-- Logs begin at Wed 2022-07-27 14:38:00 UTC, end at Wed 2022-07-27 15:49:55 UTC. -- Jul 27 15:10:32.214088 dv-cinder-841315-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 27 15:10:32.221710 dv-cinder-841315-2-smb devstack@keystone.service[80043]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 27 15:10:32.223724 dv-cinder-841315-2-smb devstack@keystone.service[80043]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 27 15:10:32 2022] *** Jul 27 15:10:32.223724 dv-cinder-841315-2-smb devstack@keystone.service[80043]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 27 15:10:32.223724 dv-cinder-841315-2-smb devstack@keystone.service[80043]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 27 15:10:32.223724 dv-cinder-841315-2-smb devstack@keystone.service[80043]: nodename: dv-cinder-841315-2-smb Jul 27 15:10:32.223724 dv-cinder-841315-2-smb devstack@keystone.service[80043]: machine: x86_64 Jul 27 15:10:32.223724 dv-cinder-841315-2-smb devstack@keystone.service[80043]: clock source: unix Jul 27 15:10:32.223724 dv-cinder-841315-2-smb devstack@keystone.service[80043]: pcre jit disabled Jul 27 15:10:32.223724 dv-cinder-841315-2-smb devstack@keystone.service[80043]: detected number of CPU cores: 4 Jul 27 15:10:32.224439 dv-cinder-841315-2-smb devstack@keystone.service[80043]: current working directory: / Jul 27 15:10:32.224439 dv-cinder-841315-2-smb devstack@keystone.service[80043]: detected binary path: /usr/bin/uwsgi-core Jul 27 15:10:32.224439 dv-cinder-841315-2-smb devstack@keystone.service[80043]: your processes number limit is 47680 Jul 27 15:10:32.224439 dv-cinder-841315-2-smb devstack@keystone.service[80043]: your memory page size is 4096 bytes Jul 27 15:10:32.224439 dv-cinder-841315-2-smb devstack@keystone.service[80043]: detected max file descriptor number: 2048 Jul 27 15:10:32.224439 dv-cinder-841315-2-smb devstack@keystone.service[80043]: lock engine: pthread robust mutexes Jul 27 15:10:32.224439 dv-cinder-841315-2-smb devstack@keystone.service[80043]: thunder lock: enabled Jul 27 15:10:32.229126 dv-cinder-841315-2-smb devstack@keystone.service[80043]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 27 15:10:32.229126 dv-cinder-841315-2-smb devstack@keystone.service[80043]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 27 15:10:32.265898 dv-cinder-841315-2-smb devstack@keystone.service[80043]: Python main interpreter initialized at 0x55bc306039c0 Jul 27 15:10:32.265898 dv-cinder-841315-2-smb devstack@keystone.service[80043]: python threads support enabled Jul 27 15:10:32.265898 dv-cinder-841315-2-smb devstack@keystone.service[80043]: your server socket listen backlog is limited to 100 connections Jul 27 15:10:32.265898 dv-cinder-841315-2-smb devstack@keystone.service[80043]: your mercy for graceful operations on workers is 90 seconds Jul 27 15:10:32.266285 dv-cinder-841315-2-smb devstack@keystone.service[80043]: mapped 403077 bytes (393 KB) for 2 cores Jul 27 15:10:32.266360 dv-cinder-841315-2-smb devstack@keystone.service[80043]: *** Operational MODE: preforking *** Jul 27 15:10:32.266647 dv-cinder-841315-2-smb devstack@keystone.service[80043]: *** uWSGI is running in multiple interpreter mode *** Jul 27 15:10:32.266647 dv-cinder-841315-2-smb devstack@keystone.service[80043]: spawned uWSGI master process (pid: 80043) Jul 27 15:10:32.266859 dv-cinder-841315-2-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 27 15:10:32.268021 dv-cinder-841315-2-smb devstack@keystone.service[80043]: spawned uWSGI worker 1 (pid: 80057, cores: 1) Jul 27 15:10:32.268021 dv-cinder-841315-2-smb devstack@keystone.service[80043]: spawned uWSGI worker 2 (pid: 80058, cores: 1) Jul 27 15:10:32.268021 dv-cinder-841315-2-smb devstack@keystone.service[80043]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 27 15:10:37.767126 dv-cinder-841315-2-smb devstack@keystone.service[80058]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 15:10:37.767126 dv-cinder-841315-2-smb devstack@keystone.service[80058]: from cryptography.utils import int_from_bytes Jul 27 15:10:37.767910 dv-cinder-841315-2-smb devstack@keystone.service[80058]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 15:10:37.767910 dv-cinder-841315-2-smb devstack@keystone.service[80058]: from cryptography.utils import int_from_bytes Jul 27 15:10:37.769768 dv-cinder-841315-2-smb devstack@keystone.service[80057]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 15:10:37.769768 dv-cinder-841315-2-smb devstack@keystone.service[80057]: from cryptography.utils import int_from_bytes Jul 27 15:10:37.770226 dv-cinder-841315-2-smb devstack@keystone.service[80057]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 15:10:37.770226 dv-cinder-841315-2-smb devstack@keystone.service[80057]: from cryptography.utils import int_from_bytes Jul 27 15:10:37.817503 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 15:10:37.817692 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 15:10:37.817883 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] command line args: [] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 15:10:37.818149 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 15:10:37.818326 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ================================================================================ {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 15:10:37.818415 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 15:10:37.818576 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] admin_token = **** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.818661 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 15:10:37.818770 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] command line args: [] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 15:10:37.818848 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] config_dir = [] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.818990 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.819077 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 15:10:37.819154 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] config_source = [] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.819224 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ================================================================================ {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 15:10:37.819335 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] debug = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.819462 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] admin_token = **** {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.819550 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.819776 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] config_dir = [] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.819899 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.820032 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.820136 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.820242 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] config_source = [] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.820242 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] debug = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.820444 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.820544 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.820664 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.820771 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.820866 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] list_limit = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.821002 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.821107 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] log_config_append = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.821107 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.821288 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.821398 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] log_dir = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.821507 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.821602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] log_file = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.821694 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.821797 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] list_limit = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.821892 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.822026 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] log_config_append = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.822137 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.822356 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.822471 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.822569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.822688 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] log_dir = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.822811 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.822937 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.823083 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] log_file = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.823214 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.823416 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.823549 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.823677 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.823811 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.823891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.824045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.824143 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.824265 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.824352 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.824476 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.824557 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.824679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.824798 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.824884 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.824995 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.825123 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.825291 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.825402 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.825515 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] publish_errors = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.825600 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.825708 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.825785 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.825893 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.826047 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.826134 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.826301 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.826387 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.826533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.826732 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.826851 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] standard_threads = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.826971 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.827210 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.827296 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.827428 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.827542 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] publish_errors = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.827616 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] use_journal = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.827721 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.827804 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] use_json = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.828009 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] use_stderr = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.828088 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.828215 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] use_syslog = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.828291 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.828406 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.828511 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.828600 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.828747 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.828831 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.828985 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] standard_threads = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.829068 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.829223 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.829308 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.829468 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.829546 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.829648 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.829724 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.829829 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] use_journal = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.829934 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.830013 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] use_json = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.830165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.830248 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] use_stderr = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.830341 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] use_syslog = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.830426 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.830575 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 15:10:37.830659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.830836 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.830913 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.831079 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.831164 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.831323 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.831403 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.831554 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.831632 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.831797 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.831885 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.832059 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.832142 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.832294 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.832377 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.832540 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.832632 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.832786 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.832874 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.833033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.833111 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.833265 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.833419 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.833493 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.833562 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.833739 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.833823 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.833978 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.834066 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.834228 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.834304 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.834457 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.834535 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.834683 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.834768 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.834909 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.834987 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.835140 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.835218 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.835384 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.835469 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.835628 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.835712 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.835856 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.835938 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.836105 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.836194 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.836350 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.836434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.836594 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.836671 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.836828 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.836913 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.837093 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.837177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.837323 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.837407 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.837558 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.837642 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.837791 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.837869 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.838019 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.838140 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.838248 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.838372 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.838499 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.838585 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.838707 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.838786 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.838936 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.839011 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.839173 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.839257 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.839402 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.839480 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.839636 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.839715 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.839863 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.839941 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.840118 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.840199 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.840351 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.840437 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.840588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.840671 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.840814 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.840892 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.841045 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.841128 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.841276 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.841353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.841511 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.841588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.841743 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.841823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.841978 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.842055 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.842206 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.842313 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.842441 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.842550 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.842672 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.842783 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.842912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.843017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.843142 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.843246 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.843381 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.843521 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.843608 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.843725 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.843830 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.843962 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.844087 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.844218 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.844296 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.844367 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.844535 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.844623 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.844778 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.844862 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.845012 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.845133 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.845251 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.845336 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.845484 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.845562 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.845716 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.845798 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.845947 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.846026 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.846190 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.846269 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.846422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.846552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.846676 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.846799 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.846931 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.847055 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.847191 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.847318 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.847434 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.847566 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.847689 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.847812 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.847934 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.848085 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.848210 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.848344 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.848472 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.848604 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.848726 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.848867 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.848993 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.849122 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.849244 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.849244 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.849427 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.849544 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.849619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.849742 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.849819 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.849935 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.850017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.850132 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.850208 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.850394 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.850473 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.850589 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.850659 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.850762 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.850842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.850968 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.851053 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.851180 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.851263 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.851379 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.851455 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.851570 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.851679 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.851769 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.851922 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.852057 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.852205 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.852294 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.852450 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.852537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.853208 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] auth.external = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.853296 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.853490 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.853625 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.853751 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.853882 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.854018 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.854141 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.854270 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.854392 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] auth.password = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.854482 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.854673 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] auth.token = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.854673 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.854867 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.854984 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.855109 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.855241 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.855395 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.855526 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.855659 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.855792 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.855916 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.856042 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.856207 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.856330 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.856330 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] credential.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.856590 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] auth.external = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.856713 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.856845 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.856978 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.857111 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.857196 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.857356 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.857488 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.857610 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] auth.password = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.857733 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.857864 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] auth.token = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.857987 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.858109 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.858237 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.858365 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.858491 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.858491 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.858744 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.858872 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.858999 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.859124 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.859261 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.859397 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.859523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.859647 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.859772 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.859899 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.860059 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] credential.caching = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.860190 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.860319 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.860445 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] federation.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.860570 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.860695 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.860822 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.860955 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.861091 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.861217 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.861342 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.861474 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.861599 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.861735 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.861861 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.861988 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.862122 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.862247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.862373 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.862506 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.862637 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.862774 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.862900 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.863026 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.863153 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.863287 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.863287 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.863526 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.863652 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.863778 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.863902 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.864055 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.864185 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.864313 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] federation.caching = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.864440 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.864577 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.864705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.864839 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.864966 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.865095 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.865223 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.865349 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.865473 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.865671 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.865801 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.865928 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.866055 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.866183 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.866321 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.866456 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.866581 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.866704 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.866837 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.866960 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.867089 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.867215 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.867337 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.867459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.caching = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.867582 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.867704 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.867840 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.867969 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.868105 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.868325 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.869079 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.869209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.869349 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.869476 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.869603 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.869729 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.869861 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.869987 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.870120 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.870248 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.870374 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.870374 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.870626 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.870704 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.870785 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.870859 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.870931 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.871001 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.871072 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.871143 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.871222 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.871296 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.871368 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.871439 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.871517 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.871590 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.871669 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.871743 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.871815 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.871886 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.871958 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.872047 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.872133 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.872208 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.872280 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.872352 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.872423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.872494 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.872573 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.872646 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.872718 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.872789 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.872861 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.872932 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.873011 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.873084 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.873156 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.873226 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.873298 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.873369 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.873448 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.873521 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.873593 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.873663 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.873794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.873874 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.874028 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.874115 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.874262 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.874341 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.874493 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.874573 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.874723 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.874804 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.874958 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.875038 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.875191 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.875269 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.875431 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.875519 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.875669 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.875752 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.875911 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.876042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.876176 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.876256 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.876406 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.876484 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.876632 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.876711 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.876864 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.876947 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.877094 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.877173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.877326 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.877407 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.877554 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.877635 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.877796 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.877876 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.878040 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.878126 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.878281 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.878360 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.878519 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.878634 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.878754 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.878882 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.878999 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.879112 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.879262 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.879342 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.879499 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.879586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.879756 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.879835 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.880022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.880105 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.880258 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.880349 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.880502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.880580 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.880735 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.880814 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.880967 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.881054 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.881201 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.881279 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.881432 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.881511 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.881663 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.881749 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.881903 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.881982 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.882135 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.882213 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.882369 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.882456 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.882614 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.882700 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.882852 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.882933 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.883081 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.883168 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.883314 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.883394 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.883555 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.883634 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] resource.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.883794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.883881 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.884088 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.884170 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.884324 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.884402 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.884570 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.884659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.884816 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.884894 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.885050 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.885130 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.885295 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.885382 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.885528 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.885606 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.885761 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.885839 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.885994 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] role.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.886081 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.886228 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.886306 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] role.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.886452 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.886585 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.886697 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.886840 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.886942 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.887084 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.887187 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.887320 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.887430 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.887585 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.887660 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.887790 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] resource.caching = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.887903 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.888069 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.888174 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.888323 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.888404 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.888562 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.888641 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.888815 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.888895 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.889070 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.889151 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.889308 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.889387 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.889557 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.889644 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.889800 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.889959 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.890045 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.890194 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.890280 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] role.caching = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.890442 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.890523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] role.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.890690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.890772 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.890935 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.891015 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.891179 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.891261 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.891411 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.891491 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.891662 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.891741 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.891910 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.892016 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.892166 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.892248 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.892395 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.892500 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.892624 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.892753 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.892854 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.892988 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.893102 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.893239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.893353 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.893490 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.893601 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.893740 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.893820 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.893989 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.894078 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.894268 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.894399 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.894499 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] token.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.894643 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.894722 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.894899 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.894979 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.895153 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.895233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.895406 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.895486 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.895653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.895732 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.895886 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.895972 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.896168 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.896274 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.896427 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.896639 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.896745 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.896888 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.897086 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.897200 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.897897 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.898369 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.898449 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.898613 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.898692 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.898852 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.898940 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.899101 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.899185 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.899353 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.899432 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.899607 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.899688 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.899848 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] token.caching = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.899926 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.900116 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.900198 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.900378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.900460 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.connection = **** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.900621 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.900712 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.900880 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.901009 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.901149 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.901278 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.901413 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.901541 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.901667 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.901795 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.901877 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.901938 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.902006 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.902067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.902280 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.902409 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.902532 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.902655 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.902797 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.902922 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.903045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.903170 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.903293 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.903415 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.903549 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.903683 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.903812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.903940 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.904088 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.904211 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.904349 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.904489 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] database.connection = **** {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.904621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.904757 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.904882 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.904882 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80058) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 15:10:37.905125 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.905125 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.905125 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.905478 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.905601 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.905826 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.906067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.906317 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.906602 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.907067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.907504 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.907960 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.908381 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.908642 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.908883 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.909134 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.913310 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 15:10:37.913310 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80057) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 15:10:37.936523 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:37.936755 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:37.936983 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:37.938592 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:37.938830 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:37.939063 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:37.945415 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:37.947556 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:37.974972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:37.975197 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:37.977055 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:37.977297 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.028596 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.029132 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.078958 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.079191 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.080943 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.081185 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.143926 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.144128 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.144352 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.144436 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.144573 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.144657 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.144790 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.144872 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.145004 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.145097 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.145239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.145458 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.169278 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.169387 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.169536 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.169620 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.169726 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.169813 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.169948 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.170039 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.170165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.170247 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.170375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.170457 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.170584 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.170674 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.181805 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.181908 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.194561 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.194790 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.194892 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.195014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.195096 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.195235 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.195317 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.195453 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.195536 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.195669 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.195750 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.195879 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80058) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.195961 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.196122 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80057) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 15:10:38.213340 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.213543 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 15:10:38.213873 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.214069 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 15:10:38.214211 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.214342 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.214470 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 15:10:38.214611 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.214738 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.214863 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.214997 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 15:10:38.215124 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.215250 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.215376 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.215627 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.215886 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.224690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.224965 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.225230 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.225506 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.225730 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.226012 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.226284 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.226566 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.232933 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 15:10:38.234160 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 15:10:38.237608 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 15:10:38.237885 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.238164 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.238439 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.238716 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.238908 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 15:10:38.239038 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.239191 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.239319 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.239474 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.239607 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.239734 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.239860 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.240011 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.240150 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.240281 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.240422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.240551 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.240805 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.241076 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.241349 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.241618 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.263239 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.264755 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 15:10:38.264940 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.265079 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.266620 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 15:10:38.267097 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.269888 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 15:10:38.270172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.270453 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.276458 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 15:10:38.276784 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.277074 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.277922 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 15:10:38.279147 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.282465 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 15:10:38.282745 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.283032 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.283308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.283577 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.283841 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 15:10:38.283978 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.284131 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.284256 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.284407 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.289201 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 15:10:38.289492 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.289779 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.290064 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.290901 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.291202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.291484 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.291769 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.301101 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.301378 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.305306 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 15:10:38.307865 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.308173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.308536 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.308827 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.312154 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 15:10:38.313202 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 15:10:38.315322 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.315621 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.316383 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 15:10:38.319534 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.319828 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.320087 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 15:10:38.320229 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.320408 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.320679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.320961 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.323350 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 15:10:38.326619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.326920 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.327209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.327499 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.327794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.328119 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.336980 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 15:10:38.337788 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.338053 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.338322 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.344859 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 15:10:38.345147 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.345274 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.345412 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.345666 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.346745 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.347017 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.349860 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 15:10:38.350137 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.350430 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.350707 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.350991 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.352649 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.354763 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.355043 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.357916 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 15:10:38.358203 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.358499 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.358781 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.359074 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.362965 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 15:10:38.363244 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.363521 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.363799 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.364102 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.364376 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.364649 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.370726 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 15:10:38.371011 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.371295 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.371578 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.371862 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.372167 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.372450 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.380205 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 15:10:38.383176 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 15:10:38.386654 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.388696 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 15:10:38.389151 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.390774 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 15:10:38.391070 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.391347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.391706 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 15:10:38.394763 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.397255 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.397829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.398764 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 15:10:38.399055 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.399358 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.399486 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 15:10:38.402881 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.403165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.403442 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.403720 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.406465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.408113 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 15:10:38.411070 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.411363 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.411650 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.411777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 15:10:38.411928 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.412099 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.412304 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.419428 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80058) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 15:10:38.419702 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.419977 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.420274 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.420411 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 15:10:38.420554 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.420686 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.420817 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.420948 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.421078 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.421327 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.421694 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.421971 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.422254 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.422514 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.422793 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.423052 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80058) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.427822 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80057) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 15:10:38.428140 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.428428 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.428707 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.428993 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.429275 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.429554 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.429822 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.430196 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.430479 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.430774 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.431089 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.431537 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.432000 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80057) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 15:10:38.457299 dv-cinder-841315-2-smb devstack@keystone.service[80058]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bc306039c0 pid: 80058 (default app) Jul 27 15:10:38.460611 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2cd57-f003-422f-9575-35c86b3cfe88 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:38.460901 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2cd57-f003-422f-9575-35c86b3cfe88 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:38.461175 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2cd57-f003-422f-9575-35c86b3cfe88 None None] PATH_INFO: `/v3` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:38.465980 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 791 bytes} [Wed Jul 27 15:10:38 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:10:38.471204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55bc306039c0 pid: 80057 (default app) Jul 27 15:10:46.144814 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8933d6-e678-4d90-b02b-286607041a1c None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:46.145370 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8933d6-e678-4d90-b02b-286607041a1c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:46.145370 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8933d6-e678-4d90-b02b-286607041a1c None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:46.146682 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 2/2] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:10:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:10:46.154700 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0cf22-9a28-4831-9565-e2e852f3c66d None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:46.155078 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0cf22-9a28-4831-9565-e2e852f3c66d None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:46.155259 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0cf22-9a28-4831-9565-e2e852f3c66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:46.230913 dv-cinder-841315-2-smb devstack@keystone.service[80057]: INFO dbcounter [None req-d9f0cf22-9a28-4831-9565-e2e852f3c66d None None] Registered counter for database keystone Jul 27 15:10:46.251735 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG oslo_db.sqlalchemy.engines [None req-d9f0cf22-9a28-4831-9565-e2e852f3c66d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80057) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 15:10:46.257890 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writer thread running {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 15:10:46.436070 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG passlib.handlers.bcrypt [None req-d9f0cf22-9a28-4831-9565-e2e852f3c66d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80057) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 27 15:10:46.436431 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG passlib.handlers.bcrypt [None req-d9f0cf22-9a28-4831-9565-e2e852f3c66d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80057) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 27 15:10:46.492375 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-d9f0cf22-9a28-4831-9565-e2e852f3c66d None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:10:46.494568 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d9f0cf22-9a28-4831-9565-e2e852f3c66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:10:46.618650 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1/3] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:10:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 467 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 27 15:10:46.755502 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8933d6-e678-4d90-b02b-286607041a1c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:10:46.824175 dv-cinder-841315-2-smb devstack@keystone.service[80058]: INFO dbcounter [None req-4e8933d6-e678-4d90-b02b-286607041a1c None None] Registered counter for database keystone Jul 27 15:10:46.842794 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG oslo_db.sqlalchemy.engines [None req-4e8933d6-e678-4d90-b02b-286607041a1c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80058) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 15:10:46.848936 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writer thread running {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 15:10:46.966300 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8933d6-e678-4d90-b02b-286607041a1c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:10:46.970685 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110f626-b09a-49b8-955d-26111fdbc29d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:10:46.971322 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110f626-b09a-49b8-955d-26111fdbc29d admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:46.971606 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110f626-b09a-49b8-955d-26111fdbc29d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:46.971884 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110f626-b09a-49b8-955d-26111fdbc29d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:46.980468 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110f626-b09a-49b8-955d-26111fdbc29d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:10:47.032080 dv-cinder-841315-2-smb devstack@keystone.service[80058]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d110f626-b09a-49b8-955d-26111fdbc29d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 27 15:10:47.032377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110f626-b09a-49b8-955d-26111fdbc29d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:10:47.042608 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 3/4] 10.222.0.40 () {58 vars in 1324 bytes} [Wed Jul 27 15:10:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 15:10:47.048542 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0cf22-9a28-4831-9565-e2e852f3c66d None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:10:47.062954 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0cf22-9a28-4831-9565-e2e852f3c66d None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:10:47.067274 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b898b-3aa4-427a-9e0c-58a81eea174a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:10:47.068416 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b898b-3aa4-427a-9e0c-58a81eea174a admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:47.068700 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b898b-3aa4-427a-9e0c-58a81eea174a admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:47.068974 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b898b-3aa4-427a-9e0c-58a81eea174a admin admin] PATH_INFO: `/v3/projects/0cee0118499d467da89c121f8970b184` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:47.070434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b898b-3aa4-427a-9e0c-58a81eea174a admin admin] RBAC: Authorizing `identity:get_project(project_id=0cee0118499d467da89c121f8970b184)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:10:47.120952 dv-cinder-841315-2-smb devstack@keystone.service[80057]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ff7b898b-3aa4-427a-9e0c-58a81eea174a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 27 15:10:47.121300 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b898b-3aa4-427a-9e0c-58a81eea174a admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:10:47.125804 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 2/5] 10.222.0.40 () {56 vars in 1207 bytes} [Wed Jul 27 15:10:47 2022] GET /identity/v3/projects/0cee0118499d467da89c121f8970b184 => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:10:49.115649 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6484ce-9e09-4d96-97a6-cd457bf3c21b None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:49.116228 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6484ce-9e09-4d96-97a6-cd457bf3c21b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:49.116317 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6484ce-9e09-4d96-97a6-cd457bf3c21b None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:49.121779 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 4/6] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:10:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:10:49.128252 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163291e-b917-47c6-9317-592659ea43d2 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:49.128666 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163291e-b917-47c6-9317-592659ea43d2 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:49.128807 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b163291e-b917-47c6-9317-592659ea43d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:49.148483 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-b163291e-b917-47c6-9317-592659ea43d2 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:10:49.149980 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b163291e-b917-47c6-9317-592659ea43d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:10:49.157642 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 3/7] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:10:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 27 15:10:49.179468 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6484ce-9e09-4d96-97a6-cd457bf3c21b None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:10:49.192146 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6484ce-9e09-4d96-97a6-cd457bf3c21b None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:10:49.196362 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c226764e-4997-4cf4-8b4d-78bf84f12c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:10:49.196972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226764e-4997-4cf4-8b4d-78bf84f12c6d admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:49.197258 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226764e-4997-4cf4-8b4d-78bf84f12c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:49.197535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c226764e-4997-4cf4-8b4d-78bf84f12c6d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:49.205168 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226764e-4997-4cf4-8b4d-78bf84f12c6d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:10:49.206928 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c226764e-4997-4cf4-8b4d-78bf84f12c6d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:10:49.215658 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 5/8] 10.222.0.40 () {58 vars in 1324 bytes} [Wed Jul 27 15:10:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 15:10:49.220616 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163291e-b917-47c6-9317-592659ea43d2 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:10:49.229863 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b163291e-b917-47c6-9317-592659ea43d2 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:10:49.234136 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc6756-b118-49bf-bed6-75019285cdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:10:49.234775 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc6756-b118-49bf-bed6-75019285cdf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:49.235054 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc6756-b118-49bf-bed6-75019285cdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:49.235326 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc6756-b118-49bf-bed6-75019285cdf8 admin admin] PATH_INFO: `/v3/users/ad4a70e32c774ff3ae25d8ff565d4a1d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:49.236686 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc6756-b118-49bf-bed6-75019285cdf8 admin admin] RBAC: Authorizing `identity:get_user(user_id=ad4a70e32c774ff3ae25d8ff565d4a1d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:10:49.238468 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc6756-b118-49bf-bed6-75019285cdf8 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:10:49.240039 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 4/9] 10.222.0.40 () {56 vars in 1198 bytes} [Wed Jul 27 15:10:49 2022] GET /identity/v3/users/ad4a70e32c774ff3ae25d8ff565d4a1d => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:10:51.283743 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455e741-11d8-44a7-ab6a-68f5125fad99 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:51.284311 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455e741-11d8-44a7-ab6a-68f5125fad99 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:51.284311 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455e741-11d8-44a7-ab6a-68f5125fad99 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:51.285666 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 6/10] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:10:51.290967 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbca0b3-5beb-4cc7-b58d-f816c9174faa None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:51.291348 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbca0b3-5beb-4cc7-b58d-f816c9174faa None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:51.291529 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbca0b3-5beb-4cc7-b58d-f816c9174faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:51.305632 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2acf6-9067-4401-9bee-38d5462d187e None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:51.305923 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2acf6-9067-4401-9bee-38d5462d187e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:51.306204 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2acf6-9067-4401-9bee-38d5462d187e None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:51.307507 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 7/11] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:10:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:10:51.310592 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-bdbca0b3-5beb-4cc7-b58d-f816c9174faa None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:10:51.311862 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-bdbca0b3-5beb-4cc7-b58d-f816c9174faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:10:51.312496 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237b1cf-9ffe-46f1-8efb-47dcb1db04c8 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:51.312783 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237b1cf-9ffe-46f1-8efb-47dcb1db04c8 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:51.313056 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237b1cf-9ffe-46f1-8efb-47dcb1db04c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:51.354674 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG passlib.handlers.bcrypt [None req-b237b1cf-9ffe-46f1-8efb-47dcb1db04c8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80058) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 27 15:10:51.355097 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG passlib.handlers.bcrypt [None req-b237b1cf-9ffe-46f1-8efb-47dcb1db04c8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80058) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 27 15:10:51.392452 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 5/12] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:10:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:10:51.405908 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b237b1cf-9ffe-46f1-8efb-47dcb1db04c8 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:10:51.407500 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b237b1cf-9ffe-46f1-8efb-47dcb1db04c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:10:51.415955 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbca0b3-5beb-4cc7-b58d-f816c9174faa None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:10:51.439635 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:10:51.506821 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 8/13] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:10:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 15:10:51.519772 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbca0b3-5beb-4cc7-b58d-f816c9174faa None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:10:51.528865 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237b1cf-9ffe-46f1-8efb-47dcb1db04c8 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:10:51.553883 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4fff3-2370-4aa9-8de8-56a13d5d0b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:10:51.554523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4fff3-2370-4aa9-8de8-56a13d5d0b21 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:51.554854 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4fff3-2370-4aa9-8de8-56a13d5d0b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:51.555154 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef4fff3-2370-4aa9-8de8-56a13d5d0b21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:51.566917 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef4fff3-2370-4aa9-8de8-56a13d5d0b21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:10:51.576465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-5ef4fff3-2370-4aa9-8de8-56a13d5d0b21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:10:51.576465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:10:51.576465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:10:51.576465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:10:51.576465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:10:51.576465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:10:51.576465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:10:51.576465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:10:51.576465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:10:51.576465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:10:51.576465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:10:51.576465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:10:51.576465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:10:51.576465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:10:51.576465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:10:51.576465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:10:51.577357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:10:51.577357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:10:51.577357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:10:51.577357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:10:51.577357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:10:51.577357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:10:51.577357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:10:51.577357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:10:51.577357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:10:51.577357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:10:51.577357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:10:51.577357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:10:51.577357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:10:51.577357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:10:51.577357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:10:51.577357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:10:51.578180 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:10:51.578180 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:10:51.578180 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:10:51.578180 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:10:51.578180 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:10:51.578180 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:10:51.578180 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:10:51.578180 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:10:51.578180 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:10:51.578180 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:10:51.578180 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:10:51.578180 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:10:51.578180 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 6/14] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jul 27 15:10:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:10:51.584357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4fff3-2370-4aa9-8de8-56a13d5d0b21 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:10:51.628461 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237b1cf-9ffe-46f1-8efb-47dcb1db04c8 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:10:51.630714 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:10:51.666054 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1addc-e238-4b44-9451-fc590bce6012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:10:51.666915 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1addc-e238-4b44-9451-fc590bce6012 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:51.667200 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1addc-e238-4b44-9451-fc590bce6012 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:51.667474 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab1addc-e238-4b44-9451-fc590bce6012 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:51.668664 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:10:51.687514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef4fff3-2370-4aa9-8de8-56a13d5d0b21 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:10:51.720302 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212a088-116b-4c4c-aa33-9659740f1cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:10:51.720911 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212a088-116b-4c4c-aa33-9659740f1cdf None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:51.721203 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212a088-116b-4c4c-aa33-9659740f1cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:51.721455 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b212a088-116b-4c4c-aa33-9659740f1cdf None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:51.722172 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212a088-116b-4c4c-aa33-9659740f1cdf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:10:51.722471 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212a088-116b-4c4c-aa33-9659740f1cdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:10:51.723844 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b212a088-116b-4c4c-aa33-9659740f1cdf None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:10:51.733783 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1addc-e238-4b44-9451-fc590bce6012 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:10:51.735320 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab1addc-e238-4b44-9451-fc590bce6012 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:10:51.736784 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 7/15] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:10:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:10:51.742079 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212a088-116b-4c4c-aa33-9659740f1cdf None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:10:51.838841 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 9/16] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:10:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 15:10:51.844628 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1addc-e238-4b44-9451-fc590bce6012 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:10:51.847781 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:10:51.947539 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b212a088-116b-4c4c-aa33-9659740f1cdf None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:10:51.948158 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab1addc-e238-4b44-9451-fc590bce6012 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:10:51.981432 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e02be7-60fb-47ee-8ac5-3e28a9c6ff0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:10:51.982078 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e02be7-60fb-47ee-8ac5-3e28a9c6ff0c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:51.982362 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e02be7-60fb-47ee-8ac5-3e28a9c6ff0c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:51.982638 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e02be7-60fb-47ee-8ac5-3e28a9c6ff0c None admin] PATH_INFO: `/v3/users/ad4a70e32c774ff3ae25d8ff565d4a1d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:51.983397 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029b5ff-1a2d-4f10-b98e-787f795cad2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:10:51.983797 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e02be7-60fb-47ee-8ac5-3e28a9c6ff0c None admin] RBAC: Authorizing `identity:get_user(user_id=ad4a70e32c774ff3ae25d8ff565d4a1d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:10:51.984271 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029b5ff-1a2d-4f10-b98e-787f795cad2b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:51.984560 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029b5ff-1a2d-4f10-b98e-787f795cad2b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:51.984841 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029b5ff-1a2d-4f10-b98e-787f795cad2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:51.985286 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e02be7-60fb-47ee-8ac5-3e28a9c6ff0c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:10:51.986878 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 8/17] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:10:51 2022] GET /identity/v3/users/ad4a70e32c774ff3ae25d8ff565d4a1d => generated 247 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:10:51.992241 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e02be7-60fb-47ee-8ac5-3e28a9c6ff0c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:10:52.004339 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029b5ff-1a2d-4f10-b98e-787f795cad2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:10:52.006895 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029b5ff-1a2d-4f10-b98e-787f795cad2b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:10:52.007374 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:10:52.024935 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-0029b5ff-1a2d-4f10-b98e-787f795cad2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:10:52.024935 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:10:52.024935 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:10:52.024935 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:10:52.024935 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:10:52.024935 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:10:52.024935 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:10:52.024935 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:10:52.024935 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:10:52.024935 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:10:52.024935 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:10:52.024935 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:10:52.024935 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:10:52.024935 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:10:52.024935 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:10:52.025833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:10:52.025833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:10:52.025833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:10:52.025833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:10:52.025833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:10:52.025833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:10:52.025833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:10:52.025833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:10:52.025833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:10:52.025833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:10:52.025833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:10:52.025833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:10:52.025833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:10:52.025833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:10:52.025833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:10:52.025833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:10:52.025833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:10:52.026632 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:10:52.026632 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:10:52.026632 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:10:52.026632 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:10:52.026632 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 10/18] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:10:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:10:52.032009 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029b5ff-1a2d-4f10-b98e-787f795cad2b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:10:52.087301 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:10:52.092452 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e02be7-60fb-47ee-8ac5-3e28a9c6ff0c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:10:52.126513 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75579c8c-9850-47f2-a751-3972657e6f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:10:52.127151 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75579c8c-9850-47f2-a751-3972657e6f15 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:52.127437 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75579c8c-9850-47f2-a751-3972657e6f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:52.127719 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75579c8c-9850-47f2-a751-3972657e6f15 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:52.128917 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75579c8c-9850-47f2-a751-3972657e6f15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:10:52.130377 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75579c8c-9850-47f2-a751-3972657e6f15 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:10:52.131777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029b5ff-1a2d-4f10-b98e-787f795cad2b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:10:52.136570 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 9/19] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:10:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:10:52.137649 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75579c8c-9850-47f2-a751-3972657e6f15 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:10:52.169509 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b59ed3c-89a9-47a0-8ad8-4e34e9d3faf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:10:52.170127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59ed3c-89a9-47a0-8ad8-4e34e9d3faf5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:52.170422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59ed3c-89a9-47a0-8ad8-4e34e9d3faf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:52.170710 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b59ed3c-89a9-47a0-8ad8-4e34e9d3faf5 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:52.172033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59ed3c-89a9-47a0-8ad8-4e34e9d3faf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:10:52.172033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59ed3c-89a9-47a0-8ad8-4e34e9d3faf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:10:52.173111 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b59ed3c-89a9-47a0-8ad8-4e34e9d3faf5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:10:52.191083 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 11/20] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:10:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:10:52.218394 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:10:52.239450 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75579c8c-9850-47f2-a751-3972657e6f15 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:10:52.276420 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec29382-a5eb-44f5-99b8-83bd73b6bc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:10:52.277054 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec29382-a5eb-44f5-99b8-83bd73b6bc23 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:52.277341 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec29382-a5eb-44f5-99b8-83bd73b6bc23 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:52.277621 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec29382-a5eb-44f5-99b8-83bd73b6bc23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:52.278435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec29382-a5eb-44f5-99b8-83bd73b6bc23 None admin] RBAC: Adding query filter params (role.id=6535f8b98008471dba33e89bd460880d, scope.domain.id=default, user.id=ad4a70e32c774ff3ae25d8ff565d4a1d) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:10:52.278753 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec29382-a5eb-44f5-99b8-83bd73b6bc23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:10:52.280251 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec29382-a5eb-44f5-99b8-83bd73b6bc23 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:10:52.287965 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 10/21] 10.222.0.40 () {56 vars in 1322 bytes} [Wed Jul 27 15:10:52 2022] GET /identity/v3/role_assignments?user.id=ad4a70e32c774ff3ae25d8ff565d4a1d&scope.domain.id=default&role.id=6535f8b98008471dba33e89bd460880d => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:10:54.693282 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791cd34-63d9-4550-a314-cb3b2d80be4e None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:54.694297 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791cd34-63d9-4550-a314-cb3b2d80be4e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:54.694818 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c791cd34-63d9-4550-a314-cb3b2d80be4e None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:54.697016 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 12/22] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:10:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:10:54.702470 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba4640-8461-42f6-8661-56c019b8335d None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:54.703323 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba4640-8461-42f6-8661-56c019b8335d None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:54.703812 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ba4640-8461-42f6-8661-56c019b8335d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:54.729024 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-86ba4640-8461-42f6-8661-56c019b8335d None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:10:54.730580 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-86ba4640-8461-42f6-8661-56c019b8335d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:10:54.761948 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748244f-254b-45fe-9ba6-a11b42b6a67f None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:54.762575 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748244f-254b-45fe-9ba6-a11b42b6a67f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:54.763081 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748244f-254b-45fe-9ba6-a11b42b6a67f None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:54.764658 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 13/23] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:10:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:10:54.770252 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de025e5-d077-4638-a7e2-f542816529ad None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:54.770803 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de025e5-d077-4638-a7e2-f542816529ad None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:54.771279 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de025e5-d077-4638-a7e2-f542816529ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:54.813974 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-1de025e5-d077-4638-a7e2-f542816529ad None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:10:54.815532 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1de025e5-d077-4638-a7e2-f542816529ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:10:54.840611 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 11/24] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:10:54.877923 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba4640-8461-42f6-8661-56c019b8335d None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:10:54.969544 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 14/25] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 15:10:54.996790 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de025e5-d077-4638-a7e2-f542816529ad None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:10:55.038562 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:10:55.067221 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:10:55.083197 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ba4640-8461-42f6-8661-56c019b8335d None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:10:55.128427 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de025e5-d077-4638-a7e2-f542816529ad None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:10:55.132025 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad5398-4aca-401d-af2c-13296d2f3d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:10:55.132883 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad5398-4aca-401d-af2c-13296d2f3d67 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:55.133390 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad5398-4aca-401d-af2c-13296d2f3d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:55.133901 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad5398-4aca-401d-af2c-13296d2f3d67 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:55.134834 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad5398-4aca-401d-af2c-13296d2f3d67 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:10:55.136893 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad5398-4aca-401d-af2c-13296d2f3d67 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:10:55.172277 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2499c865-35ae-45ea-b240-00d0e1429d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:10:55.173237 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499c865-35ae-45ea-b240-00d0e1429d89 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:55.173659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499c865-35ae-45ea-b240-00d0e1429d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:55.174068 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2499c865-35ae-45ea-b240-00d0e1429d89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:55.187459 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2499c865-35ae-45ea-b240-00d0e1429d89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:10:55.194459 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-2499c865-35ae-45ea-b240-00d0e1429d89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:10:55.194459 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:10:55.194459 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:10:55.194459 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:10:55.194459 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:10:55.194459 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:10:55.194459 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:10:55.194459 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:10:55.194459 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:10:55.194459 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:10:55.194459 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:10:55.194459 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:10:55.194459 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:10:55.194459 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:10:55.194459 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:10:55.194459 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:10:55.195379 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:10:55.195379 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:10:55.195379 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:10:55.195379 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:10:55.195379 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:10:55.195379 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:10:55.195379 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:10:55.195379 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:10:55.195379 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:10:55.195379 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:10:55.195379 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:10:55.195379 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:10:55.195379 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:10:55.195379 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:10:55.195379 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:10:55.195379 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:10:55.196229 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:10:55.196229 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:10:55.196229 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:10:55.196229 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:10:55.196229 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:10:55.196229 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:10:55.196229 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:10:55.196229 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:10:55.196229 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:10:55.196229 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:10:55.196229 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:10:55.196229 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:10:55.198553 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 15/26] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jul 27 15:10:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:10:55.200076 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce777a9-38a1-4e2a-bc25-5252d0ab0dbf None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:55.200575 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce777a9-38a1-4e2a-bc25-5252d0ab0dbf None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:55.201057 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce777a9-38a1-4e2a-bc25-5252d0ab0dbf None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:55.202496 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 16/27] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:10:55.203703 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a243b4-df0d-4559-b0c6-ced36679b435 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:55.204208 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a243b4-df0d-4559-b0c6-ced36679b435 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:55.204681 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a243b4-df0d-4559-b0c6-ced36679b435 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:55.206165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 17/28] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:10:55.207821 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ed385-c6da-46f4-93b2-5444651b3f19 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:55.208329 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ed385-c6da-46f4-93b2-5444651b3f19 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:55.208799 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336ed385-c6da-46f4-93b2-5444651b3f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:55.232642 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-336ed385-c6da-46f4-93b2-5444651b3f19 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:10:55.233828 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-336ed385-c6da-46f4-93b2-5444651b3f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:10:55.278890 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 12/29] 10.222.0.40 () {60 vars in 1131 bytes} [Wed Jul 27 15:10:54 2022] POST /identity/v3/roles => generated 219 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:10:55.280714 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a412a-6c24-4163-ba47-e6db1bc8360a None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:55.281224 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a412a-6c24-4163-ba47-e6db1bc8360a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:55.281715 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a412a-6c24-4163-ba47-e6db1bc8360a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:55.302982 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-ae9a412a-6c24-4163-ba47-e6db1bc8360a None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:10:55.305027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ae9a412a-6c24-4163-ba47-e6db1bc8360a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:10:55.309651 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 18/30] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:10:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:10:55.310110 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ed385-c6da-46f4-93b2-5444651b3f19 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:10:55.347343 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:10:55.387246 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 13/31] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:10:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:10:55.388506 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a412a-6c24-4163-ba47-e6db1bc8360a None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:10:55.472643 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:10:55.515303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9a412a-6c24-4163-ba47-e6db1bc8360a None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:10:55.530500 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336ed385-c6da-46f4-93b2-5444651b3f19 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:10:55.557181 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31621639-eb11-4c52-9b3f-51039f5cc997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:10:55.558224 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31621639-eb11-4c52-9b3f-51039f5cc997 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:55.558707 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31621639-eb11-4c52-9b3f-51039f5cc997 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:55.559247 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31621639-eb11-4c52-9b3f-51039f5cc997 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:55.570874 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31621639-eb11-4c52-9b3f-51039f5cc997 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:10:55.571816 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3930c-50ea-42b2-851b-d2eebe6b9c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:10:55.572576 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3930c-50ea-42b2-851b-d2eebe6b9c29 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:55.572965 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3930c-50ea-42b2-851b-d2eebe6b9c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:55.573348 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3930c-50ea-42b2-851b-d2eebe6b9c29 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:55.573532 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31621639-eb11-4c52-9b3f-51039f5cc997 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:10:55.574262 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3930c-50ea-42b2-851b-d2eebe6b9c29 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:10:55.574674 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3930c-50ea-42b2-851b-d2eebe6b9c29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:10:55.576232 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3930c-50ea-42b2-851b-d2eebe6b9c29 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:10:55.590894 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 19/32] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:10:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:10:55.590894 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3930c-50ea-42b2-851b-d2eebe6b9c29 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:10:55.598453 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-31621639-eb11-4c52-9b3f-51039f5cc997 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:10:55.598453 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:10:55.598453 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:10:55.598453 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:10:55.598453 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:10:55.598453 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:10:55.598453 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:10:55.598453 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:10:55.598453 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:10:55.598453 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:10:55.598453 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:10:55.598453 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:10:55.598453 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:10:55.598453 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:10:55.598453 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:10:55.599270 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:10:55.599270 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:10:55.599270 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:10:55.599270 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:10:55.599270 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:10:55.599270 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:10:55.599270 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:10:55.599270 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:10:55.599270 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:10:55.599270 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:10:55.599270 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:10:55.599270 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:10:55.599270 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:10:55.599270 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:10:55.599270 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:10:55.599270 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:10:55.599270 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:10:55.600117 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:10:55.600117 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:10:55.600117 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:10:55.600117 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:10:55.602091 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 14/33] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:10:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:10:55.603706 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31621639-eb11-4c52-9b3f-51039f5cc997 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:10:55.721527 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3930c-50ea-42b2-851b-d2eebe6b9c29 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:10:55.731921 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:10:55.744839 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31621639-eb11-4c52-9b3f-51039f5cc997 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:10:55.774129 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:10:55.794782 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462b94e-f2f3-4c77-83d8-359eec8389d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:10:55.795414 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462b94e-f2f3-4c77-83d8-359eec8389d1 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:55.795764 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462b94e-f2f3-4c77-83d8-359eec8389d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:55.795979 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462b94e-f2f3-4c77-83d8-359eec8389d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:55.796757 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0462b94e-f2f3-4c77-83d8-359eec8389d1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:10:55.798146 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0462b94e-f2f3-4c77-83d8-359eec8389d1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:10:55.810842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1714094-fd73-497f-8791-62ee6804d573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:10:55.811901 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1714094-fd73-497f-8791-62ee6804d573 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:55.812519 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1714094-fd73-497f-8791-62ee6804d573 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:55.813091 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1714094-fd73-497f-8791-62ee6804d573 None admin] PATH_INFO: `/v3/users/ad4a70e32c774ff3ae25d8ff565d4a1d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:55.814930 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1714094-fd73-497f-8791-62ee6804d573 None admin] RBAC: Authorizing `identity:get_user(user_id=ad4a70e32c774ff3ae25d8ff565d4a1d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:10:55.816770 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1714094-fd73-497f-8791-62ee6804d573 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:10:55.819162 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 15/34] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:10:55 2022] GET /identity/v3/users/ad4a70e32c774ff3ae25d8ff565d4a1d => generated 247 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:10:55.820202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1714094-fd73-497f-8791-62ee6804d573 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:10:55.931132 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1714094-fd73-497f-8791-62ee6804d573 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:10:55.931801 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 20/35] 10.222.0.40 () {60 vars in 1131 bytes} [Wed Jul 27 15:10:55 2022] POST /identity/v3/roles => generated 225 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:10:55.932942 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462b94e-f2f3-4c77-83d8-359eec8389d1 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:10:56.002171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0502ca3c-ff97-409a-8c67-a162115193dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:10:56.003143 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502ca3c-ff97-409a-8c67-a162115193dd None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:56.003631 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502ca3c-ff97-409a-8c67-a162115193dd None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:56.004160 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0502ca3c-ff97-409a-8c67-a162115193dd None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:56.005074 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0502ca3c-ff97-409a-8c67-a162115193dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:10:56.005607 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0502ca3c-ff97-409a-8c67-a162115193dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:10:56.007235 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0502ca3c-ff97-409a-8c67-a162115193dd None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:10:56.030310 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 16/36] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:10:56.037117 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78fe258-e83e-4b9b-9bbc-9a06ceac280c None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:56.037117 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78fe258-e83e-4b9b-9bbc-9a06ceac280c None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:56.037117 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78fe258-e83e-4b9b-9bbc-9a06ceac280c None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:56.040200 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 17/37] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:10:56 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:10:56.040819 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78fe258-e83e-4b9b-9bbc-9a06ceac280c None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:10:56.066249 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462b94e-f2f3-4c77-83d8-359eec8389d1 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:10:56.102194 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:10:56.108240 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6e267d-40f6-423b-afca-505a7ad5f3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:10:56.109222 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e267d-40f6-423b-afca-505a7ad5f3d1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:56.109495 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e267d-40f6-423b-afca-505a7ad5f3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:56.109877 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6e267d-40f6-423b-afca-505a7ad5f3d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:56.111644 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e267d-40f6-423b-afca-505a7ad5f3d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:10:56.113389 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6e267d-40f6-423b-afca-505a7ad5f3d1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:10:56.115668 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 21/38] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:10:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:10:56.117399 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfa406-83db-4f86-80ab-e1bff9bf3e08 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:56.117706 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfa406-83db-4f86-80ab-e1bff9bf3e08 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:56.118645 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfa406-83db-4f86-80ab-e1bff9bf3e08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:56.141013 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-e4bfa406-83db-4f86-80ab-e1bff9bf3e08 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:10:56.142602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e4bfa406-83db-4f86-80ab-e1bff9bf3e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:10:56.166842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78fe258-e83e-4b9b-9bbc-9a06ceac280c None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:10:56.167467 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:10:56.208113 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c58d0-27cd-432c-a42d-316902003299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:10:56.208742 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c58d0-27cd-432c-a42d-316902003299 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:56.209027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c58d0-27cd-432c-a42d-316902003299 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:56.209304 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c58d0-27cd-432c-a42d-316902003299 None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:56.210410 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13c58d0-27cd-432c-a42d-316902003299 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:10:56.211933 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13c58d0-27cd-432c-a42d-316902003299 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:10:56.223140 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 22/39] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:10:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:10:56.223958 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfa406-83db-4f86-80ab-e1bff9bf3e08 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:10:56.260165 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 18/40] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Jul 27 15:10:56 2022] POST /identity/v3/projects => generated 301 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:10:56.260165 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3cebd-eec6-445c-b233-83c657c3db4d None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:56.260165 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3cebd-eec6-445c-b233-83c657c3db4d None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:56.260165 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3cebd-eec6-445c-b233-83c657c3db4d None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:56.260165 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 19/41] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:10:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:10:56.260165 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca3cebd-eec6-445c-b233-83c657c3db4d None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:10:56.342439 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfa406-83db-4f86-80ab-e1bff9bf3e08 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:10:56.374408 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:10:56.381033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdebc50-0632-42cd-bb2a-05833b6c25f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:10:56.381737 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdebc50-0632-42cd-bb2a-05833b6c25f1 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:56.382023 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdebc50-0632-42cd-bb2a-05833b6c25f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:56.382307 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdebc50-0632-42cd-bb2a-05833b6c25f1 None admin] PATH_INFO: `/v3/domains/default/users/ad4a70e32c774ff3ae25d8ff565d4a1d/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:56.383422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca3cebd-eec6-445c-b233-83c657c3db4d None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:10:56.385299 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdebc50-0632-42cd-bb2a-05833b6c25f1 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ad4a70e32c774ff3ae25d8ff565d4a1d, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:10:56.386946 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdebc50-0632-42cd-bb2a-05833b6c25f1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:10:56.406043 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 23/42] 10.222.0.40 () {58 vars in 1361 bytes} [Wed Jul 27 15:10:56 2022] PUT /identity/v3/domains/default/users/ad4a70e32c774ff3ae25d8ff565d4a1d/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:10:56.408916 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6d5e4-f55b-43f3-9c1b-6153862eb484 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:56.409218 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6d5e4-f55b-43f3-9c1b-6153862eb484 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:56.409496 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6d5e4-f55b-43f3-9c1b-6153862eb484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:56.429055 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165b2c0-11e0-42b0-854c-4394561a736e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:10:56.429557 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d5a6d5e4-f55b-43f3-9c1b-6153862eb484 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:10:56.429695 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165b2c0-11e0-42b0-854c-4394561a736e None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:56.429986 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165b2c0-11e0-42b0-854c-4394561a736e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:56.430296 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165b2c0-11e0-42b0-854c-4394561a736e None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:56.431653 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165b2c0-11e0-42b0-854c-4394561a736e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:10:56.432212 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d5a6d5e4-f55b-43f3-9c1b-6153862eb484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:10:56.433108 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165b2c0-11e0-42b0-854c-4394561a736e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:10:56.447280 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:10:56.450209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 20/43] 10.222.0.40 () {60 vars in 1131 bytes} [Wed Jul 27 15:10:56 2022] POST /identity/v3/roles => generated 223 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:10:56.526506 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 24/44] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:10:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:10:56.550283 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165b2c0-11e0-42b0-854c-4394561a736e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:10:56.675341 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165b2c0-11e0-42b0-854c-4394561a736e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:10:56.709306 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8974a-f67b-4a67-8aee-9e97a01635cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:10:56.709954 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8974a-f67b-4a67-8aee-9e97a01635cd None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:56.710239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8974a-f67b-4a67-8aee-9e97a01635cd None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:56.710518 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8974a-f67b-4a67-8aee-9e97a01635cd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:56.711683 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8974a-f67b-4a67-8aee-9e97a01635cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:10:56.713147 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8974a-f67b-4a67-8aee-9e97a01635cd None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:10:56.714771 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 21/45] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:10:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:10:56.720491 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6d5e4-f55b-43f3-9c1b-6153862eb484 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:10:56.817777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6d5e4-f55b-43f3-9c1b-6153862eb484 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:10:56.850551 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8152bc6-3de1-4498-b3ee-2a967a04df8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:10:56.851179 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8152bc6-3de1-4498-b3ee-2a967a04df8f None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:56.851466 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8152bc6-3de1-4498-b3ee-2a967a04df8f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:56.851745 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8152bc6-3de1-4498-b3ee-2a967a04df8f None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:56.852554 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8152bc6-3de1-4498-b3ee-2a967a04df8f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:10:56.854003 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8152bc6-3de1-4498-b3ee-2a967a04df8f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:10:56.875514 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:10:56.884727 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 25/46] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Jul 27 15:10:56 2022] POST /identity/v3/projects => generated 312 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:10:58.418374 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca0796-2470-48e5-a176-2cb600fec1d1 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:58.418887 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca0796-2470-48e5-a176-2cb600fec1d1 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:58.418967 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdca0796-2470-48e5-a176-2cb600fec1d1 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:58.420356 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 22/47] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:10:58.425382 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ae253-feea-4688-ab86-69410c1346a0 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:58.425791 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ae253-feea-4688-ab86-69410c1346a0 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:58.425944 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ae253-feea-4688-ab86-69410c1346a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:58.443962 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-043ae253-feea-4688-ab86-69410c1346a0 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:10:58.445166 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-043ae253-feea-4688-ab86-69410c1346a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:10:58.510181 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 26/48] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 15:10:58.532310 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca0796-2470-48e5-a176-2cb600fec1d1 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:10:58.558072 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:10:58.642505 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdca0796-2470-48e5-a176-2cb600fec1d1 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:10:58.677255 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c61efb-ff1f-4914-9155-ca7bae8d99fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:10:58.677833 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c61efb-ff1f-4914-9155-ca7bae8d99fc None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:58.678120 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c61efb-ff1f-4914-9155-ca7bae8d99fc None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:58.678400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c61efb-ff1f-4914-9155-ca7bae8d99fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:58.688989 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c61efb-ff1f-4914-9155-ca7bae8d99fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:10:58.694007 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-a3c61efb-ff1f-4914-9155-ca7bae8d99fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:10:58.694007 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:10:58.694007 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:10:58.694007 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:10:58.694007 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:10:58.694007 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:10:58.694007 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:10:58.694007 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:10:58.694007 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:10:58.694007 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:10:58.694007 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:10:58.694007 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:10:58.694007 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:10:58.694007 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:10:58.694007 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:10:58.694007 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:10:58.694883 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:10:58.694883 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:10:58.694883 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:10:58.694883 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:10:58.694883 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:10:58.694883 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:10:58.694883 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:10:58.694883 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:10:58.694883 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:10:58.694883 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:10:58.694883 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:10:58.694883 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:10:58.694883 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:10:58.694883 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:10:58.694883 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:10:58.694883 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:10:58.695691 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:10:58.695691 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:10:58.695691 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:10:58.695691 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:10:58.695691 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:10:58.695691 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:10:58.695691 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:10:58.695691 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:10:58.695691 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:10:58.695691 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:10:58.695691 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:10:58.695691 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:10:58.695691 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 23/49] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jul 27 15:10:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:10:58.701035 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ae253-feea-4688-ab86-69410c1346a0 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:10:58.796224 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ae253-feea-4688-ab86-69410c1346a0 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:10:58.821754 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:10:58.829689 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b54d7-7e64-4820-bc49-a3c86685cf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:10:58.830310 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b54d7-7e64-4820-bc49-a3c86685cf36 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:58.830593 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b54d7-7e64-4820-bc49-a3c86685cf36 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:58.830866 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b54d7-7e64-4820-bc49-a3c86685cf36 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:58.831580 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b54d7-7e64-4820-bc49-a3c86685cf36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:10:58.831885 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b54d7-7e64-4820-bc49-a3c86685cf36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:10:58.833279 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b54d7-7e64-4820-bc49-a3c86685cf36 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:10:58.841267 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 27/50] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:10:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:10:58.846715 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c61efb-ff1f-4914-9155-ca7bae8d99fc None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:10:58.897490 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728dbd8-f169-4d5d-9635-64504e487296 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:58.897779 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728dbd8-f169-4d5d-9635-64504e487296 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:58.898061 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728dbd8-f169-4d5d-9635-64504e487296 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:58.899427 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 28/51] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:10:58.904413 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90233d4-88f7-437e-aa8f-9f61553a82ae None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:58.904704 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90233d4-88f7-437e-aa8f-9f61553a82ae None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:58.905014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90233d4-88f7-437e-aa8f-9f61553a82ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:58.923495 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f90233d4-88f7-437e-aa8f-9f61553a82ae None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:10:58.924713 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f90233d4-88f7-437e-aa8f-9f61553a82ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:10:58.931659 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:10:58.948288 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c61efb-ff1f-4914-9155-ca7bae8d99fc None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:10:58.981737 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30975095-0374-452b-9a13-e787a864823e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:10:58.982375 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30975095-0374-452b-9a13-e787a864823e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:58.982664 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30975095-0374-452b-9a13-e787a864823e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:58.982944 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30975095-0374-452b-9a13-e787a864823e None admin] PATH_INFO: `/v3/users/ad4a70e32c774ff3ae25d8ff565d4a1d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:58.984150 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30975095-0374-452b-9a13-e787a864823e None admin] RBAC: Authorizing `identity:get_user(user_id=ad4a70e32c774ff3ae25d8ff565d4a1d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:10:58.985609 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30975095-0374-452b-9a13-e787a864823e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:10:58.987232 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 24/52] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:10:58 2022] GET /identity/v3/users/ad4a70e32c774ff3ae25d8ff565d4a1d => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:10:58.991125 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 29/53] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 15:10:58.992629 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30975095-0374-452b-9a13-e787a864823e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:10:59.013672 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90233d4-88f7-437e-aa8f-9f61553a82ae None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:10:59.092492 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30975095-0374-452b-9a13-e787a864823e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:10:59.110249 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90233d4-88f7-437e-aa8f-9f61553a82ae None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:10:59.128950 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6338b-9f69-4da4-9f78-c13dda9ce258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:10:59.129594 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6338b-9f69-4da4-9f78-c13dda9ce258 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:59.129882 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6338b-9f69-4da4-9f78-c13dda9ce258 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:59.130163 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6338b-9f69-4da4-9f78-c13dda9ce258 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:59.131204 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:10:59.132047 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc6338b-9f69-4da4-9f78-c13dda9ce258 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:10:59.133289 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc6338b-9f69-4da4-9f78-c13dda9ce258 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:10:59.134910 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 25/54] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:10:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:10:59.140679 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6338b-9f69-4da4-9f78-c13dda9ce258 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:10:59.153743 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd828f-ae16-4b0e-935a-052a868ee341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:10:59.154391 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd828f-ae16-4b0e-935a-052a868ee341 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:59.154686 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd828f-ae16-4b0e-935a-052a868ee341 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:59.154967 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dd828f-ae16-4b0e-935a-052a868ee341 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:59.156170 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd828f-ae16-4b0e-935a-052a868ee341 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:10:59.157632 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dd828f-ae16-4b0e-935a-052a868ee341 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:10:59.159392 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 30/55] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:10:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:10:59.162942 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:10:59.165651 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd828f-ae16-4b0e-935a-052a868ee341 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:10:59.240927 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6338b-9f69-4da4-9f78-c13dda9ce258 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:10:59.264317 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dd828f-ae16-4b0e-935a-052a868ee341 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:10:59.274707 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef74c67-eb24-4c4b-b22f-aaf72cd01aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:10:59.275550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef74c67-eb24-4c4b-b22f-aaf72cd01aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:59.275834 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef74c67-eb24-4c4b-b22f-aaf72cd01aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:59.276143 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef74c67-eb24-4c4b-b22f-aaf72cd01aa5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:59.276945 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef74c67-eb24-4c4b-b22f-aaf72cd01aa5 None admin] RBAC: Adding query filter params (role.id=6535f8b98008471dba33e89bd460880d, scope.domain.id=default, user.id=ad4a70e32c774ff3ae25d8ff565d4a1d) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:10:59.277265 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef74c67-eb24-4c4b-b22f-aaf72cd01aa5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:10:59.278699 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef74c67-eb24-4c4b-b22f-aaf72cd01aa5 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:10:59.286225 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 26/56] 10.222.0.40 () {56 vars in 1322 bytes} [Wed Jul 27 15:10:59 2022] GET /identity/v3/role_assignments?user.id=ad4a70e32c774ff3ae25d8ff565d4a1d&scope.domain.id=default&role.id=6535f8b98008471dba33e89bd460880d => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:10:59.302214 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7285683-5a0b-4cf2-9dbe-b151346bbd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:10:59.302860 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7285683-5a0b-4cf2-9dbe-b151346bbd78 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:10:59.303145 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7285683-5a0b-4cf2-9dbe-b151346bbd78 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:10:59.303420 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7285683-5a0b-4cf2-9dbe-b151346bbd78 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:10:59.304178 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7285683-5a0b-4cf2-9dbe-b151346bbd78 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:10:59.305680 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7285683-5a0b-4cf2-9dbe-b151346bbd78 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:10:59.333421 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 31/57] 10.222.0.40 () {60 vars in 1140 bytes} [Wed Jul 27 15:10:59 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:11:01.350398 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f480359-491b-4809-838f-9fff7b7d9959 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:01.350914 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f480359-491b-4809-838f-9fff7b7d9959 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:01.350998 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f480359-491b-4809-838f-9fff7b7d9959 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:01.352956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 27/58] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:01.358079 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73fd327-0e0a-4571-8526-0be20401f61d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:01.358499 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73fd327-0e0a-4571-8526-0be20401f61d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:01.358630 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73fd327-0e0a-4571-8526-0be20401f61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:01.376360 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a73fd327-0e0a-4571-8526-0be20401f61d None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:01.377520 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a73fd327-0e0a-4571-8526-0be20401f61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:01.410482 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:01.444131 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 32/59] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:01.468132 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f480359-491b-4809-838f-9fff7b7d9959 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:01.550121 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:01.566526 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f480359-491b-4809-838f-9fff7b7d9959 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:01.599169 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5adc14-d76d-487e-8f51-5e8a1a044d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:01.599800 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5adc14-d76d-487e-8f51-5e8a1a044d00 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:01.600119 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5adc14-d76d-487e-8f51-5e8a1a044d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:01.600397 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5adc14-d76d-487e-8f51-5e8a1a044d00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:01.601574 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5adc14-d76d-487e-8f51-5e8a1a044d00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:01.603498 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5adc14-d76d-487e-8f51-5e8a1a044d00 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:01.605102 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 28/60] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:11:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:01.610598 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73fd327-0e0a-4571-8526-0be20401f61d None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:01.706163 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73fd327-0e0a-4571-8526-0be20401f61d None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:01.738791 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1c5a71-e10e-44e0-a63f-ff84d18b5072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:01.739398 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c5a71-e10e-44e0-a63f-ff84d18b5072 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:01.739685 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c5a71-e10e-44e0-a63f-ff84d18b5072 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:01.739960 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1c5a71-e10e-44e0-a63f-ff84d18b5072 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:01.740674 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1c5a71-e10e-44e0-a63f-ff84d18b5072 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:01.742113 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1c5a71-e10e-44e0-a63f-ff84d18b5072 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:01.768032 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 33/61] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Jul 27 15:11:01 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:11:04.822677 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41970c-5ba1-46d7-8601-13a39976a9c4 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:04.823705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41970c-5ba1-46d7-8601-13a39976a9c4 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:04.824235 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c41970c-5ba1-46d7-8601-13a39976a9c4 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:04.825801 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 29/62] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:04.831123 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e667229-300d-4d25-b5d7-1721e3a96722 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:04.832980 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3bdc6-34ff-4b86-a869-bbd923a87a73 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:04.833507 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3bdc6-34ff-4b86-a869-bbd923a87a73 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:04.833995 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3bdc6-34ff-4b86-a869-bbd923a87a73 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:04.835665 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 30/63] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:04.836206 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e667229-300d-4d25-b5d7-1721e3a96722 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:04.836759 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e667229-300d-4d25-b5d7-1721e3a96722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:04.840205 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7dfb4-492a-422c-bc06-9ff7df1d164b None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:04.840717 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7dfb4-492a-422c-bc06-9ff7df1d164b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:04.841193 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7dfb4-492a-422c-bc06-9ff7df1d164b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:04.873704 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-c2f7dfb4-492a-422c-bc06-9ff7df1d164b None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:04.874932 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-c2f7dfb4-492a-422c-bc06-9ff7df1d164b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:04.875351 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-2e667229-300d-4d25-b5d7-1721e3a96722 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:04.877803 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2e667229-300d-4d25-b5d7-1721e3a96722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:04.900873 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:04.972613 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 34/64] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:05.000778 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e667229-300d-4d25-b5d7-1721e3a96722 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:05.014132 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 31/65] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 15:11:05.049321 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7dfb4-492a-422c-bc06-9ff7df1d164b None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:05.147327 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e667229-300d-4d25-b5d7-1721e3a96722 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:05.186714 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:05.191463 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261ed0c-b9cb-4747-b444-0c523929308b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:05.192322 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261ed0c-b9cb-4747-b444-0c523929308b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:05.192783 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261ed0c-b9cb-4747-b444-0c523929308b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:05.193204 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261ed0c-b9cb-4747-b444-0c523929308b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:05.203874 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261ed0c-b9cb-4747-b444-0c523929308b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:05.208383 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7dfb4-492a-422c-bc06-9ff7df1d164b None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:05.209034 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-f261ed0c-b9cb-4747-b444-0c523929308b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 15:11:05.209034 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:05.209034 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:05.209034 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:05.209034 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:05.209034 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:05.209034 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:05.209034 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:05.209034 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:05.209034 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:05.209034 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:05.209034 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:05.209034 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:05.209034 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:05.209034 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:05.209034 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:05.210032 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:05.210032 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:05.210032 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:05.210032 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:05.210032 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:05.210032 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:05.210032 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:05.210032 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:05.210032 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:05.210032 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:05.210032 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:05.210032 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:05.210032 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:05.210032 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:05.210032 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:05.210032 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:05.210979 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:05.210979 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:05.210979 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:05.210979 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:05.210979 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:05.210979 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:05.210979 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:05.210979 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:05.210979 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:05.210979 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:05.210979 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 15:11:05.210979 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:11:05.210979 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 35/66] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:11:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:11:05.212374 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af5ed0-5e81-4ae8-8e00-a9a8161fe79e None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:05.212813 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af5ed0-5e81-4ae8-8e00-a9a8161fe79e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:05.213233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34af5ed0-5e81-4ae8-8e00-a9a8161fe79e None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:05.214653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 36/67] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:05.219876 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af5ed0-5e81-4ae8-8e00-a9a8161fe79e None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:05.238801 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:05.254991 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8dbffc-5d18-44a8-9eca-0fdfe3850fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:05.255902 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8dbffc-5d18-44a8-9eca-0fdfe3850fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:05.256218 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8dbffc-5d18-44a8-9eca-0fdfe3850fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:05.256494 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8dbffc-5d18-44a8-9eca-0fdfe3850fa7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:05.268934 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8dbffc-5d18-44a8-9eca-0fdfe3850fa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:05.275838 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-0a8dbffc-5d18-44a8-9eca-0fdfe3850fa7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:11:05.275838 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:05.275838 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:05.275838 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:05.275838 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:05.275838 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:05.275838 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:05.275838 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:05.275838 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:05.275838 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:05.275838 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:05.275838 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:05.275838 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:05.275838 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:05.275838 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:05.275838 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:05.276705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:05.276705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:05.276705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:05.276705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:05.276705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:05.276705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:05.276705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:05.276705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:05.276705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:05.276705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:05.276705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:05.276705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:05.276705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:05.276705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:05.276705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:05.276705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:05.277477 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:05.277477 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:05.277477 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:05.277477 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:05.277477 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:05.277477 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:05.277477 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:05.277477 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:05.277477 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:05.277477 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:05.277477 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:11:05.277477 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:11:05.277477 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 32/68] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jul 27 15:11:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:11:05.278383 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5cb7e-8a32-4a14-a7f9-4d5e275fc2d3 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:05.278833 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5cb7e-8a32-4a14-a7f9-4d5e275fc2d3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:05.279396 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5cb7e-8a32-4a14-a7f9-4d5e275fc2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:05.303330 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-48c5cb7e-8a32-4a14-a7f9-4d5e275fc2d3 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:05.305876 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-48c5cb7e-8a32-4a14-a7f9-4d5e275fc2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:05.335903 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34af5ed0-5e81-4ae8-8e00-a9a8161fe79e None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:05.377082 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e13a5b-cb09-4b38-9d8a-ef644fdca4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:05.378106 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e13a5b-cb09-4b38-9d8a-ef644fdca4be None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:05.378556 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e13a5b-cb09-4b38-9d8a-ef644fdca4be None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:05.380464 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e13a5b-cb09-4b38-9d8a-ef644fdca4be None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:05.381742 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e13a5b-cb09-4b38-9d8a-ef644fdca4be None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:05.382426 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e13a5b-cb09-4b38-9d8a-ef644fdca4be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:05.384891 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e13a5b-cb09-4b38-9d8a-ef644fdca4be None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:05.391459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 33/69] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:05.395380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 37/70] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jul 27 15:11:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:05.396595 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e13a5b-cb09-4b38-9d8a-ef644fdca4be None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:05.401073 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5cb7e-8a32-4a14-a7f9-4d5e275fc2d3 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:05.499813 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:05.503727 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:05.526913 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e13a5b-cb09-4b38-9d8a-ef644fdca4be None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:05.530076 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5cb7e-8a32-4a14-a7f9-4d5e275fc2d3 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:05.560742 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56847af0-abf9-4d1a-a3bc-5e4d2c6c3a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:05.561361 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56847af0-abf9-4d1a-a3bc-5e4d2c6c3a16 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:05.561647 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56847af0-abf9-4d1a-a3bc-5e4d2c6c3a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:05.561930 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56847af0-abf9-4d1a-a3bc-5e4d2c6c3a16 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:05.562649 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56847af0-abf9-4d1a-a3bc-5e4d2c6c3a16 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:05.562960 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56847af0-abf9-4d1a-a3bc-5e4d2c6c3a16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:05.564093 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4122f57b-df20-49d6-83b2-d6b5a96b7633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:05.564374 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56847af0-abf9-4d1a-a3bc-5e4d2c6c3a16 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:05.564733 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122f57b-df20-49d6-83b2-d6b5a96b7633 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:05.565020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122f57b-df20-49d6-83b2-d6b5a96b7633 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:05.565302 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4122f57b-df20-49d6-83b2-d6b5a96b7633 None admin] PATH_INFO: `/v3/users/ba54789172a447cfa1bd06445f4610b8` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:05.572741 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 38/71] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:11:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:05.573228 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56847af0-abf9-4d1a-a3bc-5e4d2c6c3a16 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:05.579879 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122f57b-df20-49d6-83b2-d6b5a96b7633 None admin] RBAC: Authorizing `identity:get_user(user_id=ba54789172a447cfa1bd06445f4610b8)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:05.581377 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4122f57b-df20-49d6-83b2-d6b5a96b7633 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:05.583620 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 34/72] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:11:05 2022] GET /identity/v3/users/ba54789172a447cfa1bd06445f4610b8 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:11:05.586817 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807cbcc-f5c6-4dd1-903f-d67a0f9ebf0c None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:05.586817 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807cbcc-f5c6-4dd1-903f-d67a0f9ebf0c None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:05.586817 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4807cbcc-f5c6-4dd1-903f-d67a0f9ebf0c None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:05.587699 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 35/73] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:05.589261 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb86c5-a220-4f87-9377-49fa0d9e4dc3 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:05.589553 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb86c5-a220-4f87-9377-49fa0d9e4dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:05.590500 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb86c5-a220-4f87-9377-49fa0d9e4dc3 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:05.594869 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 36/74] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:05.594869 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb86c5-a220-4f87-9377-49fa0d9e4dc3 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:05.673328 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56847af0-abf9-4d1a-a3bc-5e4d2c6c3a16 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:05.693079 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb86c5-a220-4f87-9377-49fa0d9e4dc3 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:05.706523 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2499721-5bb6-422d-9f3e-b932f1c9129e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:05.707165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2499721-5bb6-422d-9f3e-b932f1c9129e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:05.707454 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2499721-5bb6-422d-9f3e-b932f1c9129e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:05.707737 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2499721-5bb6-422d-9f3e-b932f1c9129e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:05.715956 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:05.720295 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2499721-5bb6-422d-9f3e-b932f1c9129e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:05.721797 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:05.725375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-c2499721-5bb6-422d-9f3e-b932f1c9129e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 15:11:05.725375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:05.725375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:05.725375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:05.725375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:05.725375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:05.725375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:05.725375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:05.725375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:05.725375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:05.725375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:05.725375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:05.725375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:05.725375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:05.725375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:05.725375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:05.726223 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:05.726223 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:05.726223 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:05.726223 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:05.726223 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:05.726223 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:05.726223 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:05.726223 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:05.726223 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:05.726223 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:05.726223 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:05.726223 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:05.726223 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:05.726223 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:05.726223 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:05.726223 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:05.726960 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:05.726960 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:05.726960 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:05.726960 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:05.726960 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:05.726960 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:05.726960 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:05.726960 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:05.726960 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:05.726960 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:05.726960 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 15:11:05.726960 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:11:05.726960 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 39/75] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jul 27 15:11:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:05.727636 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2499721-5bb6-422d-9f3e-b932f1c9129e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:05.732113 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4be802-6b4d-4958-9711-0835182b5d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:05.732756 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4be802-6b4d-4958-9711-0835182b5d6f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:05.733041 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4be802-6b4d-4958-9711-0835182b5d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:05.733318 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4be802-6b4d-4958-9711-0835182b5d6f None admin] PATH_INFO: `/v3/users/ad4a70e32c774ff3ae25d8ff565d4a1d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:05.734486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4be802-6b4d-4958-9711-0835182b5d6f None admin] RBAC: Authorizing `identity:get_user(user_id=ad4a70e32c774ff3ae25d8ff565d4a1d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:05.735923 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4be802-6b4d-4958-9711-0835182b5d6f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:05.737555 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 37/76] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:11:05 2022] GET /identity/v3/users/ad4a70e32c774ff3ae25d8ff565d4a1d => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:05.738661 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79309d42-1ebe-4a6c-8b8b-38a9e47bb0d0 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:05.738949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79309d42-1ebe-4a6c-8b8b-38a9e47bb0d0 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:05.739230 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79309d42-1ebe-4a6c-8b8b-38a9e47bb0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:05.756233 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-79309d42-1ebe-4a6c-8b8b-38a9e47bb0d0 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:05.757416 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-79309d42-1ebe-4a6c-8b8b-38a9e47bb0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:05.825210 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 38/77] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:05.828580 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2499721-5bb6-422d-9f3e-b932f1c9129e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:05.833350 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199acb2-2a8a-415d-a77d-a91a542246f9 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:05.833646 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199acb2-2a8a-415d-a77d-a91a542246f9 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:05.833929 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199acb2-2a8a-415d-a77d-a91a542246f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:05.852326 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-e199acb2-2a8a-415d-a77d-a91a542246f9 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:05.853502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e199acb2-2a8a-415d-a77d-a91a542246f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:05.861095 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021501e-af7f-4382-9368-3086f29be97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:05.861712 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021501e-af7f-4382-9368-3086f29be97c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:05.861992 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021501e-af7f-4382-9368-3086f29be97c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:05.862266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021501e-af7f-4382-9368-3086f29be97c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:05.918422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 39/78] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:05.919310 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199acb2-2a8a-415d-a77d-a91a542246f9 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:05.936963 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:05.939569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a021501e-af7f-4382-9368-3086f29be97c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:05.941447 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a021501e-af7f-4382-9368-3086f29be97c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:05.977567 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:06.019412 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199acb2-2a8a-415d-a77d-a91a542246f9 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:06.041023 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 40/79] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:11:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 15:11:06.041850 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021501e-af7f-4382-9368-3086f29be97c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:06.053403 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc37c68-670a-492e-b410-fe93cfe14d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:06.054025 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc37c68-670a-492e-b410-fe93cfe14d71 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:06.054308 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc37c68-670a-492e-b410-fe93cfe14d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:06.054588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc37c68-670a-492e-b410-fe93cfe14d71 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:06.055796 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc37c68-670a-492e-b410-fe93cfe14d71 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:06.056133 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc37c68-670a-492e-b410-fe93cfe14d71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:06.057513 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc37c68-670a-492e-b410-fe93cfe14d71 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:06.065663 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 40/80] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:11:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:06.066295 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc37c68-670a-492e-b410-fe93cfe14d71 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:06.143019 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:06.146097 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021501e-af7f-4382-9368-3086f29be97c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:06.167105 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc37c68-670a-492e-b410-fe93cfe14d71 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:06.179812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73564da9-c44e-4f3e-9a59-076674b8003d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:06.181084 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73564da9-c44e-4f3e-9a59-076674b8003d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:06.181369 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73564da9-c44e-4f3e-9a59-076674b8003d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:06.181643 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73564da9-c44e-4f3e-9a59-076674b8003d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:06.187977 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:06.203283 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a433e6-a19c-483c-a09e-56456015762b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:06.203914 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a433e6-a19c-483c-a09e-56456015762b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:06.204223 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a433e6-a19c-483c-a09e-56456015762b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:06.204501 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a433e6-a19c-483c-a09e-56456015762b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:06.214240 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a433e6-a19c-483c-a09e-56456015762b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:06.219486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-71a433e6-a19c-483c-a09e-56456015762b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 15:11:06.219486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:06.219486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:06.219486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:06.219486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:06.219486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:06.219486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:06.219486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:06.219486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:06.219486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:06.219486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:06.219486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:06.219486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:06.219486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:06.219486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:06.219486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:06.220482 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:06.220482 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:06.220482 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:06.220482 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:06.220482 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:06.220482 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:06.220482 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:06.220482 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:06.220482 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:06.220482 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:06.220482 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:06.220482 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:06.220482 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:06.220482 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:06.220482 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:06.220482 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:06.226127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:06.226127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:06.226127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:06.226127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:06.226127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:06.226127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:06.226127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:06.226127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:06.226127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:06.226127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:06.226127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 15:11:06.226127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:11:06.226127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 41/81] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:11:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:06.226127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a433e6-a19c-483c-a09e-56456015762b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:06.254298 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73564da9-c44e-4f3e-9a59-076674b8003d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:06.255766 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73564da9-c44e-4f3e-9a59-076674b8003d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:06.321331 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a433e6-a19c-483c-a09e-56456015762b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:06.349404 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:06.353860 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418d100-a7bd-4f85-845b-26a55752c97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:06.354491 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418d100-a7bd-4f85-845b-26a55752c97e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:06.354774 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418d100-a7bd-4f85-845b-26a55752c97e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:06.355051 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418d100-a7bd-4f85-845b-26a55752c97e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:06.356143 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 41/82] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:11:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 15:11:06.356291 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418d100-a7bd-4f85-845b-26a55752c97e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:06.357252 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73564da9-c44e-4f3e-9a59-076674b8003d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:06.357732 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418d100-a7bd-4f85-845b-26a55752c97e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:06.359326 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 42/83] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:11:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:06.359942 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418d100-a7bd-4f85-845b-26a55752c97e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:06.407920 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:06.456166 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73564da9-c44e-4f3e-9a59-076674b8003d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:06.458919 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418d100-a7bd-4f85-845b-26a55752c97e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:06.489326 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6961599-1daf-4230-9a00-dbf8fb19d8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:06.489964 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6961599-1daf-4230-9a00-dbf8fb19d8be None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:06.490250 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6961599-1daf-4230-9a00-dbf8fb19d8be None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:06.490530 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6961599-1daf-4230-9a00-dbf8fb19d8be None admin] PATH_INFO: `/v3/projects/db323e19e6ee4196a29be0d178ff0eb0` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:06.491374 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4ccbd-599d-4b36-a691-f81785e05101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:06.491672 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6961599-1daf-4230-9a00-dbf8fb19d8be None admin] RBAC: Authorizing `identity:get_project(project_id=db323e19e6ee4196a29be0d178ff0eb0)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:06.492025 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4ccbd-599d-4b36-a691-f81785e05101 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:06.492321 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4ccbd-599d-4b36-a691-f81785e05101 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:06.492670 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c4ccbd-599d-4b36-a691-f81785e05101 None admin] PATH_INFO: `/v3/users/ba54789172a447cfa1bd06445f4610b8` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:06.493834 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6961599-1daf-4230-9a00-dbf8fb19d8be None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:06.494460 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c4ccbd-599d-4b36-a691-f81785e05101 None admin] RBAC: Authorizing `identity:get_user(user_id=ba54789172a447cfa1bd06445f4610b8)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:06.495449 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 42/84] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:06 2022] GET /identity/v3/projects/db323e19e6ee4196a29be0d178ff0eb0 => generated 298 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:06.495879 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c4ccbd-599d-4b36-a691-f81785e05101 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:06.496225 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6961599-1daf-4230-9a00-dbf8fb19d8be None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:06.502062 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 43/85] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:11:06 2022] GET /identity/v3/users/ba54789172a447cfa1bd06445f4610b8 => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:06.502062 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4ccbd-599d-4b36-a691-f81785e05101 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:06.562470 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:06.596798 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6961599-1daf-4230-9a00-dbf8fb19d8be None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:06.597495 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c4ccbd-599d-4b36-a691-f81785e05101 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:06.613303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:06.631732 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5add6-d9bc-470f-8290-1b2796523c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:06.631905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78581a-43b2-4196-85b1-ca8e3a3d9b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:06.632476 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5add6-d9bc-470f-8290-1b2796523c68 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:06.632597 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78581a-43b2-4196-85b1-ca8e3a3d9b63 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:06.632761 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5add6-d9bc-470f-8290-1b2796523c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:06.632876 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78581a-43b2-4196-85b1-ca8e3a3d9b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:06.633037 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f5add6-d9bc-470f-8290-1b2796523c68 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:06.633160 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78581a-43b2-4196-85b1-ca8e3a3d9b63 None admin] PATH_INFO: `/v3/projects/db323e19e6ee4196a29be0d178ff0eb0` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:06.634315 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f5add6-d9bc-470f-8290-1b2796523c68 None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:06.634622 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f5add6-d9bc-470f-8290-1b2796523c68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:06.634951 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78581a-43b2-4196-85b1-ca8e3a3d9b63 None admin] RBAC: Authorizing `identity:get_project(project_id=db323e19e6ee4196a29be0d178ff0eb0)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:06.636015 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f5add6-d9bc-470f-8290-1b2796523c68 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:06.636415 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b78581a-43b2-4196-85b1-ca8e3a3d9b63 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:06.638101 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 44/86] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:06 2022] GET /identity/v3/projects/db323e19e6ee4196a29be0d178ff0eb0 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:06.638848 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78581a-43b2-4196-85b1-ca8e3a3d9b63 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:06.648958 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 43/87] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jul 27 15:11:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:06.648958 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5add6-d9bc-470f-8290-1b2796523c68 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:06.741285 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78581a-43b2-4196-85b1-ca8e3a3d9b63 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:06.744799 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f5add6-d9bc-470f-8290-1b2796523c68 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:06.773488 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:06.775537 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c16179-42c5-4e0a-9d72-16efbbe732a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:06.776187 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c16179-42c5-4e0a-9d72-16efbbe732a2 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:06.776474 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c16179-42c5-4e0a-9d72-16efbbe732a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:06.776759 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c16179-42c5-4e0a-9d72-16efbbe732a2 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:06.777442 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c16179-42c5-4e0a-9d72-16efbbe732a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:06.778886 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c16179-42c5-4e0a-9d72-16efbbe732a2 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:06.780022 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b84ef0-52b4-48bd-9546-54f8c12d953a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:06.780644 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b84ef0-52b4-48bd-9546-54f8c12d953a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:06.780934 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b84ef0-52b4-48bd-9546-54f8c12d953a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:06.781218 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b84ef0-52b4-48bd-9546-54f8c12d953a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:06.782011 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b84ef0-52b4-48bd-9546-54f8c12d953a None admin] RBAC: Adding query filter params (role.id=05b155ad77f0416a85b84ab318160c53, scope.project.id=db323e19e6ee4196a29be0d178ff0eb0, user.id=ba54789172a447cfa1bd06445f4610b8) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:06.782327 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b84ef0-52b4-48bd-9546-54f8c12d953a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:06.783735 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b84ef0-52b4-48bd-9546-54f8c12d953a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:06.791512 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 44/88] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:11:06 2022] GET /identity/v3/role_assignments?user.id=ba54789172a447cfa1bd06445f4610b8&scope.project.id=db323e19e6ee4196a29be0d178ff0eb0&role.id=05b155ad77f0416a85b84ab318160c53 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:06.792327 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b84ef0-52b4-48bd-9546-54f8c12d953a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:06.810937 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 45/89] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Jul 27 15:11:06 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:11:06.811810 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c16179-42c5-4e0a-9d72-16efbbe732a2 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:06.866661 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:06.944961 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b84ef0-52b4-48bd-9546-54f8c12d953a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:06.957653 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c16179-42c5-4e0a-9d72-16efbbe732a2 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:06.994928 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f5e16-4c12-4512-9210-e64db2629f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:06.995488 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f5e16-4c12-4512-9210-e64db2629f67 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:06.995779 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f5e16-4c12-4512-9210-e64db2629f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:06.996092 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40f5e16-4c12-4512-9210-e64db2629f67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:07.003751 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f2157-af31-4578-9860-9993836c8e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:07.004503 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f2157-af31-4578-9860-9993836c8e58 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:07.004789 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f2157-af31-4578-9860-9993836c8e58 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:07.005430 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327f2157-af31-4578-9860-9993836c8e58 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:07.006256 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f2157-af31-4578-9860-9993836c8e58 None admin] RBAC: Adding query filter params (role.id=6535f8b98008471dba33e89bd460880d, scope.project.id=db323e19e6ee4196a29be0d178ff0eb0, user.id=ad4a70e32c774ff3ae25d8ff565d4a1d) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:07.006574 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f2157-af31-4578-9860-9993836c8e58 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:07.008912 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327f2157-af31-4578-9860-9993836c8e58 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:07.016911 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 46/90] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:11:06 2022] GET /identity/v3/role_assignments?user.id=ad4a70e32c774ff3ae25d8ff565d4a1d&scope.project.id=db323e19e6ee4196a29be0d178ff0eb0&role.id=6535f8b98008471dba33e89bd460880d => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:07.016911 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f2157-af31-4578-9860-9993836c8e58 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:07.090797 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:07.100917 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f5e16-4c12-4512-9210-e64db2629f67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:07.103318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40f5e16-4c12-4512-9210-e64db2629f67 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:07.144480 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327f2157-af31-4578-9860-9993836c8e58 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:07.147135 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:07.186122 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9324670-8b4a-4032-9016-7d1676bc96c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:07.186122 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9324670-8b4a-4032-9016-7d1676bc96c2 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:07.186122 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9324670-8b4a-4032-9016-7d1676bc96c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:07.186455 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9324670-8b4a-4032-9016-7d1676bc96c2 None admin] PATH_INFO: `/v3/users/ba54789172a447cfa1bd06445f4610b8` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:07.187639 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9324670-8b4a-4032-9016-7d1676bc96c2 None admin] RBAC: Authorizing `identity:get_user(user_id=ba54789172a447cfa1bd06445f4610b8)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:07.189115 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9324670-8b4a-4032-9016-7d1676bc96c2 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:07.190754 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 47/91] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:11:07 2022] GET /identity/v3/users/ba54789172a447cfa1bd06445f4610b8 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:07.196712 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9324670-8b4a-4032-9016-7d1676bc96c2 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:07.224657 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 45/92] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:11:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 15:11:07.231035 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f5e16-4c12-4512-9210-e64db2629f67 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:07.313446 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9324670-8b4a-4032-9016-7d1676bc96c2 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:07.336218 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:07.344971 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40f5e16-4c12-4512-9210-e64db2629f67 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:07.350617 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddbcbe1-f39b-44b1-9446-4a1acade3c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:07.351252 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbcbe1-f39b-44b1-9446-4a1acade3c1d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:07.351602 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbcbe1-f39b-44b1-9446-4a1acade3c1d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:07.351889 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbcbe1-f39b-44b1-9446-4a1acade3c1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:07.386940 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36537e39-49c9-422d-9aa8-cf12b35d10fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:07.387603 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36537e39-49c9-422d-9aa8-cf12b35d10fd None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:07.387891 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36537e39-49c9-422d-9aa8-cf12b35d10fd None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:07.388195 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36537e39-49c9-422d-9aa8-cf12b35d10fd None admin] PATH_INFO: `/v3/projects/db323e19e6ee4196a29be0d178ff0eb0` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:07.389554 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36537e39-49c9-422d-9aa8-cf12b35d10fd None admin] RBAC: Authorizing `identity:get_project(project_id=db323e19e6ee4196a29be0d178ff0eb0)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:07.391019 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36537e39-49c9-422d-9aa8-cf12b35d10fd None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:07.392928 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 46/93] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:07 2022] GET /identity/v3/projects/db323e19e6ee4196a29be0d178ff0eb0 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:07.398782 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36537e39-49c9-422d-9aa8-cf12b35d10fd None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:07.410074 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:07.447317 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddbcbe1-f39b-44b1-9446-4a1acade3c1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:07.449657 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddbcbe1-f39b-44b1-9446-4a1acade3c1d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:07.536858 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36537e39-49c9-422d-9aa8-cf12b35d10fd None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:07.585849 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 48/94] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:11:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 15:11:07.591466 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddbcbe1-f39b-44b1-9446-4a1acade3c1d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:07.594458 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869237c-cc5a-471e-9333-6b7152bc7ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:07.595097 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869237c-cc5a-471e-9333-6b7152bc7ecd None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:07.595387 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869237c-cc5a-471e-9333-6b7152bc7ecd None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:07.595667 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f869237c-cc5a-471e-9333-6b7152bc7ecd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:07.596573 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869237c-cc5a-471e-9333-6b7152bc7ecd None admin] RBAC: Adding query filter params (role.id=ce7d7a296f4e448dbb11ded292818043, scope.project.id=db323e19e6ee4196a29be0d178ff0eb0, user.id=ba54789172a447cfa1bd06445f4610b8) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:07.596889 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869237c-cc5a-471e-9333-6b7152bc7ecd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:07.598333 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f869237c-cc5a-471e-9333-6b7152bc7ecd None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:07.613811 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 47/95] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:11:07 2022] GET /identity/v3/role_assignments?user.id=ba54789172a447cfa1bd06445f4610b8&scope.project.id=db323e19e6ee4196a29be0d178ff0eb0&role.id=ce7d7a296f4e448dbb11ded292818043 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:11:07.676848 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:07.729994 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddbcbe1-f39b-44b1-9446-4a1acade3c1d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:07.779422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eced2fbd-e4a7-4d9b-8304-e38ef7f57ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:07.780483 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced2fbd-e4a7-4d9b-8304-e38ef7f57ae3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:07.781008 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced2fbd-e4a7-4d9b-8304-e38ef7f57ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:07.781462 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eced2fbd-e4a7-4d9b-8304-e38ef7f57ae3 None admin] PATH_INFO: `/v3/projects/2e0af706b8c64ed1a94cef87d1fa1670` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:07.782829 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced2fbd-e4a7-4d9b-8304-e38ef7f57ae3 None admin] RBAC: Authorizing `identity:get_project(project_id=2e0af706b8c64ed1a94cef87d1fa1670)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:07.784512 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eced2fbd-e4a7-4d9b-8304-e38ef7f57ae3 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:07.792072 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 49/96] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:07 2022] GET /identity/v3/projects/2e0af706b8c64ed1a94cef87d1fa1670 => generated 312 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:07.793774 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869237c-cc5a-471e-9333-6b7152bc7ecd None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:07.824890 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:07.923958 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f869237c-cc5a-471e-9333-6b7152bc7ecd None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:07.971556 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00aa16-c0fe-4b4d-8b0d-fdac7b320fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:07.972943 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00aa16-c0fe-4b4d-8b0d-fdac7b320fd8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:07.973411 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00aa16-c0fe-4b4d-8b0d-fdac7b320fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:07.973868 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00aa16-c0fe-4b4d-8b0d-fdac7b320fd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:07.974875 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00aa16-c0fe-4b4d-8b0d-fdac7b320fd8 None admin] RBAC: Adding query filter params (role.id=05b155ad77f0416a85b84ab318160c53, scope.project.id=2e0af706b8c64ed1a94cef87d1fa1670, user.id=ba54789172a447cfa1bd06445f4610b8) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:07.975382 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00aa16-c0fe-4b4d-8b0d-fdac7b320fd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:07.977054 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00aa16-c0fe-4b4d-8b0d-fdac7b320fd8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:07.984585 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 48/97] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:11:07 2022] GET /identity/v3/role_assignments?user.id=ba54789172a447cfa1bd06445f4610b8&scope.project.id=2e0af706b8c64ed1a94cef87d1fa1670&role.id=05b155ad77f0416a85b84ab318160c53 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:09.655404 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a3e91-4d1a-4096-bf68-3cba8dda0229 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:09.655404 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a3e91-4d1a-4096-bf68-3cba8dda0229 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:09.655404 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a3e91-4d1a-4096-bf68-3cba8dda0229 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:09.656515 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 50/98] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:09.671488 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa88b8-c911-48d3-ad22-eab76f672ba7 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:09.672407 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa88b8-c911-48d3-ad22-eab76f672ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:09.672887 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa88b8-c911-48d3-ad22-eab76f672ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:09.701017 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f5fa88b8-c911-48d3-ad22-eab76f672ba7 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:09.702565 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f5fa88b8-c911-48d3-ad22-eab76f672ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:09.788715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 49/99] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:09.825229 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a3e91-4d1a-4096-bf68-3cba8dda0229 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:09.942235 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a3e91-4d1a-4096-bf68-3cba8dda0229 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:09.969122 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22028916-8d1c-48eb-af75-7a105dfd87cf None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:09.969756 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22028916-8d1c-48eb-af75-7a105dfd87cf None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:09.970245 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22028916-8d1c-48eb-af75-7a105dfd87cf None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:09.971809 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 50/100] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:09.977523 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4cf07-4a3a-465d-82a4-3fa593913ddc None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:09.978071 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4cf07-4a3a-465d-82a4-3fa593913ddc None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:09.978544 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4cf07-4a3a-465d-82a4-3fa593913ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:10.001299 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e862f5-c152-4643-9ce7-d4dc0d34df9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:10.002306 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e862f5-c152-4643-9ce7-d4dc0d34df9c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:10.002790 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e862f5-c152-4643-9ce7-d4dc0d34df9c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:10.003273 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e862f5-c152-4643-9ce7-d4dc0d34df9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:10.004811 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-1ed4cf07-4a3a-465d-82a4-3fa593913ddc None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:10.007621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1ed4cf07-4a3a-465d-82a4-3fa593913ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:10.020760 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e862f5-c152-4643-9ce7-d4dc0d34df9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:10.027239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-f5e862f5-c152-4643-9ce7-d4dc0d34df9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:11:10.027239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:10.027239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:10.027239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:10.027239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:10.027239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:10.027239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:10.027239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:10.027239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:10.027239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:10.027239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:10.027239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:10.027239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:10.027239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:10.027239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:10.027239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:10.028112 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:10.028112 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:10.028112 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:10.028112 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:10.028112 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:10.028112 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:10.028112 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:10.028112 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:10.028112 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:10.028112 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:10.028112 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:10.028112 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:10.028112 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:10.028112 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:10.028112 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:10.028112 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:10.028847 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:10.028847 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:10.028847 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:10.028847 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:10.028847 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:10.028847 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:10.028847 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:10.028847 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:10.028847 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:10.028847 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:10.028847 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:11:10.028847 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:11:10.035976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:10.036379 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 51/101] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jul 27 15:11:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:10.037976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e862f5-c152-4643-9ce7-d4dc0d34df9c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:10.049229 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:10.145957 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e862f5-c152-4643-9ce7-d4dc0d34df9c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:10.146691 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 51/102] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 15:11:10.182355 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f31b95-c649-41db-b788-465a52215f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:10.183466 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f31b95-c649-41db-b788-465a52215f53 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:10.183952 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f31b95-c649-41db-b788-465a52215f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:10.184152 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4cf07-4a3a-465d-82a4-3fa593913ddc None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:10.184619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f31b95-c649-41db-b788-465a52215f53 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:10.185552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f31b95-c649-41db-b788-465a52215f53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:10.186074 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f31b95-c649-41db-b788-465a52215f53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:10.187660 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f31b95-c649-41db-b788-465a52215f53 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:10.197555 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 52/103] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:11:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:10.209332 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f31b95-c649-41db-b788-465a52215f53 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:10.296473 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:10.322798 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f31b95-c649-41db-b788-465a52215f53 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:10.365363 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d31ed0-6ad5-4b75-a10b-9422226e9196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:10.366329 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d31ed0-6ad5-4b75-a10b-9422226e9196 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:10.366696 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d31ed0-6ad5-4b75-a10b-9422226e9196 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:10.367054 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d31ed0-6ad5-4b75-a10b-9422226e9196 None admin] PATH_INFO: `/v3/users/ad4a70e32c774ff3ae25d8ff565d4a1d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:10.369260 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d31ed0-6ad5-4b75-a10b-9422226e9196 None admin] RBAC: Authorizing `identity:get_user(user_id=ad4a70e32c774ff3ae25d8ff565d4a1d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:10.370933 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d31ed0-6ad5-4b75-a10b-9422226e9196 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:10.377205 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 53/104] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:11:10 2022] GET /identity/v3/users/ad4a70e32c774ff3ae25d8ff565d4a1d => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:10.380520 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d31ed0-6ad5-4b75-a10b-9422226e9196 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:10.414536 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4cf07-4a3a-465d-82a4-3fa593913ddc None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:10.475016 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16c79e2-ea6f-4167-9b33-a0b7f867e84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:10.475596 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c79e2-ea6f-4167-9b33-a0b7f867e84b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:10.475885 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c79e2-ea6f-4167-9b33-a0b7f867e84b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:10.476195 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16c79e2-ea6f-4167-9b33-a0b7f867e84b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:10.491436 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16c79e2-ea6f-4167-9b33-a0b7f867e84b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:10.503519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-d16c79e2-ea6f-4167-9b33-a0b7f867e84b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 15:11:10.503519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:10.503519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:10.503519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:10.503519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:10.503519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:10.503519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:10.503519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:10.503519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:10.503519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:10.503519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:10.503519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:10.503519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:10.503519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:10.503519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:10.503519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:10.504465 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:10.504465 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:10.504465 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:10.504465 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:10.504465 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:10.504465 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:10.504465 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:10.504465 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:10.504465 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:10.504465 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:10.504465 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:10.504465 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:10.504465 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:10.504465 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:10.504465 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:10.504465 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:10.506142 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:10.506142 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:10.506142 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:10.506142 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:10.506142 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:10.506142 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:10.506142 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:10.506142 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:10.506142 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:10.506142 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:10.506142 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 15:11:10.506142 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:11:10.506142 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 52/105] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:11:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:11:10.506142 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ff768-7e15-4888-afbf-d1d667e4ca0a None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:10.508046 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ff768-7e15-4888-afbf-d1d667e4ca0a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:10.508046 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ff768-7e15-4888-afbf-d1d667e4ca0a None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:10.512968 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d31ed0-6ad5-4b75-a10b-9422226e9196 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:10.522662 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 53/106] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:10 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:10.523359 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ff768-7e15-4888-afbf-d1d667e4ca0a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:10.552393 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:10.560106 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:10.560951 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605f2f2-73d2-4e9b-9a80-317d3b6345f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:10.561617 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605f2f2-73d2-4e9b-9a80-317d3b6345f7 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:10.562699 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605f2f2-73d2-4e9b-9a80-317d3b6345f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:10.563194 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605f2f2-73d2-4e9b-9a80-317d3b6345f7 None admin] PATH_INFO: `/v3/projects/db323e19e6ee4196a29be0d178ff0eb0` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:10.565966 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605f2f2-73d2-4e9b-9a80-317d3b6345f7 None admin] RBAC: Authorizing `identity:get_project(project_id=db323e19e6ee4196a29be0d178ff0eb0)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:10.571270 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605f2f2-73d2-4e9b-9a80-317d3b6345f7 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:10.573639 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 54/107] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:10 2022] GET /identity/v3/projects/db323e19e6ee4196a29be0d178ff0eb0 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:11:10.588275 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6453e75-05de-496c-84d9-73c261a94f07 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:10.588275 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6453e75-05de-496c-84d9-73c261a94f07 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:10.588275 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6453e75-05de-496c-84d9-73c261a94f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:10.613903 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-f6453e75-05de-496c-84d9-73c261a94f07 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:10.615124 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f6453e75-05de-496c-84d9-73c261a94f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:10.689324 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 55/108] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:10.690177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6453e75-05de-496c-84d9-73c261a94f07 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:10.733272 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ff768-7e15-4888-afbf-d1d667e4ca0a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:10.776040 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d26278-da81-4dc9-b26e-43ff72704951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:10.776669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d26278-da81-4dc9-b26e-43ff72704951 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:10.776951 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d26278-da81-4dc9-b26e-43ff72704951 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:10.777223 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d26278-da81-4dc9-b26e-43ff72704951 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:10.777952 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d26278-da81-4dc9-b26e-43ff72704951 None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:10.778256 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d26278-da81-4dc9-b26e-43ff72704951 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:10.779647 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d26278-da81-4dc9-b26e-43ff72704951 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:10.789993 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 54/109] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jul 27 15:11:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:10.791529 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f2cb6-cc35-47cf-8d52-3649162e79da None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:10.791819 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f2cb6-cc35-47cf-8d52-3649162e79da None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:10.792106 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03f2cb6-cc35-47cf-8d52-3649162e79da None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:10.793462 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 55/110] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:10.794005 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f2cb6-cc35-47cf-8d52-3649162e79da None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:10.807609 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6453e75-05de-496c-84d9-73c261a94f07 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:10.835066 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:10.844033 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79854a9d-68f1-42d1-8554-eb7bc1173c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:10.844759 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79854a9d-68f1-42d1-8554-eb7bc1173c2f None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:10.845053 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79854a9d-68f1-42d1-8554-eb7bc1173c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:10.845394 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79854a9d-68f1-42d1-8554-eb7bc1173c2f None admin] PATH_INFO: `/v3/projects/db323e19e6ee4196a29be0d178ff0eb0/users/ad4a70e32c774ff3ae25d8ff565d4a1d/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:10.847670 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79854a9d-68f1-42d1-8554-eb7bc1173c2f None admin] RBAC: Authorizing `identity:create_grant(project_id=db323e19e6ee4196a29be0d178ff0eb0, user_id=ad4a70e32c774ff3ae25d8ff565d4a1d, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:10.849206 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79854a9d-68f1-42d1-8554-eb7bc1173c2f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:10.880725 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:10.888022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 56/111] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jul 27 15:11:10 2022] PUT /identity/v3/projects/db323e19e6ee4196a29be0d178ff0eb0/users/ad4a70e32c774ff3ae25d8ff565d4a1d/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:11:10.888022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bc96b-ead8-4f0b-9300-5fe94060884a None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:10.888022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bc96b-ead8-4f0b-9300-5fe94060884a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:10.888022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bc96b-ead8-4f0b-9300-5fe94060884a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:10.927088 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-763bc96b-ead8-4f0b-9300-5fe94060884a None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:10.928324 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-763bc96b-ead8-4f0b-9300-5fe94060884a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:10.945498 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03f2cb6-cc35-47cf-8d52-3649162e79da None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:10.992310 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade59de-5600-4784-94d0-435dd026f499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:10.994026 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade59de-5600-4784-94d0-435dd026f499 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:10.994384 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade59de-5600-4784-94d0-435dd026f499 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:10.994743 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bade59de-5600-4784-94d0-435dd026f499 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:10.996264 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade59de-5600-4784-94d0-435dd026f499 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:10.997749 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bade59de-5600-4784-94d0-435dd026f499 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:10.999609 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 56/112] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:11:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:11.000363 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade59de-5600-4784-94d0-435dd026f499 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:11.035175 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 57/113] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:11.037095 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78c2fb-2637-420f-91f9-01578f830e3f None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:11.037477 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78c2fb-2637-420f-91f9-01578f830e3f None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:11.037855 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe78c2fb-2637-420f-91f9-01578f830e3f None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:11.040147 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 58/114] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:11.041024 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe78c2fb-2637-420f-91f9-01578f830e3f None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:11.131722 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bade59de-5600-4784-94d0-435dd026f499 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:11.170677 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db2b77c-8810-4916-81d4-9c0a9cd4fb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:11.171676 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2b77c-8810-4916-81d4-9c0a9cd4fb8b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:11.172205 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2b77c-8810-4916-81d4-9c0a9cd4fb8b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:11.172685 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2b77c-8810-4916-81d4-9c0a9cd4fb8b None admin] PATH_INFO: `/v3/users/ba54789172a447cfa1bd06445f4610b8` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:11.174406 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db2b77c-8810-4916-81d4-9c0a9cd4fb8b None admin] RBAC: Authorizing `identity:get_user(user_id=ba54789172a447cfa1bd06445f4610b8)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:11.175864 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db2b77c-8810-4916-81d4-9c0a9cd4fb8b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:11.178210 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 57/115] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:11:10 2022] GET /identity/v3/users/ba54789172a447cfa1bd06445f4610b8 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:11.179258 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9f0fe-d919-44b6-82f3-b365f5ea66bf None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:11.179546 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9f0fe-d919-44b6-82f3-b365f5ea66bf None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:11.179824 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e9f0fe-d919-44b6-82f3-b365f5ea66bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:11.196972 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe78c2fb-2637-420f-91f9-01578f830e3f None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:11.203082 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-54e9f0fe-d919-44b6-82f3-b365f5ea66bf None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:11.204317 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-54e9f0fe-d919-44b6-82f3-b365f5ea66bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:11.206605 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:11.220342 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:11.240419 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f88d7-2d79-4712-9968-f29f8e621943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:11.241042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f88d7-2d79-4712-9968-f29f8e621943 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:11.241329 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f88d7-2d79-4712-9968-f29f8e621943 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:11.241603 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f88d7-2d79-4712-9968-f29f8e621943 None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:11.242287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f88d7-2d79-4712-9968-f29f8e621943 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:11.243807 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68f88d7-2d79-4712-9968-f29f8e621943 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:11.272130 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 59/116] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Jul 27 15:11:11 2022] POST /identity/v3/projects => generated 302 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:11:11.277094 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f88d7-2d79-4712-9968-f29f8e621943 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:11.306733 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 58/117] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:11.308420 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fbb5b-94a2-470e-b632-3ed3a26e9b9d None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:11.308793 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fbb5b-94a2-470e-b632-3ed3a26e9b9d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:11.309143 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fbb5b-94a2-470e-b632-3ed3a26e9b9d None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:11.314780 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 59/118] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:11.314780 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514fbb5b-94a2-470e-b632-3ed3a26e9b9d None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:11.433409 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f88d7-2d79-4712-9968-f29f8e621943 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:11.446286 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514fbb5b-94a2-470e-b632-3ed3a26e9b9d None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:11.469740 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ddfbae-f99d-47a9-8812-1d27f24191d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:11.470400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddfbae-f99d-47a9-8812-1d27f24191d8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:11.471138 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddfbae-f99d-47a9-8812-1d27f24191d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:11.471945 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ddfbae-f99d-47a9-8812-1d27f24191d8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:11.485301 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ddfbae-f99d-47a9-8812-1d27f24191d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:11.487235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888edf4-50b3-46c2-bcd1-092d71342bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:11.487883 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888edf4-50b3-46c2-bcd1-092d71342bcf None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:11.488199 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888edf4-50b3-46c2-bcd1-092d71342bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:11.488475 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b888edf4-50b3-46c2-bcd1-092d71342bcf None admin] PATH_INFO: `/v3/projects/db323e19e6ee4196a29be0d178ff0eb0` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:11.489639 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888edf4-50b3-46c2-bcd1-092d71342bcf None admin] RBAC: Authorizing `identity:get_project(project_id=db323e19e6ee4196a29be0d178ff0eb0)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:11.490910 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-21ddfbae-f99d-47a9-8812-1d27f24191d8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 15:11:11.490910 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:11.490910 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:11.490910 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:11.490910 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:11.490910 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:11.490910 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:11.490910 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:11.490910 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:11.490910 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:11.490910 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:11.490910 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:11.490910 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:11.490910 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:11.490910 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:11.490910 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:11.491760 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:11.491760 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:11.491760 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:11.491760 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:11.491760 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:11.491760 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:11.491760 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:11.491760 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:11.491760 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:11.491760 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:11.491760 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:11.491760 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:11.491760 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:11.491760 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:11.491760 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:11.491760 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:11.493996 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:11.493996 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:11.493996 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:11.493996 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:11.493996 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:11.493996 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:11.493996 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:11.493996 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:11.493996 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:11.493996 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:11.493996 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 15:11:11.493996 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:11:11.494645 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b888edf4-50b3-46c2-bcd1-092d71342bcf None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:11.494717 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 60/119] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:11:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:11.494785 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 60/120] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:11 2022] GET /identity/v3/projects/db323e19e6ee4196a29be0d178ff0eb0 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:11.494852 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13373bf-6ed1-48a5-ae5d-d9bd4c4ea538 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:11.494852 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13373bf-6ed1-48a5-ae5d-d9bd4c4ea538 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:11.494852 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13373bf-6ed1-48a5-ae5d-d9bd4c4ea538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:11.495634 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888edf4-50b3-46c2-bcd1-092d71342bcf None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:11.512621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:11.518704 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-d13373bf-6ed1-48a5-ae5d-d9bd4c4ea538 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:11.520827 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d13373bf-6ed1-48a5-ae5d-d9bd4c4ea538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:11.556363 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:11.605822 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 61/121] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:11.606998 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13373bf-6ed1-48a5-ae5d-d9bd4c4ea538 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:11.613431 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b888edf4-50b3-46c2-bcd1-092d71342bcf None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:11.662385 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a510e7-88db-41cd-abe1-709d9a9a451e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:11.663097 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a510e7-88db-41cd-abe1-709d9a9a451e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:11.663660 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a510e7-88db-41cd-abe1-709d9a9a451e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:11.663949 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a510e7-88db-41cd-abe1-709d9a9a451e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:11.676092 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a510e7-88db-41cd-abe1-709d9a9a451e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:11.681976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-31a510e7-88db-41cd-abe1-709d9a9a451e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 15:11:11.681976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:11.681976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:11.681976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:11.681976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:11.681976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:11.681976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:11.681976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:11.681976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:11.681976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:11.681976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:11.681976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:11.681976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:11.681976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:11.681976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:11.681976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:11.682808 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:11.682808 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:11.682808 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:11.682808 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:11.682808 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:11.682808 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:11.682808 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:11.682808 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:11.682808 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:11.682808 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:11.682808 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:11.682808 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:11.682808 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:11.682808 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:11.682808 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:11.682808 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:11.683569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:11.683569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:11.683569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:11.683569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:11.683569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:11.683569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:11.683569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:11.683569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:11.683569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:11.683569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:11.683569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 15:11:11.683569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:11:11.684160 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 61/122] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jul 27 15:11:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:11.689163 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a510e7-88db-41cd-abe1-709d9a9a451e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:11.733248 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13373bf-6ed1-48a5-ae5d-d9bd4c4ea538 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:11.761322 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:11.773521 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd801e28-5b2e-4c48-a3f8-64f0b9b6c6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:11.774971 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd801e28-5b2e-4c48-a3f8-64f0b9b6c6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:11.775460 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd801e28-5b2e-4c48-a3f8-64f0b9b6c6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:11.775932 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd801e28-5b2e-4c48-a3f8-64f0b9b6c6f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:11.776950 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd801e28-5b2e-4c48-a3f8-64f0b9b6c6f0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:11.777522 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd801e28-5b2e-4c48-a3f8-64f0b9b6c6f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:11.779123 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd801e28-5b2e-4c48-a3f8-64f0b9b6c6f0 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:11.788263 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 62/123] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jul 27 15:11:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:11.790122 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd801e28-5b2e-4c48-a3f8-64f0b9b6c6f0 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:11.805296 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a510e7-88db-41cd-abe1-709d9a9a451e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:11.816285 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:11.843512 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b435a-85dc-4dc0-b69a-06498cbec817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:11.844312 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b435a-85dc-4dc0-b69a-06498cbec817 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:11.844604 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b435a-85dc-4dc0-b69a-06498cbec817 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:11.844879 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6b435a-85dc-4dc0-b69a-06498cbec817 None admin] PATH_INFO: `/v3/projects/db323e19e6ee4196a29be0d178ff0eb0/users/ba54789172a447cfa1bd06445f4610b8/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:11.846981 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b435a-85dc-4dc0-b69a-06498cbec817 None admin] RBAC: Authorizing `identity:create_grant(project_id=db323e19e6ee4196a29be0d178ff0eb0, user_id=ba54789172a447cfa1bd06445f4610b8, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:11.848557 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6b435a-85dc-4dc0-b69a-06498cbec817 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:11.866262 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 62/124] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jul 27 15:11:11 2022] PUT /identity/v3/projects/db323e19e6ee4196a29be0d178ff0eb0/users/ba54789172a447cfa1bd06445f4610b8/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:11:11.867000 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b435a-85dc-4dc0-b69a-06498cbec817 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:11.909925 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd801e28-5b2e-4c48-a3f8-64f0b9b6c6f0 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:11.947873 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a253ed1-8d12-4075-a115-d60702d32701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:11.948871 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a253ed1-8d12-4075-a115-d60702d32701 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:11.949357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a253ed1-8d12-4075-a115-d60702d32701 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:11.949814 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a253ed1-8d12-4075-a115-d60702d32701 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:11.961954 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a253ed1-8d12-4075-a115-d60702d32701 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:11.976199 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-9a253ed1-8d12-4075-a115-d60702d32701 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 15:11:11.976199 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:11.976199 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:11.976199 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:11.976199 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:11.976199 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:11.976199 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:11.976199 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:11.976199 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:11.976199 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:11.976199 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:11.976199 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:11.976199 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:11.976199 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:11.976199 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:11.976199 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:11.977745 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:11.977745 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:11.977745 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:11.977745 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:11.977745 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:11.977745 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:11.977745 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:11.977745 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:11.977745 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:11.977745 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:11.977745 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:11.977745 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:11.977745 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:11.977745 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:11.977745 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:11.977745 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:11.978538 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:11.978538 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:11.978538 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:11.978538 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:11.978538 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:11.978538 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:11.978538 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:11.978538 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:11.978538 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:11.978538 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:11.978538 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 15:11:11.978538 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:11:11.980849 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 63/125] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:11:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:11.981907 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a253ed1-8d12-4075-a115-d60702d32701 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:11.983217 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6b435a-85dc-4dc0-b69a-06498cbec817 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:12.024515 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:12.024515 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de8d09-2b57-43fe-97aa-0007aa9554dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:12.024515 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de8d09-2b57-43fe-97aa-0007aa9554dd None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:12.025003 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de8d09-2b57-43fe-97aa-0007aa9554dd None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:12.025291 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de8d09-2b57-43fe-97aa-0007aa9554dd None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:12.026096 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de8d09-2b57-43fe-97aa-0007aa9554dd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:12.026590 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de8d09-2b57-43fe-97aa-0007aa9554dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:12.028169 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81de8d09-2b57-43fe-97aa-0007aa9554dd None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:12.044160 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 63/126] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:11:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:12.044160 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de8d09-2b57-43fe-97aa-0007aa9554dd None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:12.116998 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:12.136949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a253ed1-8d12-4075-a115-d60702d32701 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:12.155032 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81de8d09-2b57-43fe-97aa-0007aa9554dd None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:12.181727 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1f053-da2e-44be-88ce-ed5f45b59d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:12.182492 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1f053-da2e-44be-88ce-ed5f45b59d4e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:12.182806 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1f053-da2e-44be-88ce-ed5f45b59d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:12.183167 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1f053-da2e-44be-88ce-ed5f45b59d4e None admin] PATH_INFO: `/v3/users/0470acd2a63f4c0781810be5d5df8ca2` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:12.190813 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc76559-2764-46da-9355-e2a13a1fdad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:12.191443 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc76559-2764-46da-9355-e2a13a1fdad2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:12.191731 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc76559-2764-46da-9355-e2a13a1fdad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:12.192038 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc76559-2764-46da-9355-e2a13a1fdad2 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:12.192755 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc76559-2764-46da-9355-e2a13a1fdad2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:12.193063 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc76559-2764-46da-9355-e2a13a1fdad2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:12.194502 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc76559-2764-46da-9355-e2a13a1fdad2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:12.203943 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 64/127] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jul 27 15:11:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:12.204776 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc1f053-da2e-44be-88ce-ed5f45b59d4e None admin] RBAC: Authorizing `identity:get_user(user_id=0470acd2a63f4c0781810be5d5df8ca2)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:12.204903 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc76559-2764-46da-9355-e2a13a1fdad2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:12.206418 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc1f053-da2e-44be-88ce-ed5f45b59d4e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:12.208405 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 64/128] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:11:11 2022] GET /identity/v3/users/0470acd2a63f4c0781810be5d5df8ca2 => generated 289 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:12.213041 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1f053-da2e-44be-88ce-ed5f45b59d4e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:12.264203 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:12.318178 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc76559-2764-46da-9355-e2a13a1fdad2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:12.355378 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7444a0e-9824-4df2-9708-499caa466313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:12.356054 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7444a0e-9824-4df2-9708-499caa466313 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:12.356346 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7444a0e-9824-4df2-9708-499caa466313 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:12.356568 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc1f053-da2e-44be-88ce-ed5f45b59d4e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:12.356668 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7444a0e-9824-4df2-9708-499caa466313 None admin] PATH_INFO: `/v3/users/ba54789172a447cfa1bd06445f4610b8` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:12.357807 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7444a0e-9824-4df2-9708-499caa466313 None admin] RBAC: Authorizing `identity:get_user(user_id=ba54789172a447cfa1bd06445f4610b8)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:12.359270 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7444a0e-9824-4df2-9708-499caa466313 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:12.361141 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 65/129] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:11:12 2022] GET /identity/v3/users/ba54789172a447cfa1bd06445f4610b8 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:12.361690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7444a0e-9824-4df2-9708-499caa466313 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:12.444692 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0537bf1-e219-4fff-9702-9ac062625819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:12.446270 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0537bf1-e219-4fff-9702-9ac062625819 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:12.446778 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0537bf1-e219-4fff-9702-9ac062625819 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:12.447258 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0537bf1-e219-4fff-9702-9ac062625819 None admin] PATH_INFO: `/v3/users/ba54789172a447cfa1bd06445f4610b8` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:12.448715 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0537bf1-e219-4fff-9702-9ac062625819 None admin] RBAC: Authorizing `identity:get_user(user_id=ba54789172a447cfa1bd06445f4610b8)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:12.450388 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0537bf1-e219-4fff-9702-9ac062625819 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:12.452251 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 65/130] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:11:12 2022] GET /identity/v3/users/ba54789172a447cfa1bd06445f4610b8 => generated 275 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:12.456278 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0537bf1-e219-4fff-9702-9ac062625819 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:12.480335 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:12.496127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7444a0e-9824-4df2-9708-499caa466313 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:12.532356 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:12.592104 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025d73d-595b-4ccc-9ebd-b5987e496913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:12.592104 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025d73d-595b-4ccc-9ebd-b5987e496913 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:12.592104 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025d73d-595b-4ccc-9ebd-b5987e496913 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:12.592104 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8025d73d-595b-4ccc-9ebd-b5987e496913 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:12.620207 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0537bf1-e219-4fff-9702-9ac062625819 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:12.685583 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef6cae-3166-43cb-b949-22528f677ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:12.686242 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef6cae-3166-43cb-b949-22528f677ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:12.686581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef6cae-3166-43cb-b949-22528f677ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:12.686861 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef6cae-3166-43cb-b949-22528f677ce1 None admin] PATH_INFO: `/v3/projects/db323e19e6ee4196a29be0d178ff0eb0` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:12.688240 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef6cae-3166-43cb-b949-22528f677ce1 None admin] RBAC: Authorizing `identity:get_project(project_id=db323e19e6ee4196a29be0d178ff0eb0)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:12.689698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef6cae-3166-43cb-b949-22528f677ce1 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:12.691374 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 66/131] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:12 2022] GET /identity/v3/projects/db323e19e6ee4196a29be0d178ff0eb0 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:12.692159 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef6cae-3166-43cb-b949-22528f677ce1 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:12.727038 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8025d73d-595b-4ccc-9ebd-b5987e496913 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:12.728700 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8025d73d-595b-4ccc-9ebd-b5987e496913 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:12.843557 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 66/132] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:11:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 15:11:12.848402 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025d73d-595b-4ccc-9ebd-b5987e496913 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:12.867030 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:12.888449 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:12.927803 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef6cae-3166-43cb-b949-22528f677ce1 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:12.951250 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8025d73d-595b-4ccc-9ebd-b5987e496913 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:12.985910 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fda926-b74b-4ed6-8230-4745b448972e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:12.986625 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fda926-b74b-4ed6-8230-4745b448972e None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:12.986924 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fda926-b74b-4ed6-8230-4745b448972e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:12.987203 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fda926-b74b-4ed6-8230-4745b448972e None admin] PATH_INFO: `/v3/projects/db323e19e6ee4196a29be0d178ff0eb0/users/ba54789172a447cfa1bd06445f4610b8/roles/ce7d7a296f4e448dbb11ded292818043` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:12.989478 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fda926-b74b-4ed6-8230-4745b448972e None admin] RBAC: Authorizing `identity:create_grant(project_id=db323e19e6ee4196a29be0d178ff0eb0, user_id=ba54789172a447cfa1bd06445f4610b8, role_id=ce7d7a296f4e448dbb11ded292818043)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:12.990934 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fda926-b74b-4ed6-8230-4745b448972e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:12.993293 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f07a1-d8ea-4ec1-9e77-1dca6dd32a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:12.994051 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f07a1-d8ea-4ec1-9e77-1dca6dd32a2f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:12.994346 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f07a1-d8ea-4ec1-9e77-1dca6dd32a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:12.994718 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f07a1-d8ea-4ec1-9e77-1dca6dd32a2f None admin] PATH_INFO: `/v3/projects/2e0af706b8c64ed1a94cef87d1fa1670` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:13.000713 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f07a1-d8ea-4ec1-9e77-1dca6dd32a2f None admin] RBAC: Authorizing `identity:get_project(project_id=2e0af706b8c64ed1a94cef87d1fa1670)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:13.002197 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48f07a1-d8ea-4ec1-9e77-1dca6dd32a2f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:13.004381 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 67/133] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:12 2022] GET /identity/v3/projects/2e0af706b8c64ed1a94cef87d1fa1670 => generated 312 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:13.004978 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f07a1-d8ea-4ec1-9e77-1dca6dd32a2f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:13.007786 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 67/134] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jul 27 15:11:12 2022] PUT /identity/v3/projects/db323e19e6ee4196a29be0d178ff0eb0/users/ba54789172a447cfa1bd06445f4610b8/roles/ce7d7a296f4e448dbb11ded292818043 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:11:13.011199 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fda926-b74b-4ed6-8230-4745b448972e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:13.097174 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:13.123038 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fda926-b74b-4ed6-8230-4745b448972e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:13.164772 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408f9d0-f61b-4f4f-8d26-c17d1a3b4b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:13.165471 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408f9d0-f61b-4f4f-8d26-c17d1a3b4b67 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:13.165754 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408f9d0-f61b-4f4f-8d26-c17d1a3b4b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:13.166027 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408f9d0-f61b-4f4f-8d26-c17d1a3b4b67 None admin] PATH_INFO: `/v3/projects/2e0af706b8c64ed1a94cef87d1fa1670/users/ba54789172a447cfa1bd06445f4610b8/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:13.169097 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408f9d0-f61b-4f4f-8d26-c17d1a3b4b67 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e0af706b8c64ed1a94cef87d1fa1670, user_id=ba54789172a447cfa1bd06445f4610b8, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:13.170539 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0408f9d0-f61b-4f4f-8d26-c17d1a3b4b67 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:13.196431 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 68/135] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jul 27 15:11:13 2022] PUT /identity/v3/projects/2e0af706b8c64ed1a94cef87d1fa1670/users/ba54789172a447cfa1bd06445f4610b8/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:11:13.218430 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f07a1-d8ea-4ec1-9e77-1dca6dd32a2f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:13.257978 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc9307-bcff-4171-b95d-fb11d149028f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:13.258687 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc9307-bcff-4171-b95d-fb11d149028f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:13.258972 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc9307-bcff-4171-b95d-fb11d149028f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:13.259249 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc9307-bcff-4171-b95d-fb11d149028f None admin] PATH_INFO: `/v3/projects/db323e19e6ee4196a29be0d178ff0eb0` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:13.260554 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc9307-bcff-4171-b95d-fb11d149028f None admin] RBAC: Authorizing `identity:get_project(project_id=db323e19e6ee4196a29be0d178ff0eb0)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:13.262077 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc9307-bcff-4171-b95d-fb11d149028f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:13.263802 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 68/136] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:13 2022] GET /identity/v3/projects/db323e19e6ee4196a29be0d178ff0eb0 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:13.270162 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408f9d0-f61b-4f4f-8d26-c17d1a3b4b67 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:13.390064 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408f9d0-f61b-4f4f-8d26-c17d1a3b4b67 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:13.431642 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7210b1-017b-479d-8ae2-1c16fbb45861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:13.432326 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7210b1-017b-479d-8ae2-1c16fbb45861 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:13.432611 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7210b1-017b-479d-8ae2-1c16fbb45861 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:13.432888 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7210b1-017b-479d-8ae2-1c16fbb45861 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:13.433694 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7210b1-017b-479d-8ae2-1c16fbb45861 None admin] RBAC: Adding query filter params (role.id=b5c62080008c4f3baa59ef8985befc47, scope.project.id=db323e19e6ee4196a29be0d178ff0eb0, user.id=0470acd2a63f4c0781810be5d5df8ca2) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:13.434008 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7210b1-017b-479d-8ae2-1c16fbb45861 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:13.435475 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7210b1-017b-479d-8ae2-1c16fbb45861 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:13.441606 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 69/137] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:11:13 2022] GET /identity/v3/role_assignments?user.id=0470acd2a63f4c0781810be5d5df8ca2&scope.project.id=db323e19e6ee4196a29be0d178ff0eb0&role.id=b5c62080008c4f3baa59ef8985befc47 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:13.505499 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e09dc5-7fe2-4af8-a64a-8beefad67af7 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:13.505824 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e09dc5-7fe2-4af8-a64a-8beefad67af7 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:13.506063 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e09dc5-7fe2-4af8-a64a-8beefad67af7 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:13.507615 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 69/138] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:13.513825 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858bf1d-4df1-41ff-8c08-30584b940c4c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:13.514116 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858bf1d-4df1-41ff-8c08-30584b940c4c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:13.514396 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b858bf1d-4df1-41ff-8c08-30584b940c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:13.527282 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:13.541411 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b858bf1d-4df1-41ff-8c08-30584b940c4c None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:13.543585 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b858bf1d-4df1-41ff-8c08-30584b940c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:13.629808 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 70/139] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:13.653305 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e09dc5-7fe2-4af8-a64a-8beefad67af7 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:13.670029 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:13.773975 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e09dc5-7fe2-4af8-a64a-8beefad67af7 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:13.816209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed3f5c-617c-46dc-8328-750d5db1deac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:13.816859 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed3f5c-617c-46dc-8328-750d5db1deac None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:13.817142 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed3f5c-617c-46dc-8328-750d5db1deac None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:13.817419 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ed3f5c-617c-46dc-8328-750d5db1deac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:13.831778 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ed3f5c-617c-46dc-8328-750d5db1deac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:13.836896 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-20ed3f5c-617c-46dc-8328-750d5db1deac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:11:13.836896 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:13.836896 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:13.836896 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:13.836896 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:13.836896 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:13.836896 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:13.836896 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:13.836896 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:13.836896 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:13.836896 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:13.836896 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:13.836896 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:13.836896 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:13.836896 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:13.836896 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:13.837761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:13.837761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:13.837761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:13.837761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:13.837761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:13.837761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:13.837761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:13.837761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:13.837761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:13.837761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:13.837761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:13.837761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:13.837761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:13.837761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:13.837761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:13.837761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:13.838933 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:13.838933 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:13.838933 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:13.838933 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:13.838933 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:13.838933 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:13.838933 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:13.838933 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:13.838933 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:13.838933 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:13.838933 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:11:13.838933 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:11:13.838933 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 70/140] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jul 27 15:11:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:13.844040 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858bf1d-4df1-41ff-8c08-30584b940c4c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:13.965198 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b858bf1d-4df1-41ff-8c08-30584b940c4c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:14.005755 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:14.015090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ec592e-4222-43ae-af52-d6877909cf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:14.016074 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec592e-4222-43ae-af52-d6877909cf85 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:14.016588 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec592e-4222-43ae-af52-d6877909cf85 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:14.017067 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec592e-4222-43ae-af52-d6877909cf85 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:14.017994 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec592e-4222-43ae-af52-d6877909cf85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:14.018503 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec592e-4222-43ae-af52-d6877909cf85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:14.020125 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ec592e-4222-43ae-af52-d6877909cf85 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:14.031584 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 71/141] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:11:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:14.037384 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed3f5c-617c-46dc-8328-750d5db1deac None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:14.137837 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:14.173695 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ed3f5c-617c-46dc-8328-750d5db1deac None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:14.180544 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ade6d-9b5a-40f4-8e9e-102fb7d7e4d3 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:14.180846 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ade6d-9b5a-40f4-8e9e-102fb7d7e4d3 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:14.181132 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ade6d-9b5a-40f4-8e9e-102fb7d7e4d3 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:14.182495 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 72/142] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:14.187502 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa12a4-f2a8-48a0-b123-a740316a8987 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:14.187792 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa12a4-f2a8-48a0-b123-a740316a8987 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:14.188113 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa12a4-f2a8-48a0-b123-a740316a8987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:14.206729 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-20aa12a4-f2a8-48a0-b123-a740316a8987 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:14.207928 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-20aa12a4-f2a8-48a0-b123-a740316a8987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:14.226013 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d556a0-3292-4e20-90ae-65038311e3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:14.226594 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d556a0-3292-4e20-90ae-65038311e3d0 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:14.226931 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d556a0-3292-4e20-90ae-65038311e3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:14.227210 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d556a0-3292-4e20-90ae-65038311e3d0 None admin] PATH_INFO: `/v3/users/ad4a70e32c774ff3ae25d8ff565d4a1d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:14.229876 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d556a0-3292-4e20-90ae-65038311e3d0 None admin] RBAC: Authorizing `identity:get_user(user_id=ad4a70e32c774ff3ae25d8ff565d4a1d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:14.232533 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d556a0-3292-4e20-90ae-65038311e3d0 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:14.237330 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 71/143] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:11:14 2022] GET /identity/v3/users/ad4a70e32c774ff3ae25d8ff565d4a1d => generated 247 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:14.239382 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d556a0-3292-4e20-90ae-65038311e3d0 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:14.333129 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 73/144] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 15:11:14.370898 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa12a4-f2a8-48a0-b123-a740316a8987 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:14.425639 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d556a0-3292-4e20-90ae-65038311e3d0 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:14.493733 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04c6406-bbc1-4bd6-9be3-0b243e8608b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:14.494280 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c6406-bbc1-4bd6-9be3-0b243e8608b1 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:14.494553 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c6406-bbc1-4bd6-9be3-0b243e8608b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:14.494834 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04c6406-bbc1-4bd6-9be3-0b243e8608b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:14.519681 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:14.580908 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa12a4-f2a8-48a0-b123-a740316a8987 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:14.626269 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:14.646401 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3c4fa-7aaf-4f85-a5a9-e7d79f8a2c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:14.647062 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3c4fa-7aaf-4f85-a5a9-e7d79f8a2c91 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:14.647348 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3c4fa-7aaf-4f85-a5a9-e7d79f8a2c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:14.647625 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3c4fa-7aaf-4f85-a5a9-e7d79f8a2c91 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:14.648943 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec3c4fa-7aaf-4f85-a5a9-e7d79f8a2c91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:14.650378 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec3c4fa-7aaf-4f85-a5a9-e7d79f8a2c91 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:14.652216 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 74/145] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:11:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:11:14.653122 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37090230-7e6d-463a-bf09-80bd773456cd None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:14.653428 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37090230-7e6d-463a-bf09-80bd773456cd None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:14.654207 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c6406-bbc1-4bd6-9be3-0b243e8608b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:14.655675 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04c6406-bbc1-4bd6-9be3-0b243e8608b1 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:14.657888 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37090230-7e6d-463a-bf09-80bd773456cd None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:14.659133 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 75/146] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:14.659818 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37090230-7e6d-463a-bf09-80bd773456cd None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:14.825335 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37090230-7e6d-463a-bf09-80bd773456cd None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:14.858256 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 72/147] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:11:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 15:11:14.859690 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970b4d7-fd8a-4d1c-9862-d36c50853518 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:14.860110 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970b4d7-fd8a-4d1c-9862-d36c50853518 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:14.860389 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970b4d7-fd8a-4d1c-9862-d36c50853518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:14.861172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef496faf-88d9-4fab-ad2b-567de2a02ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:14.861896 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef496faf-88d9-4fab-ad2b-567de2a02ab2 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:14.862280 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef496faf-88d9-4fab-ad2b-567de2a02ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:14.862656 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef496faf-88d9-4fab-ad2b-567de2a02ab2 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:14.863526 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef496faf-88d9-4fab-ad2b-567de2a02ab2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:14.865090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef496faf-88d9-4fab-ad2b-567de2a02ab2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:14.891348 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-5970b4d7-fd8a-4d1c-9862-d36c50853518 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:14.893283 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5970b4d7-fd8a-4d1c-9862-d36c50853518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:14.902712 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 76/148] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Jul 27 15:11:14 2022] POST /identity/v3/users => generated 283 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:11:14.903557 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef496faf-88d9-4fab-ad2b-567de2a02ab2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:14.943485 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:15.008505 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 73/149] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:15.010405 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:15.040204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970b4d7-fd8a-4d1c-9862-d36c50853518 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:15.141992 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef496faf-88d9-4fab-ad2b-567de2a02ab2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:15.205454 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce823a7-5b32-4f35-82f6-6268e016b6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:15.206462 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce823a7-5b32-4f35-82f6-6268e016b6e4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:15.206973 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce823a7-5b32-4f35-82f6-6268e016b6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:15.207450 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce823a7-5b32-4f35-82f6-6268e016b6e4 None admin] PATH_INFO: `/v3/projects/db323e19e6ee4196a29be0d178ff0eb0` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:15.209737 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce823a7-5b32-4f35-82f6-6268e016b6e4 None admin] RBAC: Authorizing `identity:get_project(project_id=db323e19e6ee4196a29be0d178ff0eb0)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:15.211935 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce823a7-5b32-4f35-82f6-6268e016b6e4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:15.213998 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 77/150] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:14 2022] GET /identity/v3/projects/db323e19e6ee4196a29be0d178ff0eb0 => generated 298 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:15.220980 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce823a7-5b32-4f35-82f6-6268e016b6e4 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:15.231367 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970b4d7-fd8a-4d1c-9862-d36c50853518 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:15.297222 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95033e33-9d9c-43aa-8784-a37214a2b0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:15.298241 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95033e33-9d9c-43aa-8784-a37214a2b0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:15.298804 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95033e33-9d9c-43aa-8784-a37214a2b0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:15.300871 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95033e33-9d9c-43aa-8784-a37214a2b0a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:15.323527 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95033e33-9d9c-43aa-8784-a37214a2b0a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:15.329902 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-95033e33-9d9c-43aa-8784-a37214a2b0a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 15:11:15.329902 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:15.329902 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:15.329902 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:15.329902 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:15.329902 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:15.329902 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:15.329902 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:15.329902 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:15.329902 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:15.329902 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:15.329902 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:15.329902 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:15.329902 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:15.329902 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:15.329902 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:15.330742 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:15.330742 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:15.330742 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:15.330742 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:15.330742 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:15.330742 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:15.330742 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:15.330742 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:15.330742 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:15.330742 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:15.330742 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:15.330742 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:15.330742 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:15.330742 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:15.330742 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:15.330742 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:15.331536 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:15.331536 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:15.331536 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:15.331536 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:15.331536 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:15.331536 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:15.331536 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:15.331536 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:15.331536 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:15.331536 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:15.331536 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 15:11:15.331536 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:11:15.337735 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 74/151] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:11:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:11:15.343971 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95033e33-9d9c-43aa-8784-a37214a2b0a8 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:15.401751 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:15.421944 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce823a7-5b32-4f35-82f6-6268e016b6e4 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:15.451781 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:15.487349 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e1cc9-f993-49c5-8312-df1d0bd46fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:15.488366 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e1cc9-f993-49c5-8312-df1d0bd46fe6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:15.488847 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e1cc9-f993-49c5-8312-df1d0bd46fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:15.489344 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14e1cc9-f993-49c5-8312-df1d0bd46fe6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:15.490338 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e1cc9-f993-49c5-8312-df1d0bd46fe6 None admin] RBAC: Adding query filter params (role.id=6535f8b98008471dba33e89bd460880d, scope.project.id=db323e19e6ee4196a29be0d178ff0eb0, user.id=ad4a70e32c774ff3ae25d8ff565d4a1d) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:15.490853 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e1cc9-f993-49c5-8312-df1d0bd46fe6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:15.493511 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14e1cc9-f993-49c5-8312-df1d0bd46fe6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:15.504415 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 78/152] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:11:15 2022] GET /identity/v3/role_assignments?user.id=ad4a70e32c774ff3ae25d8ff565d4a1d&scope.project.id=db323e19e6ee4196a29be0d178ff0eb0&role.id=6535f8b98008471dba33e89bd460880d => generated 608 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:11:15.523692 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95033e33-9d9c-43aa-8784-a37214a2b0a8 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:15.584452 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab5323-cc13-4a46-b218-1437f580a7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:15.585494 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab5323-cc13-4a46-b218-1437f580a7ac None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:15.585974 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab5323-cc13-4a46-b218-1437f580a7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:15.586514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab5323-cc13-4a46-b218-1437f580a7ac None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:15.587461 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab5323-cc13-4a46-b218-1437f580a7ac None admin] RBAC: Adding query filter params (name=member) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:15.587972 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab5323-cc13-4a46-b218-1437f580a7ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:15.592026 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab5323-cc13-4a46-b218-1437f580a7ac None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:15.604102 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 75/153] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jul 27 15:11:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:15.609932 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e1cc9-f993-49c5-8312-df1d0bd46fe6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:15.736982 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14e1cc9-f993-49c5-8312-df1d0bd46fe6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:15.777547 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8bb332-5f56-406c-9f31-bb2df6d91779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:15.778271 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bb332-5f56-406c-9f31-bb2df6d91779 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:15.778551 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bb332-5f56-406c-9f31-bb2df6d91779 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:15.778825 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8bb332-5f56-406c-9f31-bb2df6d91779 None admin] PATH_INFO: `/v3/users/ba54789172a447cfa1bd06445f4610b8` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:15.780138 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8bb332-5f56-406c-9f31-bb2df6d91779 None admin] RBAC: Authorizing `identity:get_user(user_id=ba54789172a447cfa1bd06445f4610b8)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:15.781686 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8bb332-5f56-406c-9f31-bb2df6d91779 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:15.783653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 79/154] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:11:15 2022] GET /identity/v3/users/ba54789172a447cfa1bd06445f4610b8 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:15.789287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab5323-cc13-4a46-b218-1437f580a7ac None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:15.892081 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:15.902287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab5323-cc13-4a46-b218-1437f580a7ac None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:15.938829 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a81d33-eae6-4232-b4de-3fe24ceb160b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:15.939462 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a81d33-eae6-4232-b4de-3fe24ceb160b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:15.939749 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a81d33-eae6-4232-b4de-3fe24ceb160b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:15.940046 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a81d33-eae6-4232-b4de-3fe24ceb160b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:16.013199 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a81d33-eae6-4232-b4de-3fe24ceb160b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:16.014608 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a81d33-eae6-4232-b4de-3fe24ceb160b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:16.126324 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:16.137486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 76/155] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:11:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 15:11:16.142735 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8bb332-5f56-406c-9f31-bb2df6d91779 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:16.154003 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb96e5-bf72-464e-b496-313657784312 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:16.154280 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb96e5-bf72-464e-b496-313657784312 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:16.154546 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cb96e5-bf72-464e-b496-313657784312 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:16.156135 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 77/156] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:16.161119 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def54858-67df-4b1c-99bf-d77d5fd1e522 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:16.161400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def54858-67df-4b1c-99bf-d77d5fd1e522 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:16.161678 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def54858-67df-4b1c-99bf-d77d5fd1e522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:16.197931 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-def54858-67df-4b1c-99bf-d77d5fd1e522 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:16.198585 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-def54858-67df-4b1c-99bf-d77d5fd1e522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:16.232665 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:16.313171 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8bb332-5f56-406c-9f31-bb2df6d91779 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:16.325317 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 78/157] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:16.353324 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def54858-67df-4b1c-99bf-d77d5fd1e522 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:16.359159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8f202-1512-481c-b0fc-7f8445fdba1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:16.360081 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8f202-1512-481c-b0fc-7f8445fdba1d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:16.360506 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8f202-1512-481c-b0fc-7f8445fdba1d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:16.360919 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c8f202-1512-481c-b0fc-7f8445fdba1d None admin] PATH_INFO: `/v3/projects/db323e19e6ee4196a29be0d178ff0eb0` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:16.362372 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8f202-1512-481c-b0fc-7f8445fdba1d None admin] RBAC: Authorizing `identity:get_project(project_id=db323e19e6ee4196a29be0d178ff0eb0)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:16.364093 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c8f202-1512-481c-b0fc-7f8445fdba1d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:16.366007 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 80/158] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:16 2022] GET /identity/v3/projects/db323e19e6ee4196a29be0d178ff0eb0 => generated 298 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:16.378309 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8f202-1512-481c-b0fc-7f8445fdba1d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:16.466779 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def54858-67df-4b1c-99bf-d77d5fd1e522 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:16.492184 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:16.497002 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c8f202-1512-481c-b0fc-7f8445fdba1d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:16.504073 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe945e9-b03e-42aa-9a86-5fe830ef2f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:16.504715 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe945e9-b03e-42aa-9a86-5fe830ef2f33 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:16.504994 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe945e9-b03e-42aa-9a86-5fe830ef2f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:16.505262 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe945e9-b03e-42aa-9a86-5fe830ef2f33 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:16.516550 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:16.518665 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe945e9-b03e-42aa-9a86-5fe830ef2f33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:16.524113 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-9fe945e9-b03e-42aa-9a86-5fe830ef2f33 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 15:11:16.524113 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:16.524113 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:16.524113 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:16.524113 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:16.524113 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:16.524113 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:16.524113 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:16.524113 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:16.524113 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:16.524113 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:16.524113 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:16.524113 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:16.524113 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:16.524113 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:16.524113 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:16.524976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:16.524976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:16.524976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:16.524976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:16.524976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:16.524976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:16.524976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:16.524976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:16.524976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:16.524976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:16.524976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:16.524976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:16.524976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:16.524976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:16.524976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:16.524976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:16.525763 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:16.525763 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:16.525763 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:16.525763 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:16.525763 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:16.525763 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:16.525763 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:16.525763 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:16.525763 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:16.525763 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:16.525763 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 15:11:16.525763 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:11:16.525763 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 79/159] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:11:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:16.526892 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e834bf-063a-4614-a6ab-48958f52d6ae None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:16.526892 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e834bf-063a-4614-a6ab-48958f52d6ae None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:16.527049 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e834bf-063a-4614-a6ab-48958f52d6ae None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:16.533011 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 80/160] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:16.534083 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a6f84-c85d-4457-9006-2fdf5292ec11 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:16.534364 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a6f84-c85d-4457-9006-2fdf5292ec11 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:16.534633 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04a6f84-c85d-4457-9006-2fdf5292ec11 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:16.536032 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 81/161] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:16.536593 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a6f84-c85d-4457-9006-2fdf5292ec11 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:16.553240 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6962a8-56ec-405c-947b-a7e53085afea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:16.553871 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6962a8-56ec-405c-947b-a7e53085afea None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:16.554219 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6962a8-56ec-405c-947b-a7e53085afea None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:16.554413 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6962a8-56ec-405c-947b-a7e53085afea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:16.555274 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6962a8-56ec-405c-947b-a7e53085afea None admin] RBAC: Adding query filter params (role.id=05b155ad77f0416a85b84ab318160c53, scope.project.id=db323e19e6ee4196a29be0d178ff0eb0, user.id=ba54789172a447cfa1bd06445f4610b8) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:16.555586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6962a8-56ec-405c-947b-a7e53085afea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:16.557061 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6962a8-56ec-405c-947b-a7e53085afea None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:16.571647 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 81/162] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:11:16 2022] GET /identity/v3/role_assignments?user.id=ba54789172a447cfa1bd06445f4610b8&scope.project.id=db323e19e6ee4196a29be0d178ff0eb0&role.id=05b155ad77f0416a85b84ab318160c53 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:11:16.572983 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3068d91-37f4-4f44-b06d-01556e2d0dd0 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:16.573200 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3068d91-37f4-4f44-b06d-01556e2d0dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:16.573476 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3068d91-37f4-4f44-b06d-01556e2d0dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:16.633740 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f3068d91-37f4-4f44-b06d-01556e2d0dd0 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:16.634980 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f3068d91-37f4-4f44-b06d-01556e2d0dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:16.677458 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04a6f84-c85d-4457-9006-2fdf5292ec11 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:16.755630 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3e05a-adaf-4002-b510-34cde172d10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:16.760548 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3e05a-adaf-4002-b510-34cde172d10b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:16.760949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3e05a-adaf-4002-b510-34cde172d10b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:16.761230 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3e05a-adaf-4002-b510-34cde172d10b None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:16.761986 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3e05a-adaf-4002-b510-34cde172d10b None admin] RBAC: Adding query filter params (name=member) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:16.762292 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3e05a-adaf-4002-b510-34cde172d10b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:16.763698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3e05a-adaf-4002-b510-34cde172d10b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:16.770469 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 82/163] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:16.771910 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f9dbf-51e7-45cf-aca0-c11490711de2 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:16.772230 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f9dbf-51e7-45cf-aca0-c11490711de2 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:16.772506 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5f9dbf-51e7-45cf-aca0-c11490711de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:16.778624 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 82/164] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jul 27 15:11:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:16.784384 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3e05a-adaf-4002-b510-34cde172d10b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:16.807898 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-0c5f9dbf-51e7-45cf-aca0-c11490711de2 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:16.809140 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0c5f9dbf-51e7-45cf-aca0-c11490711de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:16.881757 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:16.926235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 83/165] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:16.927111 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f9dbf-51e7-45cf-aca0-c11490711de2 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:16.979804 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3e05a-adaf-4002-b510-34cde172d10b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:17.016955 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:17.025776 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb5767-902e-479c-b037-9ab5a588d5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:17.026685 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb5767-902e-479c-b037-9ab5a588d5fd None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:17.027164 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb5767-902e-479c-b037-9ab5a588d5fd None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:17.027613 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cb5767-902e-479c-b037-9ab5a588d5fd None admin] PATH_INFO: `/v3/users/ba54789172a447cfa1bd06445f4610b8` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:17.029085 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb5767-902e-479c-b037-9ab5a588d5fd None admin] RBAC: Authorizing `identity:get_user(user_id=ba54789172a447cfa1bd06445f4610b8)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:17.030723 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cb5767-902e-479c-b037-9ab5a588d5fd None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:17.032854 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 83/166] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:11:16 2022] GET /identity/v3/users/ba54789172a447cfa1bd06445f4610b8 => generated 275 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:17.036027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb5767-902e-479c-b037-9ab5a588d5fd None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:17.090792 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5f9dbf-51e7-45cf-aca0-c11490711de2 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:17.133788 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e8acf-bb80-4b22-86bb-3bbfad4afdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:17.134729 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e8acf-bb80-4b22-86bb-3bbfad4afdc1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:17.135203 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e8acf-bb80-4b22-86bb-3bbfad4afdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:17.135631 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e8acf-bb80-4b22-86bb-3bbfad4afdc1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:17.149545 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e8acf-bb80-4b22-86bb-3bbfad4afdc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:17.155859 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-830e8acf-bb80-4b22-86bb-3bbfad4afdc1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 15:11:17.155859 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:17.155859 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:17.155859 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:17.155859 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:17.155859 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:17.155859 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:17.155859 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:17.155859 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:17.155859 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:17.155859 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:17.155859 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:17.155859 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:17.155859 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:17.155859 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:17.155859 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:17.156934 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:17.156934 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:17.156934 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:17.156934 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:17.156934 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:17.156934 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:17.156934 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:17.156934 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:17.156934 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:17.156934 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:17.156934 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:17.156934 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:17.156934 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:17.156934 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:17.156934 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:17.156934 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:17.158151 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:17.158151 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:17.158151 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:17.158151 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:17.158151 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:17.158151 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:17.158151 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:17.158151 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:17.158151 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:17.158151 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:17.158151 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 15:11:17.158151 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:11:17.161086 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 84/167] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:11:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:17.162151 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e8acf-bb80-4b22-86bb-3bbfad4afdc1 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:17.288678 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cb5767-902e-479c-b037-9ab5a588d5fd None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:17.312371 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:17.342253 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:17.347561 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e8acf-bb80-4b22-86bb-3bbfad4afdc1 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:17.358458 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97354d-ddfa-4087-a2d4-c12a0efcd188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:17.359303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97354d-ddfa-4087-a2d4-c12a0efcd188 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:17.359757 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97354d-ddfa-4087-a2d4-c12a0efcd188 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:17.360209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97354d-ddfa-4087-a2d4-c12a0efcd188 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:17.379334 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec97354d-ddfa-4087-a2d4-c12a0efcd188 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:17.387207 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-ec97354d-ddfa-4087-a2d4-c12a0efcd188 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 15:11:17.387207 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:17.387207 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:17.387207 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:17.387207 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:17.387207 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:17.387207 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:17.387207 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:17.387207 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:17.387207 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:17.387207 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:17.387207 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:17.387207 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:17.387207 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:17.387207 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:17.387207 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:17.388302 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:17.388302 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:17.388302 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:17.388302 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:17.388302 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:17.388302 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:17.388302 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:17.388302 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:17.388302 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:17.388302 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:17.388302 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:17.388302 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:17.388302 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:17.388302 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:17.388302 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:17.388302 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:17.389327 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:17.389327 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:17.389327 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:17.389327 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:17.389327 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:17.389327 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:17.389327 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:17.389327 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:17.389327 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:17.389327 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:17.389327 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 15:11:17.389327 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:11:17.395069 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 84/168] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jul 27 15:11:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:17.396154 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97354d-ddfa-4087-a2d4-c12a0efcd188 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:17.438033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640ad9d-fa21-4058-9c13-a59999a54799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:17.438657 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640ad9d-fa21-4058-9c13-a59999a54799 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:17.438941 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640ad9d-fa21-4058-9c13-a59999a54799 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:17.439212 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640ad9d-fa21-4058-9c13-a59999a54799 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:17.503327 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97354d-ddfa-4087-a2d4-c12a0efcd188 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:17.569777 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293a779-7aec-4f7b-9abd-f1f7aec49e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:17.570676 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293a779-7aec-4f7b-9abd-f1f7aec49e8e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:17.571128 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293a779-7aec-4f7b-9abd-f1f7aec49e8e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:17.571547 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293a779-7aec-4f7b-9abd-f1f7aec49e8e None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:17.572454 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293a779-7aec-4f7b-9abd-f1f7aec49e8e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:17.573590 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293a779-7aec-4f7b-9abd-f1f7aec49e8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:17.580942 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293a779-7aec-4f7b-9abd-f1f7aec49e8e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:17.603581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 85/169] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jul 27 15:11:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:17.604194 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640ad9d-fa21-4058-9c13-a59999a54799 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:17.605880 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640ad9d-fa21-4058-9c13-a59999a54799 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:17.606885 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293a779-7aec-4f7b-9abd-f1f7aec49e8e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:17.683926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:17.772455 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:17.778341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 85/170] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:11:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 617 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 15:11:17.779225 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640ad9d-fa21-4058-9c13-a59999a54799 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:17.807628 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293a779-7aec-4f7b-9abd-f1f7aec49e8e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:17.892685 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9f4fa-81b5-475d-bc66-da4f435995bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:17.893314 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9f4fa-81b5-475d-bc66-da4f435995bb None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:17.893596 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9f4fa-81b5-475d-bc66-da4f435995bb None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:17.893870 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c9f4fa-81b5-475d-bc66-da4f435995bb None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:17.894590 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9f4fa-81b5-475d-bc66-da4f435995bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:17.894899 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9f4fa-81b5-475d-bc66-da4f435995bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:17.896353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c9f4fa-81b5-475d-bc66-da4f435995bb None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:17.913402 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640ad9d-fa21-4058-9c13-a59999a54799 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:17.917973 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 86/171] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:11:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:17.918788 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9f4fa-81b5-475d-bc66-da4f435995bb None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:17.971351 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107da462-774c-4c44-ab43-65197224630c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:17.971910 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107da462-774c-4c44-ab43-65197224630c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:17.972217 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107da462-774c-4c44-ab43-65197224630c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:17.972492 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107da462-774c-4c44-ab43-65197224630c None admin] PATH_INFO: `/v3/users/0470acd2a63f4c0781810be5d5df8ca2` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:17.974237 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107da462-774c-4c44-ab43-65197224630c None admin] RBAC: Authorizing `identity:get_user(user_id=0470acd2a63f4c0781810be5d5df8ca2)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:17.975678 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107da462-774c-4c44-ab43-65197224630c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:17.980397 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 86/172] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:11:17 2022] GET /identity/v3/users/0470acd2a63f4c0781810be5d5df8ca2 => generated 289 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:17.980948 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107da462-774c-4c44-ab43-65197224630c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:18.093608 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:18.107360 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c9f4fa-81b5-475d-bc66-da4f435995bb None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:18.128605 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107da462-774c-4c44-ab43-65197224630c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:18.128605 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:18.158285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27a03c-0e94-4afe-921d-28c28fc46c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:18.158930 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27a03c-0e94-4afe-921d-28c28fc46c3e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:18.164207 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27a03c-0e94-4afe-921d-28c28fc46c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:18.164207 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d27a03c-0e94-4afe-921d-28c28fc46c3e None admin] PATH_INFO: `/v3/users/ba54789172a447cfa1bd06445f4610b8` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:18.164207 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27a03c-0e94-4afe-921d-28c28fc46c3e None admin] RBAC: Authorizing `identity:get_user(user_id=ba54789172a447cfa1bd06445f4610b8)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:18.164207 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d27a03c-0e94-4afe-921d-28c28fc46c3e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:18.169505 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 87/173] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:11:17 2022] GET /identity/v3/users/ba54789172a447cfa1bd06445f4610b8 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:18.169505 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27a03c-0e94-4afe-921d-28c28fc46c3e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:18.178443 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c517d0-a749-45da-9ae3-667471e762a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:18.179414 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c517d0-a749-45da-9ae3-667471e762a8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:18.179970 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c517d0-a749-45da-9ae3-667471e762a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:18.180473 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c517d0-a749-45da-9ae3-667471e762a8 None admin] PATH_INFO: `/v3/projects/2e0af706b8c64ed1a94cef87d1fa1670` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:18.181846 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c517d0-a749-45da-9ae3-667471e762a8 None admin] RBAC: Authorizing `identity:get_project(project_id=2e0af706b8c64ed1a94cef87d1fa1670)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:18.183490 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c517d0-a749-45da-9ae3-667471e762a8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:18.185408 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 87/174] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:17 2022] GET /identity/v3/projects/2e0af706b8c64ed1a94cef87d1fa1670 => generated 312 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:18.186389 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c517d0-a749-45da-9ae3-667471e762a8 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:18.276573 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d27a03c-0e94-4afe-921d-28c28fc46c3e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:18.314103 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec9f55-a044-4b7a-8470-2af4a7a9aaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:18.314741 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c517d0-a749-45da-9ae3-667471e762a8 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:18.315709 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec9f55-a044-4b7a-8470-2af4a7a9aaaf None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:18.316366 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec9f55-a044-4b7a-8470-2af4a7a9aaaf None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:18.316958 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec9f55-a044-4b7a-8470-2af4a7a9aaaf None admin] PATH_INFO: `/v3/projects/db323e19e6ee4196a29be0d178ff0eb0` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:18.318358 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec9f55-a044-4b7a-8470-2af4a7a9aaaf None admin] RBAC: Authorizing `identity:get_project(project_id=db323e19e6ee4196a29be0d178ff0eb0)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:18.320088 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ec9f55-a044-4b7a-8470-2af4a7a9aaaf None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:18.322789 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 88/175] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:18 2022] GET /identity/v3/projects/db323e19e6ee4196a29be0d178ff0eb0 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:18.323807 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec9f55-a044-4b7a-8470-2af4a7a9aaaf None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:18.336951 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:18.362852 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e3f19-6cc6-45dd-89e3-89b71d1861b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:18.363486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e3f19-6cc6-45dd-89e3-89b71d1861b1 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:18.363784 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e3f19-6cc6-45dd-89e3-89b71d1861b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:18.364069 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e3f19-6cc6-45dd-89e3-89b71d1861b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:18.408975 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:18.439964 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec9f55-a044-4b7a-8470-2af4a7a9aaaf None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:18.458218 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e3f19-6cc6-45dd-89e3-89b71d1861b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:18.460354 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e3f19-6cc6-45dd-89e3-89b71d1861b1 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:18.481319 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16781964-5a16-41cb-ad05-ba311939bed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:18.481942 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16781964-5a16-41cb-ad05-ba311939bed2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:18.482224 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16781964-5a16-41cb-ad05-ba311939bed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:18.482499 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16781964-5a16-41cb-ad05-ba311939bed2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:18.483295 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16781964-5a16-41cb-ad05-ba311939bed2 None admin] RBAC: Adding query filter params (role.id=05b155ad77f0416a85b84ab318160c53, scope.project.id=2e0af706b8c64ed1a94cef87d1fa1670, user.id=ba54789172a447cfa1bd06445f4610b8) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:18.483613 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16781964-5a16-41cb-ad05-ba311939bed2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:18.485799 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16781964-5a16-41cb-ad05-ba311939bed2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:18.494236 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 89/176] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:11:18 2022] GET /identity/v3/role_assignments?user.id=ba54789172a447cfa1bd06445f4610b8&scope.project.id=2e0af706b8c64ed1a94cef87d1fa1670&role.id=05b155ad77f0416a85b84ab318160c53 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:18.495841 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b77a8f-1563-45df-ba7a-277e1372d438 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:18.496153 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b77a8f-1563-45df-ba7a-277e1372d438 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:18.496432 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b77a8f-1563-45df-ba7a-277e1372d438 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:18.498161 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 90/177] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:18.499013 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b77a8f-1563-45df-ba7a-277e1372d438 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:18.581545 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 88/178] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:11:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 15:11:18.581545 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead701e-95d6-4c53-96fe-4d99341ca28b None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:18.581545 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead701e-95d6-4c53-96fe-4d99341ca28b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:18.581545 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead701e-95d6-4c53-96fe-4d99341ca28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:18.602476 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:18.603952 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-2ead701e-95d6-4c53-96fe-4d99341ca28b None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:18.605507 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-2ead701e-95d6-4c53-96fe-4d99341ca28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:18.644817 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b77a8f-1563-45df-ba7a-277e1372d438 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:18.685703 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:18.689193 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d5c04d-1f7b-4eb4-a60f-221dcc6bf150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:18.689891 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5c04d-1f7b-4eb4-a60f-221dcc6bf150 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:18.690178 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5c04d-1f7b-4eb4-a60f-221dcc6bf150 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:18.690458 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d5c04d-1f7b-4eb4-a60f-221dcc6bf150 None admin] PATH_INFO: `/v3/projects/db323e19e6ee4196a29be0d178ff0eb0/users/0470acd2a63f4c0781810be5d5df8ca2/roles/b5c62080008c4f3baa59ef8985befc47` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:18.694417 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5c04d-1f7b-4eb4-a60f-221dcc6bf150 None admin] RBAC: Authorizing `identity:create_grant(project_id=db323e19e6ee4196a29be0d178ff0eb0, user_id=0470acd2a63f4c0781810be5d5df8ca2, role_id=b5c62080008c4f3baa59ef8985befc47)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:18.696947 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d5c04d-1f7b-4eb4-a60f-221dcc6bf150 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:18.698843 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 89/179] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:18.699939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead701e-95d6-4c53-96fe-4d99341ca28b None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:18.730362 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 91/180] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jul 27 15:11:18 2022] PUT /identity/v3/projects/db323e19e6ee4196a29be0d178ff0eb0/users/0470acd2a63f4c0781810be5d5df8ca2/roles/b5c62080008c4f3baa59ef8985befc47 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:11:18.731697 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96427c-9535-4ed6-bf45-77c22c3fda79 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:18.732005 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96427c-9535-4ed6-bf45-77c22c3fda79 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:18.732359 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96427c-9535-4ed6-bf45-77c22c3fda79 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:18.733914 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 92/181] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:18.739907 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cdf26-bd57-4970-b2b5-6cc25f9b9614 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:18.740258 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cdf26-bd57-4970-b2b5-6cc25f9b9614 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:18.740554 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cdf26-bd57-4970-b2b5-6cc25f9b9614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:18.762125 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-585cdf26-bd57-4970-b2b5-6cc25f9b9614 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:18.763376 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-585cdf26-bd57-4970-b2b5-6cc25f9b9614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:18.853339 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead701e-95d6-4c53-96fe-4d99341ca28b None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:18.854996 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 93/182] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 15:11:18.855690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cdf26-bd57-4970-b2b5-6cc25f9b9614 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:18.899873 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6435f25-7280-4ffc-9343-7070870d0e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:18.901225 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6435f25-7280-4ffc-9343-7070870d0e84 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:18.901728 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6435f25-7280-4ffc-9343-7070870d0e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:18.902201 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6435f25-7280-4ffc-9343-7070870d0e84 None admin] PATH_INFO: `/v3/projects/db323e19e6ee4196a29be0d178ff0eb0` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:18.904235 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6435f25-7280-4ffc-9343-7070870d0e84 None admin] RBAC: Authorizing `identity:get_project(project_id=db323e19e6ee4196a29be0d178ff0eb0)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:18.906278 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6435f25-7280-4ffc-9343-7070870d0e84 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:18.908289 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 90/183] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:18 2022] GET /identity/v3/projects/db323e19e6ee4196a29be0d178ff0eb0 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:18.909460 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6435f25-7280-4ffc-9343-7070870d0e84 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:18.968478 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:18.996326 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:19.016733 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cdf26-bd57-4970-b2b5-6cc25f9b9614 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:19.047008 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6435f25-7280-4ffc-9343-7070870d0e84 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:19.058269 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e86e3-67f2-42e1-95fb-3bfa30d63b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:19.058909 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e86e3-67f2-42e1-95fb-3bfa30d63b3f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:19.059186 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e86e3-67f2-42e1-95fb-3bfa30d63b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:19.059456 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e86e3-67f2-42e1-95fb-3bfa30d63b3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:19.070740 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e86e3-67f2-42e1-95fb-3bfa30d63b3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:19.075620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-d59e86e3-67f2-42e1-95fb-3bfa30d63b3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:11:19.075620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:19.075620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:19.075620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:19.075620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:19.075620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:19.075620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:19.075620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:19.075620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:19.075620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:19.075620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:19.075620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:19.075620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:19.075620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:19.075620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:19.075620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:19.076653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:19.076653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:19.076653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:19.076653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:19.076653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:19.076653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:19.076653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:19.076653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:19.076653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:19.076653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:19.076653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:19.076653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:19.076653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:19.076653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:19.076653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:19.076653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:19.077457 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:19.077457 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:19.077457 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:19.077457 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:19.077457 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:19.077457 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:19.077457 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:19.077457 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:19.077457 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:19.077457 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:19.077457 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:11:19.077457 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:11:19.077457 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 94/184] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jul 27 15:11:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:19.078115 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e86e3-67f2-42e1-95fb-3bfa30d63b3f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:19.086482 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374cc28f-249a-4ac0-9d54-47ab6bef7259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:19.087139 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cc28f-249a-4ac0-9d54-47ab6bef7259 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:19.087429 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cc28f-249a-4ac0-9d54-47ab6bef7259 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:19.087709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374cc28f-249a-4ac0-9d54-47ab6bef7259 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:19.088891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374cc28f-249a-4ac0-9d54-47ab6bef7259 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:19.090335 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374cc28f-249a-4ac0-9d54-47ab6bef7259 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:19.092097 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 91/185] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:11:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:19.093217 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8b11f-7826-4fce-bf64-e07753df7165 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:19.093509 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8b11f-7826-4fce-bf64-e07753df7165 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:19.093787 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8b11f-7826-4fce-bf64-e07753df7165 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:19.095145 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 92/186] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:19.097046 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8b11f-7826-4fce-bf64-e07753df7165 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:19.191047 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e86e3-67f2-42e1-95fb-3bfa30d63b3f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:19.202365 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8b11f-7826-4fce-bf64-e07753df7165 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:19.210789 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:19.231454 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a66b4-6c30-4b63-99ba-ad22f3caae37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:19.232114 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a66b4-6c30-4b63-99ba-ad22f3caae37 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:19.232398 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a66b4-6c30-4b63-99ba-ad22f3caae37 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:19.232673 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a66b4-6c30-4b63-99ba-ad22f3caae37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:19.233476 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a66b4-6c30-4b63-99ba-ad22f3caae37 None admin] RBAC: Adding query filter params (role.id=ce7d7a296f4e448dbb11ded292818043, scope.project.id=db323e19e6ee4196a29be0d178ff0eb0, user.id=ba54789172a447cfa1bd06445f4610b8) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:19.233791 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a66b4-6c30-4b63-99ba-ad22f3caae37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:19.235232 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a66b4-6c30-4b63-99ba-ad22f3caae37 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:19.237237 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:19.252023 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 95/187] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:11:19 2022] GET /identity/v3/role_assignments?user.id=ba54789172a447cfa1bd06445f4610b8&scope.project.id=db323e19e6ee4196a29be0d178ff0eb0&role.id=ce7d7a296f4e448dbb11ded292818043 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:19.252023 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a66b4-6c30-4b63-99ba-ad22f3caae37 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:19.254844 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96eaee-59a8-4765-ae5f-45e5b8ecd242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:19.255626 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96eaee-59a8-4765-ae5f-45e5b8ecd242 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:19.255910 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96eaee-59a8-4765-ae5f-45e5b8ecd242 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:19.256343 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96eaee-59a8-4765-ae5f-45e5b8ecd242 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:19.257086 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96eaee-59a8-4765-ae5f-45e5b8ecd242 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:19.257395 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96eaee-59a8-4765-ae5f-45e5b8ecd242 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:19.259034 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96eaee-59a8-4765-ae5f-45e5b8ecd242 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:19.273319 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 93/188] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:11:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:19.273319 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adec28-4385-4e70-864b-e5b093691fde None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:19.273319 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adec28-4385-4e70-864b-e5b093691fde None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:19.273319 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8adec28-4385-4e70-864b-e5b093691fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:19.291924 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-b8adec28-4385-4e70-864b-e5b093691fde None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:19.293350 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b8adec28-4385-4e70-864b-e5b093691fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:19.379085 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 94/189] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:19.380038 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adec28-4385-4e70-864b-e5b093691fde None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:19.392681 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a66b4-6c30-4b63-99ba-ad22f3caae37 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:19.433411 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2fad5-81bb-4c86-b3c1-94a88ce23bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:19.434095 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2fad5-81bb-4c86-b3c1-94a88ce23bd3 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:19.434381 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2fad5-81bb-4c86-b3c1-94a88ce23bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:19.434707 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2fad5-81bb-4c86-b3c1-94a88ce23bd3 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:19.435414 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2fad5-81bb-4c86-b3c1-94a88ce23bd3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:19.437040 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2fad5-81bb-4c86-b3c1-94a88ce23bd3 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:19.465873 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 96/190] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Jul 27 15:11:19 2022] POST /identity/v3/users => generated 297 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:11:19.467047 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2fad5-81bb-4c86-b3c1-94a88ce23bd3 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:19.519455 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:19.524868 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8adec28-4385-4e70-864b-e5b093691fde None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:19.561156 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:19.600746 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd1f62-41ac-4571-b6be-a7a8cdd37fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:19.602633 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd1f62-41ac-4571-b6be-a7a8cdd37fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:19.603569 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd1f62-41ac-4571-b6be-a7a8cdd37fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:19.604086 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbd1f62-41ac-4571-b6be-a7a8cdd37fe4 None admin] PATH_INFO: `/v3/users/2dce1e52547748738bf636a30696828e` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:19.613398 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2fad5-81bb-4c86-b3c1-94a88ce23bd3 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:19.624963 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd1f62-41ac-4571-b6be-a7a8cdd37fe4 None admin] RBAC: Authorizing `identity:get_user(user_id=2dce1e52547748738bf636a30696828e)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:19.627557 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbd1f62-41ac-4571-b6be-a7a8cdd37fe4 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:19.630438 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 95/191] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:11:19 2022] GET /identity/v3/users/2dce1e52547748738bf636a30696828e => generated 283 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:19.639426 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd1f62-41ac-4571-b6be-a7a8cdd37fe4 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:19.659547 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546e736-fc86-47d7-b961-54e2d011da28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:19.660227 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546e736-fc86-47d7-b961-54e2d011da28 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:19.660526 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546e736-fc86-47d7-b961-54e2d011da28 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:19.660844 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546e736-fc86-47d7-b961-54e2d011da28 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:19.676038 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546e736-fc86-47d7-b961-54e2d011da28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:19.680501 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-c546e736-fc86-47d7-b961-54e2d011da28 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 15:11:19.680501 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:19.680501 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:19.680501 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:19.680501 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:19.680501 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:19.680501 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:19.680501 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:19.680501 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:19.680501 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:19.680501 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:19.680501 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:19.680501 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:19.680501 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:19.680501 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:19.680501 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:19.681377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:19.681377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:19.681377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:19.681377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:19.681377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:19.681377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:19.681377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:19.681377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:19.681377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:19.681377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:19.681377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:19.681377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:19.681377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:19.681377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:19.681377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:19.681377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:19.682198 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:19.682198 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:19.682198 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:19.682198 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:19.682198 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:19.682198 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:19.682198 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:19.682198 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:19.682198 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:19.682198 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:19.682198 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 15:11:19.682198 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:11:19.682198 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 97/192] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jul 27 15:11:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:19.689106 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546e736-fc86-47d7-b961-54e2d011da28 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:19.777097 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbd1f62-41ac-4571-b6be-a7a8cdd37fe4 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:19.815208 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7cf57-5a5f-4069-a96f-a353f5f7d974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:19.816027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7cf57-5a5f-4069-a96f-a353f5f7d974 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:19.816436 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7cf57-5a5f-4069-a96f-a353f5f7d974 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:19.816852 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7cf57-5a5f-4069-a96f-a353f5f7d974 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:19.817339 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:19.821534 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546e736-fc86-47d7-b961-54e2d011da28 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:19.866962 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0d45e-a3de-4812-a948-0fadc3eed30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:19.867655 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0d45e-a3de-4812-a948-0fadc3eed30c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:19.867941 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0d45e-a3de-4812-a948-0fadc3eed30c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:19.868269 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e0d45e-a3de-4812-a948-0fadc3eed30c None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:19.869520 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0d45e-a3de-4812-a948-0fadc3eed30c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:19.869520 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0d45e-a3de-4812-a948-0fadc3eed30c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:19.870780 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e0d45e-a3de-4812-a948-0fadc3eed30c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:19.881932 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:19.882209 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 98/193] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:11:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:19.889724 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0d45e-a3de-4812-a948-0fadc3eed30c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:19.911588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7cf57-5a5f-4069-a96f-a353f5f7d974 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:19.913061 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7cf57-5a5f-4069-a96f-a353f5f7d974 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:20.027604 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e0d45e-a3de-4812-a948-0fadc3eed30c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:20.033615 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 96/194] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:11:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 15:11:20.042191 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7cf57-5a5f-4069-a96f-a353f5f7d974 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:20.084222 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d3e7e-2c96-41c3-9b65-e378b70b7bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:20.085263 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d3e7e-2c96-41c3-9b65-e378b70b7bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:20.085758 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d3e7e-2c96-41c3-9b65-e378b70b7bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:20.086277 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d3e7e-2c96-41c3-9b65-e378b70b7bb5 None admin] PATH_INFO: `/v3/users/2dce1e52547748738bf636a30696828e` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:20.087810 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d3e7e-2c96-41c3-9b65-e378b70b7bb5 None admin] RBAC: Authorizing `identity:get_user(user_id=2dce1e52547748738bf636a30696828e)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:20.089499 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967d3e7e-2c96-41c3-9b65-e378b70b7bb5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:20.092513 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 99/195] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:11:19 2022] GET /identity/v3/users/2dce1e52547748738bf636a30696828e => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:20.099024 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d3e7e-2c96-41c3-9b65-e378b70b7bb5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:20.132375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:20.234204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:20.241855 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d3e7e-2c96-41c3-9b65-e378b70b7bb5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:20.282243 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762a681-abeb-442d-b334-0ee38d124a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:20.283228 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762a681-abeb-442d-b334-0ee38d124a96 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:20.283836 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762a681-abeb-442d-b334-0ee38d124a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:20.284345 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762a681-abeb-442d-b334-0ee38d124a96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:20.324848 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7cf57-5a5f-4069-a96f-a353f5f7d974 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:20.372295 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762a681-abeb-442d-b334-0ee38d124a96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:20.376374 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762a681-abeb-442d-b334-0ee38d124a96 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:20.414709 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:20.452707 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0aae1e-1bc6-437e-ba31-01f4551457c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:20.454166 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0aae1e-1bc6-437e-ba31-01f4551457c8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:20.454459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0aae1e-1bc6-437e-ba31-01f4551457c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:20.454740 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0aae1e-1bc6-437e-ba31-01f4551457c8 None admin] PATH_INFO: `/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:20.457568 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0aae1e-1bc6-437e-ba31-01f4551457c8 None admin] RBAC: Authorizing `identity:get_project(project_id=cd46e34c8ff44b9abce25e0fd266ac70)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:20.459026 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0aae1e-1bc6-437e-ba31-01f4551457c8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:20.460749 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 97/196] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:20 2022] GET /identity/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70 => generated 302 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:20.489477 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0aae1e-1bc6-437e-ba31-01f4551457c8 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:20.531845 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 100/197] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:11:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 15:11:20.542173 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762a681-abeb-442d-b334-0ee38d124a96 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:20.668431 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762a681-abeb-442d-b334-0ee38d124a96 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:20.700468 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:20.712256 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb2902-5836-42c2-ad69-b1a01b85ee5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:20.712900 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb2902-5836-42c2-ad69-b1a01b85ee5d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:20.713180 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb2902-5836-42c2-ad69-b1a01b85ee5d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:20.713450 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb2902-5836-42c2-ad69-b1a01b85ee5d None admin] PATH_INFO: `/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:20.717816 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb2902-5836-42c2-ad69-b1a01b85ee5d None admin] RBAC: Authorizing `identity:get_project(project_id=cd46e34c8ff44b9abce25e0fd266ac70)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:20.719248 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb2902-5836-42c2-ad69-b1a01b85ee5d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:20.729200 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 101/198] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:20 2022] GET /identity/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:20.738699 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0aae1e-1bc6-437e-ba31-01f4551457c8 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:20.745964 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb2902-5836-42c2-ad69-b1a01b85ee5d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:20.799811 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166895d-4bc9-4567-9555-32e6824991db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:20.800373 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166895d-4bc9-4567-9555-32e6824991db None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:20.800654 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166895d-4bc9-4567-9555-32e6824991db None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:20.800924 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166895d-4bc9-4567-9555-32e6824991db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:20.801711 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166895d-4bc9-4567-9555-32e6824991db None admin] RBAC: Adding query filter params (role.id=6535f8b98008471dba33e89bd460880d, scope.project.id=cd46e34c8ff44b9abce25e0fd266ac70, user.id=2dce1e52547748738bf636a30696828e) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:20.802019 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166895d-4bc9-4567-9555-32e6824991db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:20.803459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166895d-4bc9-4567-9555-32e6824991db None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:20.824704 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 98/199] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:11:20 2022] GET /identity/v3/role_assignments?user.id=2dce1e52547748738bf636a30696828e&scope.project.id=cd46e34c8ff44b9abce25e0fd266ac70&role.id=6535f8b98008471dba33e89bd460880d => generated 259 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:20.896157 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb2902-5836-42c2-ad69-b1a01b85ee5d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:20.939341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b684b-383b-40f1-b841-3a7ffe314dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:20.940093 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b684b-383b-40f1-b841-3a7ffe314dbc None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:20.940378 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b684b-383b-40f1-b841-3a7ffe314dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:20.940652 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b684b-383b-40f1-b841-3a7ffe314dbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:20.941536 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b684b-383b-40f1-b841-3a7ffe314dbc None admin] RBAC: Adding query filter params (role.id=ce7d7a296f4e448dbb11ded292818043, scope.project.id=cd46e34c8ff44b9abce25e0fd266ac70, user.id=2dce1e52547748738bf636a30696828e) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:20.941846 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b684b-383b-40f1-b841-3a7ffe314dbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:20.942652 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cfbe7-9947-4cb6-b66a-e9da5420c935 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:20.943168 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cfbe7-9947-4cb6-b66a-e9da5420c935 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:20.943378 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b684b-383b-40f1-b841-3a7ffe314dbc None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:20.943831 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5cfbe7-9947-4cb6-b66a-e9da5420c935 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:20.946282 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 99/200] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:20.952133 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107cfec-2a37-4d0e-a248-c6fc0bc8655c None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:20.952579 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 102/201] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:11:20 2022] GET /identity/v3/role_assignments?user.id=2dce1e52547748738bf636a30696828e&scope.project.id=cd46e34c8ff44b9abce25e0fd266ac70&role.id=ce7d7a296f4e448dbb11ded292818043 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:11:20.953070 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107cfec-2a37-4d0e-a248-c6fc0bc8655c None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:20.953815 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107cfec-2a37-4d0e-a248-c6fc0bc8655c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:20.974556 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-a107cfec-2a37-4d0e-a248-c6fc0bc8655c None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:20.976192 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a107cfec-2a37-4d0e-a248-c6fc0bc8655c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:20.996343 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:21.077041 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 100/202] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:21.100223 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b684b-383b-40f1-b841-3a7ffe314dbc None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:21.170947 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:21.217020 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b684b-383b-40f1-b841-3a7ffe314dbc None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:21.253452 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286e144-0558-447b-bec4-bc418494c18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:21.254118 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286e144-0558-447b-bec4-bc418494c18f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:21.254447 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286e144-0558-447b-bec4-bc418494c18f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:21.254624 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d286e144-0558-447b-bec4-bc418494c18f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:21.265021 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d286e144-0558-447b-bec4-bc418494c18f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:21.270422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-d286e144-0558-447b-bec4-bc418494c18f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 15:11:21.270422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:21.270422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:21.270422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:21.270422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:21.270422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:21.270422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:21.270422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:21.270422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:21.270422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:21.270422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:21.270422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:21.270422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:21.270422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:21.270422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:21.270422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:21.271454 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:21.271454 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:21.271454 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:21.271454 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:21.271454 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:21.271454 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:21.271454 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:21.271454 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:21.271454 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:21.271454 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:21.271454 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:21.271454 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:21.271454 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:21.271454 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:21.271454 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:21.271454 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:21.272337 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:21.272337 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:21.272337 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:21.272337 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:21.272337 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:21.272337 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:21.272337 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:21.272337 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:21.272337 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:21.272337 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:21.272337 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 15:11:21.272337 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:11:21.272337 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 103/203] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:11:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:21.277701 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107cfec-2a37-4d0e-a248-c6fc0bc8655c None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:21.395669 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107cfec-2a37-4d0e-a248-c6fc0bc8655c None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:21.438890 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c36d8c-7dcc-46bf-a2d2-fdd718c6b96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:21.439530 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c36d8c-7dcc-46bf-a2d2-fdd718c6b96d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:21.439799 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c36d8c-7dcc-46bf-a2d2-fdd718c6b96d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:21.440142 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c36d8c-7dcc-46bf-a2d2-fdd718c6b96d None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:21.440864 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c36d8c-7dcc-46bf-a2d2-fdd718c6b96d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:21.441167 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c36d8c-7dcc-46bf-a2d2-fdd718c6b96d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:21.442529 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c36d8c-7dcc-46bf-a2d2-fdd718c6b96d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:21.454548 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 101/204] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jul 27 15:11:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:21.460096 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286e144-0558-447b-bec4-bc418494c18f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:21.598713 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d286e144-0558-447b-bec4-bc418494c18f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:21.626191 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:21.648817 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a14c1a-c896-41c6-a285-f38db82d7a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:21.649707 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a14c1a-c896-41c6-a285-f38db82d7a4c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:21.650159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a14c1a-c896-41c6-a285-f38db82d7a4c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:21.650612 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a14c1a-c896-41c6-a285-f38db82d7a4c None admin] PATH_INFO: `/v3/users/0470acd2a63f4c0781810be5d5df8ca2` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:21.651958 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a14c1a-c896-41c6-a285-f38db82d7a4c None admin] RBAC: Authorizing `identity:get_user(user_id=0470acd2a63f4c0781810be5d5df8ca2)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:21.653590 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a14c1a-c896-41c6-a285-f38db82d7a4c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:21.655380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 104/205] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:11:21 2022] GET /identity/v3/users/0470acd2a63f4c0781810be5d5df8ca2 => generated 289 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:21.660890 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c36d8c-7dcc-46bf-a2d2-fdd718c6b96d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:21.665279 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:21.791391 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c36d8c-7dcc-46bf-a2d2-fdd718c6b96d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:21.825930 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b06e53-917a-485b-bc0e-aaae8c92f584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:21.826548 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b06e53-917a-485b-bc0e-aaae8c92f584 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:21.826823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b06e53-917a-485b-bc0e-aaae8c92f584 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:21.827089 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b06e53-917a-485b-bc0e-aaae8c92f584 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:21.911810 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b06e53-917a-485b-bc0e-aaae8c92f584 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:21.913211 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b06e53-917a-485b-bc0e-aaae8c92f584 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:21.920984 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:22.021534 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f724b8-b851-4ee5-a91e-40c1639fca50 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:22.021817 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f724b8-b851-4ee5-a91e-40c1639fca50 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:22.022133 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f724b8-b851-4ee5-a91e-40c1639fca50 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:22.023512 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 105/206] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:22.033286 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001496ed-712b-49f1-b022-58df8a4246c1 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:22.033570 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001496ed-712b-49f1-b022-58df8a4246c1 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:22.033841 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001496ed-712b-49f1-b022-58df8a4246c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:22.047163 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 102/207] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:11:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 15:11:22.058632 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b06e53-917a-485b-bc0e-aaae8c92f584 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:22.069219 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-001496ed-712b-49f1-b022-58df8a4246c1 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:22.070453 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-001496ed-712b-49f1-b022-58df8a4246c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:22.155507 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 106/208] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:22.184103 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001496ed-712b-49f1-b022-58df8a4246c1 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:22.275008 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b06e53-917a-485b-bc0e-aaae8c92f584 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:22.278831 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:22.282250 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001496ed-712b-49f1-b022-58df8a4246c1 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:22.312695 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:22.323875 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5d171-1fcf-4e52-bd68-56224fab95a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:22.324545 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5d171-1fcf-4e52-bd68-56224fab95a3 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:22.324870 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5d171-1fcf-4e52-bd68-56224fab95a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:22.325147 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b5d171-1fcf-4e52-bd68-56224fab95a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:22.336483 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b5d171-1fcf-4e52-bd68-56224fab95a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:22.341399 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-92b5d171-1fcf-4e52-bd68-56224fab95a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 15:11:22.341399 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:22.341399 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:22.341399 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:22.341399 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:22.341399 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:22.341399 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:22.341399 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:22.341399 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:22.341399 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:22.341399 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:22.341399 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:22.341399 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:22.341399 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:22.341399 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:22.341399 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:22.342291 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:22.342291 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:22.342291 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:22.342291 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:22.342291 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:22.342291 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:22.342291 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:22.342291 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:22.342291 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:22.342291 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:22.342291 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:22.342291 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:22.342291 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:22.342291 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:22.342291 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:22.342291 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:22.343080 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:22.343080 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:22.343080 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:22.343080 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:22.343080 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:22.343080 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:22.343080 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:22.343080 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:22.343080 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:22.343080 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:22.343080 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 15:11:22.343080 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:11:22.343080 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 107/209] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:11:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:11:22.348240 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5d171-1fcf-4e52-bd68-56224fab95a3 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:22.375346 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0098e-a8b5-4de4-8b9b-cf49976d47cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:22.376387 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0098e-a8b5-4de4-8b9b-cf49976d47cf None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:22.376869 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0098e-a8b5-4de4-8b9b-cf49976d47cf None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:22.377360 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0098e-a8b5-4de4-8b9b-cf49976d47cf None admin] PATH_INFO: `/v3/projects/db323e19e6ee4196a29be0d178ff0eb0` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:22.384774 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0098e-a8b5-4de4-8b9b-cf49976d47cf None admin] RBAC: Authorizing `identity:get_project(project_id=db323e19e6ee4196a29be0d178ff0eb0)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:22.386518 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0098e-a8b5-4de4-8b9b-cf49976d47cf None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:22.388483 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 103/210] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:22 2022] GET /identity/v3/projects/db323e19e6ee4196a29be0d178ff0eb0 => generated 298 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:22.395583 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0098e-a8b5-4de4-8b9b-cf49976d47cf None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:22.460033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b5d171-1fcf-4e52-bd68-56224fab95a3 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:22.495186 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95860a47-3554-462b-8610-e9fc37619060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:22.495845 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95860a47-3554-462b-8610-e9fc37619060 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:22.496153 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95860a47-3554-462b-8610-e9fc37619060 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:22.496423 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95860a47-3554-462b-8610-e9fc37619060 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:22.497317 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95860a47-3554-462b-8610-e9fc37619060 None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:22.497622 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95860a47-3554-462b-8610-e9fc37619060 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:22.499045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95860a47-3554-462b-8610-e9fc37619060 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:22.507530 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 108/211] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jul 27 15:11:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:11:22.513817 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95860a47-3554-462b-8610-e9fc37619060 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:22.560416 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:22.622652 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95860a47-3554-462b-8610-e9fc37619060 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:22.623410 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0098e-a8b5-4de4-8b9b-cf49976d47cf None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:22.657464 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8764fdd-4eb5-490d-be2a-d41398cd2773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:22.658094 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8764fdd-4eb5-490d-be2a-d41398cd2773 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:22.658373 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8764fdd-4eb5-490d-be2a-d41398cd2773 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:22.658642 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8764fdd-4eb5-490d-be2a-d41398cd2773 None admin] PATH_INFO: `/v3/users/3c24360a72d940549a1437ef97d5d10b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:22.669466 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d25a0d-e81c-497c-945d-29594487c404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:22.670354 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d25a0d-e81c-497c-945d-29594487c404 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:22.670647 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d25a0d-e81c-497c-945d-29594487c404 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:22.670928 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d25a0d-e81c-497c-945d-29594487c404 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:22.671732 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d25a0d-e81c-497c-945d-29594487c404 None admin] RBAC: Adding query filter params (role.id=b5c62080008c4f3baa59ef8985befc47, scope.project.id=db323e19e6ee4196a29be0d178ff0eb0, user.id=0470acd2a63f4c0781810be5d5df8ca2) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:22.672076 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d25a0d-e81c-497c-945d-29594487c404 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:22.674696 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d25a0d-e81c-497c-945d-29594487c404 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:22.675246 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8764fdd-4eb5-490d-be2a-d41398cd2773 None admin] RBAC: Authorizing `identity:get_user(user_id=3c24360a72d940549a1437ef97d5d10b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:22.676979 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8764fdd-4eb5-490d-be2a-d41398cd2773 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:22.683588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 104/213] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:11:22 2022] GET /identity/v3/role_assignments?user.id=0470acd2a63f4c0781810be5d5df8ca2&scope.project.id=db323e19e6ee4196a29be0d178ff0eb0&role.id=b5c62080008c4f3baa59ef8985befc47 => generated 608 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:11:22.684083 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 109/213] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:11:22 2022] GET /identity/v3/users/3c24360a72d940549a1437ef97d5d10b => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:11:22.684914 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a120d-dd18-4f33-aae1-81fc141b12ef None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:22.685209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a120d-dd18-4f33-aae1-81fc141b12ef None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:22.685502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923a120d-dd18-4f33-aae1-81fc141b12ef None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:22.686978 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 105/214] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:22.692413 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a120d-dd18-4f33-aae1-81fc141b12ef None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:22.692686 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7f584-b232-415d-bbec-9b26bdf84d04 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:22.692686 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7f584-b232-415d-bbec-9b26bdf84d04 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:22.692990 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d7f584-b232-415d-bbec-9b26bdf84d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:22.733208 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-61d7f584-b232-415d-bbec-9b26bdf84d04 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:22.734325 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-61d7f584-b232-415d-bbec-9b26bdf84d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:22.734530 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:22.817399 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923a120d-dd18-4f33-aae1-81fc141b12ef None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:22.860059 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c709d5d-fb32-420d-9896-a49f9ae4730b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:22.860687 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c709d5d-fb32-420d-9896-a49f9ae4730b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:22.860964 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c709d5d-fb32-420d-9896-a49f9ae4730b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:22.861234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c709d5d-fb32-420d-9896-a49f9ae4730b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:22.915367 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 110/215] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:22.946517 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7f584-b232-415d-bbec-9b26bdf84d04 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:22.949043 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c709d5d-fb32-420d-9896-a49f9ae4730b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:22.952656 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c709d5d-fb32-420d-9896-a49f9ae4730b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:22.979355 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:22.997808 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:23.075597 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 106/216] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:11:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 15:11:23.083004 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c709d5d-fb32-420d-9896-a49f9ae4730b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:23.086516 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d7f584-b232-415d-bbec-9b26bdf84d04 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:23.125520 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab7d4d-a446-4bd3-813b-ad565acd7632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:23.126161 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab7d4d-a446-4bd3-813b-ad565acd7632 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:23.126442 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab7d4d-a446-4bd3-813b-ad565acd7632 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:23.126803 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab7d4d-a446-4bd3-813b-ad565acd7632 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:23.127948 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab7d4d-a446-4bd3-813b-ad565acd7632 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:23.129333 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab7d4d-a446-4bd3-813b-ad565acd7632 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:23.131081 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 111/217] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:11:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:23.136778 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab7d4d-a446-4bd3-813b-ad565acd7632 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:23.211784 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c709d5d-fb32-420d-9896-a49f9ae4730b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:23.234565 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:23.241545 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab7d4d-a446-4bd3-813b-ad565acd7632 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:23.260340 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88561c-b335-4dbd-9cff-622b60756f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:23.261429 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88561c-b335-4dbd-9cff-622b60756f0e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:23.261930 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88561c-b335-4dbd-9cff-622b60756f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:23.262399 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88561c-b335-4dbd-9cff-622b60756f0e None admin] PATH_INFO: `/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:23.263892 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88561c-b335-4dbd-9cff-622b60756f0e None admin] RBAC: Authorizing `identity:get_project(project_id=cd46e34c8ff44b9abce25e0fd266ac70)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:23.265634 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88561c-b335-4dbd-9cff-622b60756f0e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:23.268083 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 107/218] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:23 2022] GET /identity/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:23.274683 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88561c-b335-4dbd-9cff-622b60756f0e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:23.278912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc643f4d-0e18-4951-b416-c29bd0637a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:23.279351 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:23.279523 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc643f4d-0e18-4951-b416-c29bd0637a93 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:23.279801 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc643f4d-0e18-4951-b416-c29bd0637a93 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:23.280099 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc643f4d-0e18-4951-b416-c29bd0637a93 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:23.281077 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc643f4d-0e18-4951-b416-c29bd0637a93 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:23.282346 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc643f4d-0e18-4951-b416-c29bd0637a93 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:23.306622 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 112/219] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Jul 27 15:11:23 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:11:23.352343 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f566a6-2971-4b72-8118-c080c151b006 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:23.352654 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f566a6-2971-4b72-8118-c080c151b006 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:23.352896 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f566a6-2971-4b72-8118-c080c151b006 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:23.354506 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 113/220] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:11:23.360365 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3314746-e8d9-4631-be36-f26fc56c06cf None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:23.360945 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3314746-e8d9-4631-be36-f26fc56c06cf None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:23.361419 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3314746-e8d9-4631-be36-f26fc56c06cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:23.380973 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b3314746-e8d9-4631-be36-f26fc56c06cf None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:23.382580 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b3314746-e8d9-4631-be36-f26fc56c06cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:23.403106 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88561c-b335-4dbd-9cff-622b60756f0e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:23.442488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ec62a6-4c57-4aa9-a892-62dabebb952d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:23.443477 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec62a6-4c57-4aa9-a892-62dabebb952d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:23.444044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec62a6-4c57-4aa9-a892-62dabebb952d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:23.444394 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ec62a6-4c57-4aa9-a892-62dabebb952d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:23.445327 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec62a6-4c57-4aa9-a892-62dabebb952d None admin] RBAC: Adding query filter params (role.id=05b155ad77f0416a85b84ab318160c53, scope.project.id=cd46e34c8ff44b9abce25e0fd266ac70, user.id=3c24360a72d940549a1437ef97d5d10b) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:23.445711 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec62a6-4c57-4aa9-a892-62dabebb952d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:23.447266 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ec62a6-4c57-4aa9-a892-62dabebb952d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:23.456294 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 108/221] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:11:23 2022] GET /identity/v3/role_assignments?user.id=3c24360a72d940549a1437ef97d5d10b&scope.project.id=cd46e34c8ff44b9abce25e0fd266ac70&role.id=05b155ad77f0416a85b84ab318160c53 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:23.457628 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4bda8-4cd9-43ee-9749-9ec07ef6438d None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:23.457918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4bda8-4cd9-43ee-9749-9ec07ef6438d None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:23.458188 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4bda8-4cd9-43ee-9749-9ec07ef6438d None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:23.459734 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 109/222] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:23.465589 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb04e9-75f1-4b6f-b2ae-2f2013e68607 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:23.465881 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb04e9-75f1-4b6f-b2ae-2f2013e68607 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:23.466161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb04e9-75f1-4b6f-b2ae-2f2013e68607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:23.470893 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 114/223] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:23.488660 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-96fb04e9-75f1-4b6f-b2ae-2f2013e68607 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:23.490215 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-96fb04e9-75f1-4b6f-b2ae-2f2013e68607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:23.494346 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3314746-e8d9-4631-be36-f26fc56c06cf None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:23.588025 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:23.596896 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 110/224] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 15:11:23.607382 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:23.621761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb04e9-75f1-4b6f-b2ae-2f2013e68607 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:23.633232 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3314746-e8d9-4631-be36-f26fc56c06cf None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:23.675281 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6032d-b2ad-4fbc-8d0c-7bdc30c6cd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:23.675920 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6032d-b2ad-4fbc-8d0c-7bdc30c6cd3f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:23.676242 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6032d-b2ad-4fbc-8d0c-7bdc30c6cd3f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:23.676502 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6032d-b2ad-4fbc-8d0c-7bdc30c6cd3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:23.695241 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6032d-b2ad-4fbc-8d0c-7bdc30c6cd3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:23.700715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-a7a6032d-b2ad-4fbc-8d0c-7bdc30c6cd3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:11:23.700715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:23.700715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:23.700715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:23.700715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:23.700715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:23.700715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:23.700715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:23.700715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:23.700715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:23.700715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:23.700715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:23.700715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:23.700715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:23.700715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:23.700715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:23.701872 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:23.701872 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:23.701872 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:23.701872 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:23.701872 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:23.701872 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:23.701872 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:23.701872 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:23.701872 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:23.701872 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:23.701872 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:23.701872 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:23.701872 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:23.701872 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:23.701872 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:23.701872 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:23.702851 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:23.702851 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:23.702851 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:23.702851 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:23.702851 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:23.702851 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:23.702851 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:23.702851 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:23.702851 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:23.702851 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:23.702851 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:11:23.702851 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:11:23.702851 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 115/225] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jul 27 15:11:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:23.710204 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6032d-b2ad-4fbc-8d0c-7bdc30c6cd3f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:23.750035 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb04e9-75f1-4b6f-b2ae-2f2013e68607 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:23.790800 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55228fc1-e58b-4e61-9fa1-6d7ffb7cb5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:23.791842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55228fc1-e58b-4e61-9fa1-6d7ffb7cb5ed None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:23.792338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55228fc1-e58b-4e61-9fa1-6d7ffb7cb5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:23.792855 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55228fc1-e58b-4e61-9fa1-6d7ffb7cb5ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:23.804024 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55228fc1-e58b-4e61-9fa1-6d7ffb7cb5ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:23.809686 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-55228fc1-e58b-4e61-9fa1-6d7ffb7cb5ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 15:11:23.809686 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:23.809686 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:23.809686 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:23.809686 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:23.809686 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:23.809686 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:23.809686 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:23.809686 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:23.809686 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:23.809686 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:23.809686 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:23.809686 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:23.809686 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:23.809686 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:23.809686 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:23.810558 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:23.810558 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:23.810558 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:23.810558 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:23.810558 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:23.810558 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:23.810558 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:23.810558 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:23.810558 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:23.810558 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:23.810558 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:23.810558 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:23.810558 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:23.810558 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:23.810558 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:23.810558 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:23.811338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:23.811338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:23.811338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:23.811338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:23.811338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:23.811338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:23.811338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:23.811338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:23.811338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:23.811338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:23.811338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 15:11:23.811338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:11:23.814227 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 111/226] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jul 27 15:11:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:11:23.819774 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55228fc1-e58b-4e61-9fa1-6d7ffb7cb5ed None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:23.823918 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6032d-b2ad-4fbc-8d0c-7bdc30c6cd3f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:23.875013 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785da2e7-e0ed-45de-9f81-a82213976fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:23.875553 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785da2e7-e0ed-45de-9f81-a82213976fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:23.875829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785da2e7-e0ed-45de-9f81-a82213976fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:23.876131 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785da2e7-e0ed-45de-9f81-a82213976fd4 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:23.876853 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785da2e7-e0ed-45de-9f81-a82213976fd4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:23.877152 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785da2e7-e0ed-45de-9f81-a82213976fd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:23.878530 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785da2e7-e0ed-45de-9f81-a82213976fd4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:23.897635 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 116/227] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:11:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:11:23.904723 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785da2e7-e0ed-45de-9f81-a82213976fd4 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:23.909342 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:23.925951 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:24.003223 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55228fc1-e58b-4e61-9fa1-6d7ffb7cb5ed None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:24.063857 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785da2e7-e0ed-45de-9f81-a82213976fd4 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:24.069043 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8272f-b76f-4f87-bf70-9a151df0a6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:24.070881 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8272f-b76f-4f87-bf70-9a151df0a6b2 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:24.070881 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8272f-b76f-4f87-bf70-9a151df0a6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:24.070881 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e8272f-b76f-4f87-bf70-9a151df0a6b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:24.071458 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8272f-b76f-4f87-bf70-9a151df0a6b2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:24.071761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8272f-b76f-4f87-bf70-9a151df0a6b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:24.073171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e8272f-b76f-4f87-bf70-9a151df0a6b2 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:24.087871 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 112/228] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:11:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:24.093840 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8272f-b76f-4f87-bf70-9a151df0a6b2 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:24.123041 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b031e2-dbe5-4f62-ab31-220f72444871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:24.123675 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b031e2-dbe5-4f62-ab31-220f72444871 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:24.123952 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b031e2-dbe5-4f62-ab31-220f72444871 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:24.124242 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b031e2-dbe5-4f62-ab31-220f72444871 None admin] PATH_INFO: `/v3/users/2dce1e52547748738bf636a30696828e` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:24.126280 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b031e2-dbe5-4f62-ab31-220f72444871 None admin] RBAC: Authorizing `identity:get_user(user_id=2dce1e52547748738bf636a30696828e)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:24.127647 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b031e2-dbe5-4f62-ab31-220f72444871 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:24.129265 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 117/229] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:11:23 2022] GET /identity/v3/users/2dce1e52547748738bf636a30696828e => generated 283 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:11:24.136259 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b031e2-dbe5-4f62-ab31-220f72444871 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:24.252015 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:24.262447 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e8272f-b76f-4f87-bf70-9a151df0a6b2 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:24.271635 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b031e2-dbe5-4f62-ab31-220f72444871 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:24.299495 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:24.308896 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97d86f-f1d1-4dd0-837a-98c67e8d8469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:24.309540 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97d86f-f1d1-4dd0-837a-98c67e8d8469 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:24.309824 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97d86f-f1d1-4dd0-837a-98c67e8d8469 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:24.310096 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d97d86f-f1d1-4dd0-837a-98c67e8d8469 None admin] PATH_INFO: `/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:24.311433 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97d86f-f1d1-4dd0-837a-98c67e8d8469 None admin] RBAC: Authorizing `identity:get_project(project_id=cd46e34c8ff44b9abce25e0fd266ac70)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:24.312932 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d97d86f-f1d1-4dd0-837a-98c67e8d8469 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:24.315121 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 118/230] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:24 2022] GET /identity/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:24.325156 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97d86f-f1d1-4dd0-837a-98c67e8d8469 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:24.330137 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32881103-95f7-486f-b98d-bf19739f501d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:24.331161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32881103-95f7-486f-b98d-bf19739f501d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:24.331657 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32881103-95f7-486f-b98d-bf19739f501d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:24.332198 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32881103-95f7-486f-b98d-bf19739f501d None admin] PATH_INFO: `/v3/users/2dce1e52547748738bf636a30696828e` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:24.333656 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32881103-95f7-486f-b98d-bf19739f501d None admin] RBAC: Authorizing `identity:get_user(user_id=2dce1e52547748738bf636a30696828e)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:24.335312 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32881103-95f7-486f-b98d-bf19739f501d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:24.337600 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 113/231] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:11:24 2022] GET /identity/v3/users/2dce1e52547748738bf636a30696828e => generated 283 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:11:24.342525 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32881103-95f7-486f-b98d-bf19739f501d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:24.497182 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d97d86f-f1d1-4dd0-837a-98c67e8d8469 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:24.535247 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32881103-95f7-486f-b98d-bf19739f501d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:24.560550 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a274aa2-d0a0-4c44-8b1b-95d5ad09620e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:24.561497 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a274aa2-d0a0-4c44-8b1b-95d5ad09620e None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:24.562005 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a274aa2-d0a0-4c44-8b1b-95d5ad09620e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:24.562537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a274aa2-d0a0-4c44-8b1b-95d5ad09620e None admin] PATH_INFO: `/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70/users/2dce1e52547748738bf636a30696828e/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:24.565984 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a274aa2-d0a0-4c44-8b1b-95d5ad09620e None admin] RBAC: Authorizing `identity:create_grant(project_id=cd46e34c8ff44b9abce25e0fd266ac70, user_id=2dce1e52547748738bf636a30696828e, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:24.567628 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a274aa2-d0a0-4c44-8b1b-95d5ad09620e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:24.591295 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:24.593590 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b39dc8-c74a-46a2-abee-16273d17d1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:24.594601 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b39dc8-c74a-46a2-abee-16273d17d1d7 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:24.595084 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b39dc8-c74a-46a2-abee-16273d17d1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:24.596865 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b39dc8-c74a-46a2-abee-16273d17d1d7 None admin] PATH_INFO: `/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:24.598408 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b39dc8-c74a-46a2-abee-16273d17d1d7 None admin] RBAC: Authorizing `identity:get_project(project_id=cd46e34c8ff44b9abce25e0fd266ac70)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:24.599459 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 119/232] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jul 27 15:11:24 2022] PUT /identity/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70/users/2dce1e52547748738bf636a30696828e/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:11:24.605898 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b39dc8-c74a-46a2-abee-16273d17d1d7 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:24.608145 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 114/233] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:24 2022] GET /identity/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70 => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:24.614633 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a274aa2-d0a0-4c44-8b1b-95d5ad09620e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:24.778756 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a274aa2-d0a0-4c44-8b1b-95d5ad09620e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:24.825123 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362bc66-429c-438b-90c2-ed3bf0d6c19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:24.826176 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362bc66-429c-438b-90c2-ed3bf0d6c19e None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:24.826662 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362bc66-429c-438b-90c2-ed3bf0d6c19e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:24.827137 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362bc66-429c-438b-90c2-ed3bf0d6c19e None admin] PATH_INFO: `/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70/users/2dce1e52547748738bf636a30696828e/roles/ce7d7a296f4e448dbb11ded292818043` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:24.830855 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9362bc66-429c-438b-90c2-ed3bf0d6c19e None admin] RBAC: Authorizing `identity:create_grant(project_id=cd46e34c8ff44b9abce25e0fd266ac70, user_id=2dce1e52547748738bf636a30696828e, role_id=ce7d7a296f4e448dbb11ded292818043)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:24.832651 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9362bc66-429c-438b-90c2-ed3bf0d6c19e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:24.861015 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 120/234] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jul 27 15:11:24 2022] PUT /identity/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70/users/2dce1e52547748738bf636a30696828e/roles/ce7d7a296f4e448dbb11ded292818043 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:11:25.754978 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107ee32-47e0-4112-85f1-545dadaf7d88 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:25.755513 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107ee32-47e0-4112-85f1-545dadaf7d88 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:25.755513 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c107ee32-47e0-4112-85f1-545dadaf7d88 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:25.756918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 115/235] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:25.762093 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d2b92-fb53-401d-8083-247507bb9941 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:25.762480 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d2b92-fb53-401d-8083-247507bb9941 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:25.762658 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d2b92-fb53-401d-8083-247507bb9941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:25.797118 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-483d2b92-fb53-401d-8083-247507bb9941 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:25.798329 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-483d2b92-fb53-401d-8083-247507bb9941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:25.862532 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:25.877041 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 121/236] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:25.897248 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107ee32-47e0-4112-85f1-545dadaf7d88 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:25.966895 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:25.990490 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f7460-a4cc-48d9-a521-906aef3d8886 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:25.990774 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f7460-a4cc-48d9-a521-906aef3d8886 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:25.991049 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81f7460-a4cc-48d9-a521-906aef3d8886 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:25.993265 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 122/237] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:11:26.001143 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94835f6e-a7ea-45bb-8f5a-223433fe4296 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:26.001431 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94835f6e-a7ea-45bb-8f5a-223433fe4296 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:26.001712 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94835f6e-a7ea-45bb-8f5a-223433fe4296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:26.021870 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c107ee32-47e0-4112-85f1-545dadaf7d88 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:26.030181 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-94835f6e-a7ea-45bb-8f5a-223433fe4296 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:26.031392 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-94835f6e-a7ea-45bb-8f5a-223433fe4296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:26.084207 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026d2008-4d21-42da-b973-b01af8fdd84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:26.084860 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d2008-4d21-42da-b973-b01af8fdd84b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:26.085136 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d2008-4d21-42da-b973-b01af8fdd84b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:26.085403 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d2008-4d21-42da-b973-b01af8fdd84b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:26.102967 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026d2008-4d21-42da-b973-b01af8fdd84b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:26.111465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-026d2008-4d21-42da-b973-b01af8fdd84b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 15:11:26.111465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:26.111465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:26.111465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:26.111465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:26.111465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:26.111465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:26.111465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:26.111465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:26.111465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:26.111465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:26.111465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:26.111465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:26.111465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:26.111465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:26.111465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:26.112365 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:26.112365 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:26.112365 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:26.112365 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:26.112365 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:26.112365 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:26.112365 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:26.112365 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:26.112365 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:26.112365 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:26.112365 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:26.112365 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:26.112365 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:26.112365 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:26.112365 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:26.112365 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:26.113204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:26.113204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:26.113204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:26.113204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:26.113204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:26.113204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:26.113204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:26.113204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:26.113204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:26.113204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:26.113204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 15:11:26.113204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:11:26.114422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 116/238] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:11:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:26.114625 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fdef6-c38b-4636-a9f2-ff9242d88ac1 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:26.116563 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fdef6-c38b-4636-a9f2-ff9242d88ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:26.116563 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332fdef6-c38b-4636-a9f2-ff9242d88ac1 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:26.116747 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 117/239] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:26.121167 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fdef6-c38b-4636-a9f2-ff9242d88ac1 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:26.125240 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 123/240] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:26.126625 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe60af9-236c-4889-8072-89f5e68fe6b7 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:26.126921 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe60af9-236c-4889-8072-89f5e68fe6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:26.127199 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe60af9-236c-4889-8072-89f5e68fe6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:26.146652 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-dbe60af9-236c-4889-8072-89f5e68fe6b7 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:26.147838 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-dbe60af9-236c-4889-8072-89f5e68fe6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:26.223263 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 124/241] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:26.224148 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe60af9-236c-4889-8072-89f5e68fe6b7 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:26.236942 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332fdef6-c38b-4636-a9f2-ff9242d88ac1 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:26.268382 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:26.287622 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:26.291917 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f39c7-8445-4ffc-9543-255f90ef6696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:26.292718 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f39c7-8445-4ffc-9543-255f90ef6696 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:26.293165 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f39c7-8445-4ffc-9543-255f90ef6696 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:26.293577 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f39c7-8445-4ffc-9543-255f90ef6696 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:26.294426 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f39c7-8445-4ffc-9543-255f90ef6696 None admin] RBAC: Adding query filter params (name=member) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:26.294868 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f39c7-8445-4ffc-9543-255f90ef6696 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:26.296391 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f39c7-8445-4ffc-9543-255f90ef6696 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:26.305017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 118/242] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jul 27 15:11:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:26.305978 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f39c7-8445-4ffc-9543-255f90ef6696 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:26.346162 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe60af9-236c-4889-8072-89f5e68fe6b7 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:26.387638 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a6e34-24af-48a8-8a6a-313c95e549ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:26.388716 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a6e34-24af-48a8-8a6a-313c95e549ef None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:26.388716 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a6e34-24af-48a8-8a6a-313c95e549ef None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:26.389097 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803a6e34-24af-48a8-8a6a-313c95e549ef None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:26.402058 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803a6e34-24af-48a8-8a6a-313c95e549ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:26.408341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-803a6e34-24af-48a8-8a6a-313c95e549ef None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 15:11:26.408341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:26.408341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:26.408341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:26.408341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:26.408341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:26.408341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:26.408341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:26.408341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:26.408341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:26.408341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:26.408341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:26.408341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:26.408341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:26.408341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:26.408341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:26.410150 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:26.410150 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:26.410150 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:26.410150 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:26.410150 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:26.410150 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:26.410150 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:26.410150 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:26.410150 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:26.410150 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:26.410150 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:26.410150 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:26.410150 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:26.410150 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:26.410150 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:26.410150 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:26.411240 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:26.411240 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:26.411240 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:26.411240 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:26.411240 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:26.411240 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:26.411240 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:26.411240 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:26.411240 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:26.411240 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:26.411240 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 15:11:26.411240 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:11:26.411240 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 125/243] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:11:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:26.411240 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a6e34-24af-48a8-8a6a-313c95e549ef None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:26.424669 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f39c7-8445-4ffc-9543-255f90ef6696 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:26.463885 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc47c6-4510-4c2d-98c3-138d018e4821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:26.464669 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc47c6-4510-4c2d-98c3-138d018e4821 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:26.464870 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc47c6-4510-4c2d-98c3-138d018e4821 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:26.465149 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc47c6-4510-4c2d-98c3-138d018e4821 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:26.467124 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc47c6-4510-4c2d-98c3-138d018e4821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:26.468031 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc47c6-4510-4c2d-98c3-138d018e4821 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:26.469851 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 119/244] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:11:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:26.474819 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc47c6-4510-4c2d-98c3-138d018e4821 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:26.537293 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803a6e34-24af-48a8-8a6a-313c95e549ef None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:26.548150 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:26.568379 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:26.574321 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8fa99-7fcd-4e6b-bc0e-bff11d4118e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:26.574963 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8fa99-7fcd-4e6b-bc0e-bff11d4118e6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:26.580387 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8fa99-7fcd-4e6b-bc0e-bff11d4118e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:26.580688 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d8fa99-7fcd-4e6b-bc0e-bff11d4118e6 None admin] PATH_INFO: `/v3/users/3c24360a72d940549a1437ef97d5d10b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:26.582010 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8fa99-7fcd-4e6b-bc0e-bff11d4118e6 None admin] RBAC: Authorizing `identity:get_user(user_id=3c24360a72d940549a1437ef97d5d10b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:26.583465 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d8fa99-7fcd-4e6b-bc0e-bff11d4118e6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:26.596136 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 126/245] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:11:26 2022] GET /identity/v3/users/3c24360a72d940549a1437ef97d5d10b => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:26.596136 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8fa99-7fcd-4e6b-bc0e-bff11d4118e6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:26.596352 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc47c6-4510-4c2d-98c3-138d018e4821 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:26.639522 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ea6d1-c30e-4647-bd38-21f88b7d8382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:26.640089 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ea6d1-c30e-4647-bd38-21f88b7d8382 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:26.640370 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ea6d1-c30e-4647-bd38-21f88b7d8382 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:26.640643 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ea6d1-c30e-4647-bd38-21f88b7d8382 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:26.641354 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ea6d1-c30e-4647-bd38-21f88b7d8382 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:26.641657 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ea6d1-c30e-4647-bd38-21f88b7d8382 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:26.643034 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ea6d1-c30e-4647-bd38-21f88b7d8382 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:26.653734 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 120/246] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jul 27 15:11:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:26.654875 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ea6d1-c30e-4647-bd38-21f88b7d8382 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:26.712962 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d8fa99-7fcd-4e6b-bc0e-bff11d4118e6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:26.758506 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee164955-6b1f-4cd6-ada4-e0bb38945f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:26.759131 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee164955-6b1f-4cd6-ada4-e0bb38945f57 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:26.759425 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee164955-6b1f-4cd6-ada4-e0bb38945f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:26.759679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee164955-6b1f-4cd6-ada4-e0bb38945f57 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:26.760913 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee164955-6b1f-4cd6-ada4-e0bb38945f57 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:26.762698 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee164955-6b1f-4cd6-ada4-e0bb38945f57 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:26.781220 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ea6d1-c30e-4647-bd38-21f88b7d8382 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:26.795331 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:26.800819 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 127/247] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Jul 27 15:11:26 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:11:26.802958 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee164955-6b1f-4cd6-ada4-e0bb38945f57 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:26.858501 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3ddff-e5fd-429a-8191-d21da43f07d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:26.859847 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3ddff-e5fd-429a-8191-d21da43f07d8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:26.860384 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3ddff-e5fd-429a-8191-d21da43f07d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:26.862864 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3ddff-e5fd-429a-8191-d21da43f07d8 None admin] PATH_INFO: `/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:26.864897 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3ddff-e5fd-429a-8191-d21da43f07d8 None admin] RBAC: Authorizing `identity:get_project(project_id=cd46e34c8ff44b9abce25e0fd266ac70)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:26.868474 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3ddff-e5fd-429a-8191-d21da43f07d8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:26.873640 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 121/248] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:26 2022] GET /identity/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70 => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:26.889181 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:26.894400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3ddff-e5fd-429a-8191-d21da43f07d8 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:26.990524 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee164955-6b1f-4cd6-ada4-e0bb38945f57 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:27.030408 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e0fbe-5fa0-486c-9f9a-63b397d6cc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:27.031574 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e0fbe-5fa0-486c-9f9a-63b397d6cc7a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:27.032088 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e0fbe-5fa0-486c-9f9a-63b397d6cc7a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:27.032621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e0fbe-5fa0-486c-9f9a-63b397d6cc7a None admin] PATH_INFO: `/v3/users/10993ef618c64eb09a79ded94b6259e0` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:27.048298 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e0fbe-5fa0-486c-9f9a-63b397d6cc7a None admin] RBAC: Authorizing `identity:get_user(user_id=10993ef618c64eb09a79ded94b6259e0)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:27.050293 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e0fbe-5fa0-486c-9f9a-63b397d6cc7a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:27.052246 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 128/249] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:11:26 2022] GET /identity/v3/users/10993ef618c64eb09a79ded94b6259e0 => generated 297 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:27.057408 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3ddff-e5fd-429a-8191-d21da43f07d8 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:27.058752 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e0fbe-5fa0-486c-9f9a-63b397d6cc7a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:27.094514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffdeeb3-bc62-4732-832c-91aaaf3d7488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:27.095197 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffdeeb3-bc62-4732-832c-91aaaf3d7488 None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:27.095473 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffdeeb3-bc62-4732-832c-91aaaf3d7488 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:27.095742 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffdeeb3-bc62-4732-832c-91aaaf3d7488 None admin] PATH_INFO: `/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70/users/3c24360a72d940549a1437ef97d5d10b/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:27.097736 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffdeeb3-bc62-4732-832c-91aaaf3d7488 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd46e34c8ff44b9abce25e0fd266ac70, user_id=3c24360a72d940549a1437ef97d5d10b, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:27.099185 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffdeeb3-bc62-4732-832c-91aaaf3d7488 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:27.124027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 122/250] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jul 27 15:11:26 2022] PUT /identity/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70/users/3c24360a72d940549a1437ef97d5d10b/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:11:27.160684 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066569b-5fc8-4ae0-92f8-72a423ed07d4 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:27.161759 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066569b-5fc8-4ae0-92f8-72a423ed07d4 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:27.162233 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9066569b-5fc8-4ae0-92f8-72a423ed07d4 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:27.165231 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 123/251] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:11:27.172508 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235d9ba-e0d9-4537-91fa-4a00ad6ca4e9 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:27.172799 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235d9ba-e0d9-4537-91fa-4a00ad6ca4e9 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:27.173067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235d9ba-e0d9-4537-91fa-4a00ad6ca4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:27.189680 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:27.197447 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-7235d9ba-e0d9-4537-91fa-4a00ad6ca4e9 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:27.199664 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-7235d9ba-e0d9-4537-91fa-4a00ad6ca4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:27.201737 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e0fbe-5fa0-486c-9f9a-63b397d6cc7a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:27.236555 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:27.248537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8038f-883a-404c-9186-cf36e9d9c32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:27.249177 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8038f-883a-404c-9186-cf36e9d9c32a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:27.249462 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8038f-883a-404c-9186-cf36e9d9c32a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:27.249746 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8038f-883a-404c-9186-cf36e9d9c32a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:27.304273 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 124/252] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 15:11:27.325694 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235d9ba-e0d9-4537-91fa-4a00ad6ca4e9 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:27.352101 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c8038f-883a-404c-9186-cf36e9d9c32a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:27.353354 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c8038f-883a-404c-9186-cf36e9d9c32a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:27.461506 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235d9ba-e0d9-4537-91fa-4a00ad6ca4e9 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:27.472381 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:27.483899 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 129/253] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:11:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 15:11:27.485354 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676102a1-60fa-4a4b-ba95-1d2b1480d909 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:27.485910 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676102a1-60fa-4a4b-ba95-1d2b1480d909 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:27.486192 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676102a1-60fa-4a4b-ba95-1d2b1480d909 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:27.491057 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 130/254] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:27.492672 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676102a1-60fa-4a4b-ba95-1d2b1480d909 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:27.516574 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b6d16d-74d0-42f7-97e2-1e6d498f1fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:27.517234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6d16d-74d0-42f7-97e2-1e6d498f1fdf None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:27.517519 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6d16d-74d0-42f7-97e2-1e6d498f1fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:27.517796 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b6d16d-74d0-42f7-97e2-1e6d498f1fdf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:27.533338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b6d16d-74d0-42f7-97e2-1e6d498f1fdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:27.541532 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-55b6d16d-74d0-42f7-97e2-1e6d498f1fdf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:11:27.541532 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:27.541532 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:27.541532 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:27.541532 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:27.541532 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:27.541532 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:27.541532 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:27.541532 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:27.541532 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:27.541532 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:27.541532 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:27.541532 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:27.541532 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:27.541532 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:27.541532 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:27.542398 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:27.542398 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:27.542398 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:27.542398 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:27.542398 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:27.542398 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:27.542398 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:27.542398 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:27.542398 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:27.542398 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:27.542398 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:27.542398 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:27.542398 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:27.542398 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:27.542398 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:27.542398 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:27.543174 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:27.543174 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:27.543174 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:27.543174 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:27.543174 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:27.543174 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:27.543174 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:27.543174 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:27.543174 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:27.543174 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:27.543174 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:11:27.543174 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:11:27.548073 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 125/255] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jul 27 15:11:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:27.549372 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536c5ff-76f7-4828-84bb-f9e83d2da7fc None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:27.549669 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536c5ff-76f7-4828-84bb-f9e83d2da7fc None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:27.549950 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6536c5ff-76f7-4828-84bb-f9e83d2da7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:27.569759 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-6536c5ff-76f7-4828-84bb-f9e83d2da7fc None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:27.571018 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6536c5ff-76f7-4828-84bb-f9e83d2da7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:27.595067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:27.651332 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 126/256] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:27.652453 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536c5ff-76f7-4828-84bb-f9e83d2da7fc None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:27.733760 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676102a1-60fa-4a4b-ba95-1d2b1480d909 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:27.783220 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6536c5ff-76f7-4828-84bb-f9e83d2da7fc None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:27.796323 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d8525-9eb8-44d8-9393-e707b6baa12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:27.797641 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d8525-9eb8-44d8-9393-e707b6baa12b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:27.798135 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d8525-9eb8-44d8-9393-e707b6baa12b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:27.800070 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d8525-9eb8-44d8-9393-e707b6baa12b None admin] PATH_INFO: `/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:27.801440 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d8525-9eb8-44d8-9393-e707b6baa12b None admin] RBAC: Authorizing `identity:get_project(project_id=cd46e34c8ff44b9abce25e0fd266ac70)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:27.805800 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12d8525-9eb8-44d8-9393-e707b6baa12b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:27.807735 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 131/257] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:27 2022] GET /identity/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70 => generated 302 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:27.811910 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d8525-9eb8-44d8-9393-e707b6baa12b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:27.838352 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d067bf-1009-4fae-a004-496a89c1fef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:27.839368 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d067bf-1009-4fae-a004-496a89c1fef7 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:27.839859 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d067bf-1009-4fae-a004-496a89c1fef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:27.840359 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d067bf-1009-4fae-a004-496a89c1fef7 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:27.841273 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d067bf-1009-4fae-a004-496a89c1fef7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:27.841813 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d067bf-1009-4fae-a004-496a89c1fef7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:27.843478 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d067bf-1009-4fae-a004-496a89c1fef7 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:27.853110 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 127/258] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:11:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:27.854261 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d067bf-1009-4fae-a004-496a89c1fef7 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:27.874450 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:27.915626 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:27.968640 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d067bf-1009-4fae-a004-496a89c1fef7 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:27.982529 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d8525-9eb8-44d8-9393-e707b6baa12b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:28.003881 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6c54b-5a18-4a3a-a759-b33509160701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:28.004844 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6c54b-5a18-4a3a-a759-b33509160701 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:28.005326 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6c54b-5a18-4a3a-a759-b33509160701 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:28.005799 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb6c54b-5a18-4a3a-a759-b33509160701 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:28.006774 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6c54b-5a18-4a3a-a759-b33509160701 None admin] RBAC: Adding query filter params (role.id=b5c62080008c4f3baa59ef8985befc47, scope.project.id=cd46e34c8ff44b9abce25e0fd266ac70, user.id=10993ef618c64eb09a79ded94b6259e0) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:28.007274 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6c54b-5a18-4a3a-a759-b33509160701 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:28.008970 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb6c54b-5a18-4a3a-a759-b33509160701 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:28.015159 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 128/259] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:11:27 2022] GET /identity/v3/role_assignments?user.id=10993ef618c64eb09a79ded94b6259e0&scope.project.id=cd46e34c8ff44b9abce25e0fd266ac70&role.id=b5c62080008c4f3baa59ef8985befc47 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:28.016197 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6c54b-5a18-4a3a-a759-b33509160701 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:28.072273 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376b617-c793-4e74-bac6-a07284ea1f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:28.072934 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376b617-c793-4e74-bac6-a07284ea1f4b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:28.073214 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376b617-c793-4e74-bac6-a07284ea1f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:28.073488 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a376b617-c793-4e74-bac6-a07284ea1f4b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:28.101203 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a376b617-c793-4e74-bac6-a07284ea1f4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:28.107435 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-a376b617-c793-4e74-bac6-a07284ea1f4b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 15:11:28.107435 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:28.107435 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:28.107435 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:28.107435 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:28.107435 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:28.107435 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:28.107435 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:28.107435 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:28.107435 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:28.107435 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:28.107435 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:28.107435 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:28.107435 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:28.107435 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:28.107435 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:28.108355 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:28.108355 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:28.108355 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:28.108355 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:28.108355 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:28.108355 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:28.108355 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:28.108355 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:28.108355 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:28.108355 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:28.108355 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:28.108355 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:28.108355 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:28.108355 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:28.108355 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:28.108355 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:28.109127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:28.109127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:28.109127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:28.109127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:28.109127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:28.109127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:28.109127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:28.109127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:28.109127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:28.109127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:28.109127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 15:11:28.109127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:11:28.109127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 132/260] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jul 27 15:11:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:28.114902 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:28.115758 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376b617-c793-4e74-bac6-a07284ea1f4b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:28.134161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb6c54b-5a18-4a3a-a759-b33509160701 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:28.171102 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94a405-1cdd-4e5d-a24f-95bc7d5b54fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:28.172178 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94a405-1cdd-4e5d-a24f-95bc7d5b54fc None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:28.172656 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94a405-1cdd-4e5d-a24f-95bc7d5b54fc None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:28.173121 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94a405-1cdd-4e5d-a24f-95bc7d5b54fc None admin] PATH_INFO: `/v3/users/2dce1e52547748738bf636a30696828e` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:28.174587 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94a405-1cdd-4e5d-a24f-95bc7d5b54fc None admin] RBAC: Authorizing `identity:get_user(user_id=2dce1e52547748738bf636a30696828e)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:28.176335 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94a405-1cdd-4e5d-a24f-95bc7d5b54fc None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:28.178284 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 129/261] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:11:28 2022] GET /identity/v3/users/2dce1e52547748738bf636a30696828e => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:28.184616 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94a405-1cdd-4e5d-a24f-95bc7d5b54fc None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:28.304180 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94a405-1cdd-4e5d-a24f-95bc7d5b54fc None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:28.354705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79548b65-2912-43c0-b433-ae834aa9a722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:28.355663 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79548b65-2912-43c0-b433-ae834aa9a722 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:28.359012 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79548b65-2912-43c0-b433-ae834aa9a722 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:28.359501 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79548b65-2912-43c0-b433-ae834aa9a722 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:28.391695 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:28.403722 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a376b617-c793-4e74-bac6-a07284ea1f4b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:28.444279 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:28.476586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e8e44-7dad-4194-a8f7-a5e3c595d120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:28.477214 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e8e44-7dad-4194-a8f7-a5e3c595d120 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:28.477492 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e8e44-7dad-4194-a8f7-a5e3c595d120 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:28.477761 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13e8e44-7dad-4194-a8f7-a5e3c595d120 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:28.478477 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e8e44-7dad-4194-a8f7-a5e3c595d120 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:28.478779 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e8e44-7dad-4194-a8f7-a5e3c595d120 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:28.480173 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13e8e44-7dad-4194-a8f7-a5e3c595d120 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:28.494833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 133/262] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:11:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:28.500241 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e8e44-7dad-4194-a8f7-a5e3c595d120 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:28.502434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79548b65-2912-43c0-b433-ae834aa9a722 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:28.503899 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79548b65-2912-43c0-b433-ae834aa9a722 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:28.722906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13e8e44-7dad-4194-a8f7-a5e3c595d120 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:28.743221 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 130/263] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:11:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 15:11:28.748743 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79548b65-2912-43c0-b433-ae834aa9a722 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:28.764235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009add3-9d52-4986-8f5e-3a381f816ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:28.765319 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009add3-9d52-4986-8f5e-3a381f816ebf None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:28.765797 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009add3-9d52-4986-8f5e-3a381f816ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:28.766263 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009add3-9d52-4986-8f5e-3a381f816ebf None admin] PATH_INFO: `/v3/users/2dce1e52547748738bf636a30696828e` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:28.767817 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009add3-9d52-4986-8f5e-3a381f816ebf None admin] RBAC: Authorizing `identity:get_user(user_id=2dce1e52547748738bf636a30696828e)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:28.769572 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7009add3-9d52-4986-8f5e-3a381f816ebf None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:28.772786 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 134/264] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:11:28 2022] GET /identity/v3/users/2dce1e52547748738bf636a30696828e => generated 283 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:28.781509 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009add3-9d52-4986-8f5e-3a381f816ebf None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:28.843659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:28.877172 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:28.903770 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7009add3-9d52-4986-8f5e-3a381f816ebf None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:28.944068 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604a5f3-55ba-4492-90f8-bee6c47eef83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:28.945143 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604a5f3-55ba-4492-90f8-bee6c47eef83 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:28.945645 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604a5f3-55ba-4492-90f8-bee6c47eef83 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:28.946108 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604a5f3-55ba-4492-90f8-bee6c47eef83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:29.010538 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79548b65-2912-43c0-b433-ae834aa9a722 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:29.024714 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d604a5f3-55ba-4492-90f8-bee6c47eef83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:29.026809 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d604a5f3-55ba-4492-90f8-bee6c47eef83 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:29.079854 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:29.100339 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b445b8-1452-41b1-a4f0-fc939b1a9017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:29.100677 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b445b8-1452-41b1-a4f0-fc939b1a9017 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:29.100961 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b445b8-1452-41b1-a4f0-fc939b1a9017 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:29.101237 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b445b8-1452-41b1-a4f0-fc939b1a9017 None admin] PATH_INFO: `/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:29.105905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b445b8-1452-41b1-a4f0-fc939b1a9017 None admin] RBAC: Authorizing `identity:get_project(project_id=cd46e34c8ff44b9abce25e0fd266ac70)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:29.107349 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b445b8-1452-41b1-a4f0-fc939b1a9017 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:29.109416 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 131/265] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:28 2022] GET /identity/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70 => generated 302 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:29.114888 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b445b8-1452-41b1-a4f0-fc939b1a9017 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:29.143151 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 135/266] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:11:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 15:11:29.152446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604a5f3-55ba-4492-90f8-bee6c47eef83 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:29.338464 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604a5f3-55ba-4492-90f8-bee6c47eef83 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:29.361991 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b445b8-1452-41b1-a4f0-fc939b1a9017 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:29.385394 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953be5c4-49e1-455f-9a68-86f5ef1f8294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:29.386396 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953be5c4-49e1-455f-9a68-86f5ef1f8294 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:29.386869 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953be5c4-49e1-455f-9a68-86f5ef1f8294 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:29.387331 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953be5c4-49e1-455f-9a68-86f5ef1f8294 None admin] PATH_INFO: `/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:29.389240 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953be5c4-49e1-455f-9a68-86f5ef1f8294 None admin] RBAC: Authorizing `identity:get_project(project_id=cd46e34c8ff44b9abce25e0fd266ac70)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:29.390913 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953be5c4-49e1-455f-9a68-86f5ef1f8294 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:29.393356 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 136/267] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:29 2022] GET /identity/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70 => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:29.400131 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953be5c4-49e1-455f-9a68-86f5ef1f8294 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:29.405120 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:29.426360 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:29.456707 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf71af5-5118-4e08-8273-7deb2ff70d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:29.457700 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf71af5-5118-4e08-8273-7deb2ff70d6f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:29.458202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf71af5-5118-4e08-8273-7deb2ff70d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:29.458664 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf71af5-5118-4e08-8273-7deb2ff70d6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:29.459646 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf71af5-5118-4e08-8273-7deb2ff70d6f None admin] RBAC: Adding query filter params (role.id=6535f8b98008471dba33e89bd460880d, scope.project.id=cd46e34c8ff44b9abce25e0fd266ac70, user.id=2dce1e52547748738bf636a30696828e) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:29.460189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf71af5-5118-4e08-8273-7deb2ff70d6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:29.461894 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf71af5-5118-4e08-8273-7deb2ff70d6f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:29.486053 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 132/268] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:11:29 2022] GET /identity/v3/role_assignments?user.id=2dce1e52547748738bf636a30696828e&scope.project.id=cd46e34c8ff44b9abce25e0fd266ac70&role.id=6535f8b98008471dba33e89bd460880d => generated 608 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:11:29.554481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953be5c4-49e1-455f-9a68-86f5ef1f8294 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:29.608318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fce9a-a572-43ca-a27c-a971b8784149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:29.608936 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fce9a-a572-43ca-a27c-a971b8784149 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:29.609212 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fce9a-a572-43ca-a27c-a971b8784149 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:29.609486 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fce9a-a572-43ca-a27c-a971b8784149 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:29.610333 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8fce9a-a572-43ca-a27c-a971b8784149 None admin] RBAC: Adding query filter params (role.id=ce7d7a296f4e448dbb11ded292818043, scope.project.id=cd46e34c8ff44b9abce25e0fd266ac70, user.id=2dce1e52547748738bf636a30696828e) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:29.610647 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8fce9a-a572-43ca-a27c-a971b8784149 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:29.612135 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8fce9a-a572-43ca-a27c-a971b8784149 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:29.619036 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 137/269] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:11:29 2022] GET /identity/v3/role_assignments?user.id=2dce1e52547748738bf636a30696828e&scope.project.id=cd46e34c8ff44b9abce25e0fd266ac70&role.id=ce7d7a296f4e448dbb11ded292818043 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:29.952836 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df627736-fcac-41eb-a677-c6c49beeaaea None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:29.953313 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df627736-fcac-41eb-a677-c6c49beeaaea None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:29.953313 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df627736-fcac-41eb-a677-c6c49beeaaea None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:29.954959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 133/270] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:29.959807 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efefcee-e6ed-4515-ae35-861b78f4230e None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:29.960221 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efefcee-e6ed-4515-ae35-861b78f4230e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:29.960400 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efefcee-e6ed-4515-ae35-861b78f4230e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:29.980115 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-3efefcee-e6ed-4515-ae35-861b78f4230e None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:29.981320 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3efefcee-e6ed-4515-ae35-861b78f4230e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:30.041522 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26820c83-9c53-42e3-8639-1d1997220123 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:30.041825 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26820c83-9c53-42e3-8639-1d1997220123 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:30.042135 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26820c83-9c53-42e3-8639-1d1997220123 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:30.043437 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 134/271] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:11:30.048660 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86280378-6a87-4a71-a113-3d7e37d2e452 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:30.048951 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86280378-6a87-4a71-a113-3d7e37d2e452 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:30.049235 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86280378-6a87-4a71-a113-3d7e37d2e452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:30.063660 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 138/272] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:30.070510 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-86280378-6a87-4a71-a113-3d7e37d2e452 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:30.071687 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-86280378-6a87-4a71-a113-3d7e37d2e452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:30.099064 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efefcee-e6ed-4515-ae35-861b78f4230e None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:30.114356 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:30.154830 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 135/273] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 15:11:30.180116 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86280378-6a87-4a71-a113-3d7e37d2e452 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:30.216315 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efefcee-e6ed-4515-ae35-861b78f4230e None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:30.254444 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5a740-916b-4ae8-9d1a-945d6a576452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:30.255090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5a740-916b-4ae8-9d1a-945d6a576452 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:30.255435 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5a740-916b-4ae8-9d1a-945d6a576452 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:30.255715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5a740-916b-4ae8-9d1a-945d6a576452 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:30.256931 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5a740-916b-4ae8-9d1a-945d6a576452 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:30.258413 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5a740-916b-4ae8-9d1a-945d6a576452 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:30.260052 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 139/274] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:11:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:11:30.265334 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b71b9f-01b2-4f1e-a3c3-81316c4116de None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:30.265620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b71b9f-01b2-4f1e-a3c3-81316c4116de None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:30.265898 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b71b9f-01b2-4f1e-a3c3-81316c4116de None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:30.267347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 140/275] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:30.268628 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b71b9f-01b2-4f1e-a3c3-81316c4116de None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:30.294396 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86280378-6a87-4a71-a113-3d7e37d2e452 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:30.310476 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:30.335665 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29abad6a-165a-4359-9302-9ae12ed5050e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:30.336829 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abad6a-165a-4359-9302-9ae12ed5050e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:30.337235 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abad6a-165a-4359-9302-9ae12ed5050e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:30.337509 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29abad6a-165a-4359-9302-9ae12ed5050e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:30.350418 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29abad6a-165a-4359-9302-9ae12ed5050e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:30.357238 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-29abad6a-165a-4359-9302-9ae12ed5050e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 15:11:30.357238 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:30.357238 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:30.357238 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:30.357238 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:30.357238 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:30.357238 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:30.357238 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:30.357238 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:30.357238 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:30.357238 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:30.357238 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:30.357238 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:30.357238 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:30.357238 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:30.357238 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:30.358141 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:30.358141 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:30.358141 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:30.358141 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:30.358141 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:30.358141 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:30.358141 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:30.358141 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:30.358141 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:30.358141 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:30.358141 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:30.358141 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:30.358141 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:30.358141 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:30.358141 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:30.358141 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:30.358929 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:30.358929 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:30.358929 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:30.358929 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:30.358929 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:30.358929 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:30.358929 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:30.358929 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:30.358929 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:30.358929 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:30.358929 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 15:11:30.358929 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:11:30.358929 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 136/276] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:11:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:11:30.360689 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:30.361447 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4ce8d-1354-4e72-beeb-1a861313e00e None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:30.361447 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4ce8d-1354-4e72-beeb-1a861313e00e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:30.361729 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4ce8d-1354-4e72-beeb-1a861313e00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:30.382094 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-46f4ce8d-1354-4e72-beeb-1a861313e00e None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:30.383293 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-46f4ce8d-1354-4e72-beeb-1a861313e00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:30.384625 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b71b9f-01b2-4f1e-a3c3-81316c4116de None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:30.421762 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf5aea-26a8-45ba-b1c3-ee314422a019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:30.422377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf5aea-26a8-45ba-b1c3-ee314422a019 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:30.422728 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf5aea-26a8-45ba-b1c3-ee314422a019 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:30.422924 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edf5aea-26a8-45ba-b1c3-ee314422a019 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:30.423609 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf5aea-26a8-45ba-b1c3-ee314422a019 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:30.425208 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edf5aea-26a8-45ba-b1c3-ee314422a019 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:30.451070 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 141/277] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Jul 27 15:11:30 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:11:30.457376 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf5aea-26a8-45ba-b1c3-ee314422a019 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:30.459553 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 137/278] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:30.488539 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4ce8d-1354-4e72-beeb-1a861313e00e None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:30.619901 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edf5aea-26a8-45ba-b1c3-ee314422a019 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:30.623520 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4ce8d-1354-4e72-beeb-1a861313e00e None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:30.625675 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:30.660062 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51065f5-22e5-49b0-80a4-05b92a4460c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:30.660693 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51065f5-22e5-49b0-80a4-05b92a4460c0 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:30.660980 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51065f5-22e5-49b0-80a4-05b92a4460c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:30.661255 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51065f5-22e5-49b0-80a4-05b92a4460c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:30.661976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51065f5-22e5-49b0-80a4-05b92a4460c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:30.662286 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51065f5-22e5-49b0-80a4-05b92a4460c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:30.664503 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51065f5-22e5-49b0-80a4-05b92a4460c0 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:30.666993 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:30.669599 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2be21f-df82-4341-a4eb-205dab1126c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:30.670699 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2be21f-df82-4341-a4eb-205dab1126c8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:30.670985 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2be21f-df82-4341-a4eb-205dab1126c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:30.671256 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2be21f-df82-4341-a4eb-205dab1126c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:30.680145 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 142/279] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jul 27 15:11:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:30.681705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076d0a4-a913-4ebe-970e-328da9fa253a None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:30.682011 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076d0a4-a913-4ebe-970e-328da9fa253a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:30.682279 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076d0a4-a913-4ebe-970e-328da9fa253a None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:30.682455 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2be21f-df82-4341-a4eb-205dab1126c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:30.683552 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 143/280] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:30.684304 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076d0a4-a913-4ebe-970e-328da9fa253a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:30.688652 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-0c2be21f-df82-4341-a4eb-205dab1126c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 15:11:30.688652 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:30.688652 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:30.688652 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:30.688652 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:30.688652 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:30.688652 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:30.688652 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:30.688652 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:30.688652 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:30.688652 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:30.688652 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:30.688652 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:30.688652 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:30.688652 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:30.688652 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:30.689549 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:30.689549 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:30.689549 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:30.689549 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:30.689549 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:30.689549 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:30.689549 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:30.689549 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:30.689549 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:30.689549 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:30.689549 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:30.689549 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:30.689549 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:30.689549 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:30.689549 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:30.689549 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:30.690486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:30.690486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:30.690486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:30.690486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:30.690486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:30.690486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:30.690486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:30.690486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:30.690486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:30.690486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:30.690486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 15:11:30.690486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:11:30.690486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 138/281] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:11:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:11:30.691296 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025da3e-1f26-4a33-8992-a9947b9925bd None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:30.691296 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025da3e-1f26-4a33-8992-a9947b9925bd None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:30.692431 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f025da3e-1f26-4a33-8992-a9947b9925bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:30.709152 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-f025da3e-1f26-4a33-8992-a9947b9925bd None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:30.710341 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f025da3e-1f26-4a33-8992-a9947b9925bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:30.793687 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 139/282] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:30.793879 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025da3e-1f26-4a33-8992-a9947b9925bd None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:30.821039 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076d0a4-a913-4ebe-970e-328da9fa253a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:30.880579 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb206495-d3d8-4592-bddc-561d6ef9e0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:30.881230 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb206495-d3d8-4592-bddc-561d6ef9e0ec None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:30.881514 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb206495-d3d8-4592-bddc-561d6ef9e0ec None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:30.881790 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb206495-d3d8-4592-bddc-561d6ef9e0ec None admin] PATH_INFO: `/v3/users/3c24360a72d940549a1437ef97d5d10b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:30.883508 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb206495-d3d8-4592-bddc-561d6ef9e0ec None admin] RBAC: Authorizing `identity:get_user(user_id=3c24360a72d940549a1437ef97d5d10b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:30.885489 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb206495-d3d8-4592-bddc-561d6ef9e0ec None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:30.888262 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 144/283] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:11:30 2022] GET /identity/v3/users/3c24360a72d940549a1437ef97d5d10b => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:30.889339 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb206495-d3d8-4592-bddc-561d6ef9e0ec None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:30.913330 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:30.926464 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f025da3e-1f26-4a33-8992-a9947b9925bd None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:30.966493 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:30.977986 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc067a-09e9-4394-9119-dda8c0cbf829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:30.977986 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc067a-09e9-4394-9119-dda8c0cbf829 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:30.977986 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc067a-09e9-4394-9119-dda8c0cbf829 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:30.977986 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abc067a-09e9-4394-9119-dda8c0cbf829 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:30.978766 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc067a-09e9-4394-9119-dda8c0cbf829 None admin] RBAC: Adding query filter params (name=member) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:30.978766 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc067a-09e9-4394-9119-dda8c0cbf829 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:30.979866 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abc067a-09e9-4394-9119-dda8c0cbf829 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:30.993616 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 140/284] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jul 27 15:11:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:30.994535 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc067a-09e9-4394-9119-dda8c0cbf829 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:31.013997 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb206495-d3d8-4592-bddc-561d6ef9e0ec None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:31.052022 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c97e3-5d02-4a3f-a1cd-5981da5cbbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:31.052599 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c97e3-5d02-4a3f-a1cd-5981da5cbbf6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:31.052875 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c97e3-5d02-4a3f-a1cd-5981da5cbbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:31.053144 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c97e3-5d02-4a3f-a1cd-5981da5cbbf6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:31.064267 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c97e3-5d02-4a3f-a1cd-5981da5cbbf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:31.069247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-007c97e3-5d02-4a3f-a1cd-5981da5cbbf6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 15:11:31.069247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:31.069247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:31.069247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:31.069247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:31.069247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:31.069247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:31.069247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:31.069247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:31.069247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:31.069247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:31.069247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:31.069247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:31.069247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:31.069247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:31.069247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:31.071906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:31.071906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:31.071906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:31.071906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:31.071906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:31.071906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:31.071906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:31.071906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:31.071906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:31.071906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:31.071906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:31.071906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:31.071906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:31.071906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:31.071906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:31.071906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:31.073943 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:31.073943 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:31.073943 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:31.073943 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:31.073943 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:31.073943 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:31.073943 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:31.073943 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:31.073943 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:31.073943 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:31.073943 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 15:11:31.073943 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:11:31.084016 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 145/285] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:11:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:31.084016 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c97e3-5d02-4a3f-a1cd-5981da5cbbf6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:31.129528 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abc067a-09e9-4394-9119-dda8c0cbf829 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:31.169280 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b014c81-d4b1-41d1-a459-47bb24dc3279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:31.169925 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b014c81-d4b1-41d1-a459-47bb24dc3279 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:31.170200 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b014c81-d4b1-41d1-a459-47bb24dc3279 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:31.170468 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b014c81-d4b1-41d1-a459-47bb24dc3279 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:31.194870 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:31.203076 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c97e3-5d02-4a3f-a1cd-5981da5cbbf6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:31.239017 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:31.246329 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b014c81-d4b1-41d1-a459-47bb24dc3279 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:31.248160 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b014c81-d4b1-41d1-a459-47bb24dc3279 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:31.249121 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f97fe7-b1a9-415c-a48b-205c7b8466ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:31.249866 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f97fe7-b1a9-415c-a48b-205c7b8466ec None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:31.250373 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f97fe7-b1a9-415c-a48b-205c7b8466ec None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:31.250654 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f97fe7-b1a9-415c-a48b-205c7b8466ec None admin] PATH_INFO: `/v3/users/f165aa3409d648579f1cc1e5559f5ab9` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:31.269085 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f97fe7-b1a9-415c-a48b-205c7b8466ec None admin] RBAC: Authorizing `identity:get_user(user_id=f165aa3409d648579f1cc1e5559f5ab9)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:31.270563 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f97fe7-b1a9-415c-a48b-205c7b8466ec None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:31.273194 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 146/286] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:11:31 2022] GET /identity/v3/users/f165aa3409d648579f1cc1e5559f5ab9 => generated 293 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:31.274472 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f97fe7-b1a9-415c-a48b-205c7b8466ec None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:31.357973 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 141/287] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:11:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 15:11:31.358703 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b014c81-d4b1-41d1-a459-47bb24dc3279 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:31.408744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f97fe7-b1a9-415c-a48b-205c7b8466ec None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:31.434339 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:31.449181 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7028c6-4851-4866-b52b-45f999af2388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:31.449984 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7028c6-4851-4866-b52b-45f999af2388 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:31.450327 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7028c6-4851-4866-b52b-45f999af2388 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:31.450661 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7028c6-4851-4866-b52b-45f999af2388 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:31.451438 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7028c6-4851-4866-b52b-45f999af2388 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:31.451802 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7028c6-4851-4866-b52b-45f999af2388 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:31.453444 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7028c6-4851-4866-b52b-45f999af2388 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:31.466940 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 147/288] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jul 27 15:11:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:31.467970 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7028c6-4851-4866-b52b-45f999af2388 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:31.494215 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b014c81-d4b1-41d1-a459-47bb24dc3279 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:31.517406 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:31.539251 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbd6ea-d5aa-4eae-af19-5fdfc10e4818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:31.540545 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbd6ea-d5aa-4eae-af19-5fdfc10e4818 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:31.540988 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbd6ea-d5aa-4eae-af19-5fdfc10e4818 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:31.541407 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bbd6ea-d5aa-4eae-af19-5fdfc10e4818 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:31.542586 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bbd6ea-d5aa-4eae-af19-5fdfc10e4818 None admin] RBAC: Adding query filter params (role.id=05b155ad77f0416a85b84ab318160c53, user.id=f165aa3409d648579f1cc1e5559f5ab9, scope.system=all) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:31.543222 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bbd6ea-d5aa-4eae-af19-5fdfc10e4818 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:31.545558 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bbd6ea-d5aa-4eae-af19-5fdfc10e4818 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:31.551684 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 142/289] 10.222.0.40 () {56 vars in 1308 bytes} [Wed Jul 27 15:11:31 2022] GET /identity/v3/role_assignments?user.id=f165aa3409d648579f1cc1e5559f5ab9&scope.system=all&role.id=05b155ad77f0416a85b84ab318160c53 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:31.552659 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbd6ea-d5aa-4eae-af19-5fdfc10e4818 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:31.609252 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7028c6-4851-4866-b52b-45f999af2388 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:31.660066 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27424628-890e-46ef-a5f9-f13d79e9da2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:31.661128 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27424628-890e-46ef-a5f9-f13d79e9da2c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:31.661249 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27424628-890e-46ef-a5f9-f13d79e9da2c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:31.661453 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27424628-890e-46ef-a5f9-f13d79e9da2c None admin] PATH_INFO: `/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:31.662789 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27424628-890e-46ef-a5f9-f13d79e9da2c None admin] RBAC: Authorizing `identity:get_project(project_id=cd46e34c8ff44b9abce25e0fd266ac70)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:31.665066 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27424628-890e-46ef-a5f9-f13d79e9da2c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:31.667294 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 148/290] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:31 2022] GET /identity/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:31.673208 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27424628-890e-46ef-a5f9-f13d79e9da2c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:31.676269 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bbd6ea-d5aa-4eae-af19-5fdfc10e4818 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:31.699457 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:31.741369 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c21f2-0d59-429d-9fc1-5372388b98db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:31.742595 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c21f2-0d59-429d-9fc1-5372388b98db None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:31.742877 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c21f2-0d59-429d-9fc1-5372388b98db None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:31.743151 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c21f2-0d59-429d-9fc1-5372388b98db None admin] PATH_INFO: `/v3/users/10993ef618c64eb09a79ded94b6259e0` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:31.746220 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c21f2-0d59-429d-9fc1-5372388b98db None admin] RBAC: Authorizing `identity:get_user(user_id=10993ef618c64eb09a79ded94b6259e0)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:31.747713 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c21f2-0d59-429d-9fc1-5372388b98db None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:31.749461 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 143/291] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:11:31 2022] GET /identity/v3/users/10993ef618c64eb09a79ded94b6259e0 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:31.755444 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c21f2-0d59-429d-9fc1-5372388b98db None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:31.823320 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27424628-890e-46ef-a5f9-f13d79e9da2c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:31.844772 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:31.893328 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805df32-9397-4b2e-9446-74f4f7337114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:31.894200 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805df32-9397-4b2e-9446-74f4f7337114 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:31.894494 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805df32-9397-4b2e-9446-74f4f7337114 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:31.894778 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805df32-9397-4b2e-9446-74f4f7337114 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:31.895593 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805df32-9397-4b2e-9446-74f4f7337114 None admin] RBAC: Adding query filter params (role.id=05b155ad77f0416a85b84ab318160c53, scope.project.id=cd46e34c8ff44b9abce25e0fd266ac70, user.id=3c24360a72d940549a1437ef97d5d10b) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:31.895914 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805df32-9397-4b2e-9446-74f4f7337114 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:31.898653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805df32-9397-4b2e-9446-74f4f7337114 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:31.904130 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 149/292] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:11:31 2022] GET /identity/v3/role_assignments?user.id=3c24360a72d940549a1437ef97d5d10b&scope.project.id=cd46e34c8ff44b9abce25e0fd266ac70&role.id=05b155ad77f0416a85b84ab318160c53 => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:31.921121 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c21f2-0d59-429d-9fc1-5372388b98db None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:31.978518 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f1223-5aa7-45fb-be95-2d8a16d8bff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:31.980069 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f1223-5aa7-45fb-be95-2d8a16d8bff1 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:31.980602 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f1223-5aa7-45fb-be95-2d8a16d8bff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:31.981076 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f1223-5aa7-45fb-be95-2d8a16d8bff1 None admin] PATH_INFO: `/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:31.983509 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f1223-5aa7-45fb-be95-2d8a16d8bff1 None admin] RBAC: Authorizing `identity:get_project(project_id=cd46e34c8ff44b9abce25e0fd266ac70)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:31.985282 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f1223-5aa7-45fb-be95-2d8a16d8bff1 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:31.987284 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 144/293] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:31 2022] GET /identity/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:31.993454 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805df32-9397-4b2e-9446-74f4f7337114 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:32.118715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805df32-9397-4b2e-9446-74f4f7337114 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:32.154068 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e785157-5eed-4b12-b4c1-509554a37033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:32.154672 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e785157-5eed-4b12-b4c1-509554a37033 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:32.154959 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e785157-5eed-4b12-b4c1-509554a37033 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:32.155238 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e785157-5eed-4b12-b4c1-509554a37033 None admin] PATH_INFO: `/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70/users/10993ef618c64eb09a79ded94b6259e0/roles/b5c62080008c4f3baa59ef8985befc47` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:32.157271 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e785157-5eed-4b12-b4c1-509554a37033 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd46e34c8ff44b9abce25e0fd266ac70, user_id=10993ef618c64eb09a79ded94b6259e0, role_id=b5c62080008c4f3baa59ef8985befc47)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:32.158689 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e785157-5eed-4b12-b4c1-509554a37033 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:32.175411 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 150/294] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jul 27 15:11:31 2022] PUT /identity/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70/users/10993ef618c64eb09a79ded94b6259e0/roles/b5c62080008c4f3baa59ef8985befc47 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:11:32.803939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a09fc-351b-411c-bfc5-bec6fdbfad9c None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:32.804702 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a09fc-351b-411c-bfc5-bec6fdbfad9c None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:32.805193 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418a09fc-351b-411c-bfc5-bec6fdbfad9c None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:32.807034 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 145/295] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:32.810717 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ec979-0e8a-4013-9496-27a4158f46b0 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:32.811014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ec979-0e8a-4013-9496-27a4158f46b0 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:32.811297 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ec979-0e8a-4013-9496-27a4158f46b0 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:32.812859 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 151/296] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:32.813912 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32c316-d6ee-4187-a0d2-23600f087dc4 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:32.814204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32c316-d6ee-4187-a0d2-23600f087dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:32.814479 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32c316-d6ee-4187-a0d2-23600f087dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:32.821139 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d333656-248c-4da7-a6c0-f12a42d025f1 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:32.821538 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d333656-248c-4da7-a6c0-f12a42d025f1 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:32.821938 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d333656-248c-4da7-a6c0-f12a42d025f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:32.840286 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-8f32c316-d6ee-4187-a0d2-23600f087dc4 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:32.841070 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4d333656-248c-4da7-a6c0-f12a42d025f1 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:32.841860 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8f32c316-d6ee-4187-a0d2-23600f087dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:32.842442 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4d333656-248c-4da7-a6c0-f12a42d025f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:32.875422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:32.918003 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:32.921176 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 152/297] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 15:11:32.937957 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 146/298] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:32.948982 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d333656-248c-4da7-a6c0-f12a42d025f1 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:32.967525 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32c316-d6ee-4187-a0d2-23600f087dc4 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:33.061020 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d333656-248c-4da7-a6c0-f12a42d025f1 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:33.081358 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32c316-d6ee-4187-a0d2-23600f087dc4 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:33.102048 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ad7f2-0876-47ff-932b-2a9bc9266ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:33.102713 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ad7f2-0876-47ff-932b-2a9bc9266ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:33.102999 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ad7f2-0876-47ff-932b-2a9bc9266ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:33.103391 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4ad7f2-0876-47ff-932b-2a9bc9266ed2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:33.104647 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ad7f2-0876-47ff-932b-2a9bc9266ed2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:33.106225 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4ad7f2-0876-47ff-932b-2a9bc9266ed2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:33.112418 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 153/299] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:11:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:33.113608 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ad7f2-0876-47ff-932b-2a9bc9266ed2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:33.129060 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e0037-d517-484d-a50d-9ee71a68da99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:33.129705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e0037-d517-484d-a50d-9ee71a68da99 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:33.129991 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e0037-d517-484d-a50d-9ee71a68da99 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:33.130268 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8e0037-d517-484d-a50d-9ee71a68da99 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:33.149312 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8e0037-d517-484d-a50d-9ee71a68da99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:33.156864 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-ad8e0037-d517-484d-a50d-9ee71a68da99 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 15:11:33.156864 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:33.156864 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:33.156864 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:33.156864 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:33.156864 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:33.156864 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:33.156864 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:33.156864 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:33.156864 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:33.156864 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:33.156864 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:33.156864 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:33.156864 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:33.156864 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:33.156864 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:33.157761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:33.157761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:33.157761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:33.157761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:33.157761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:33.157761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:33.157761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:33.157761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:33.157761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:33.157761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:33.157761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:33.157761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:33.157761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:33.157761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:33.157761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:33.157761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:33.158562 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:33.158562 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:33.158562 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:33.158562 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:33.158562 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:33.158562 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:33.158562 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:33.158562 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:33.158562 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:33.158562 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:33.158562 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 15:11:33.158562 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:11:33.160070 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 147/300] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:11:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:11:33.164385 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e0037-d517-484d-a50d-9ee71a68da99 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:33.167515 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:33.230198 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:33.240123 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4ad7f2-0876-47ff-932b-2a9bc9266ed2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:33.280689 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583f83c-ed26-4911-be24-7670f2194c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:33.281649 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583f83c-ed26-4911-be24-7670f2194c36 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:33.282133 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583f83c-ed26-4911-be24-7670f2194c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:33.282628 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6583f83c-ed26-4911-be24-7670f2194c36 None admin] PATH_INFO: `/v3/groups` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:33.283509 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6583f83c-ed26-4911-be24-7670f2194c36 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:33.285205 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6583f83c-ed26-4911-be24-7670f2194c36 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:33.302058 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8e0037-d517-484d-a50d-9ee71a68da99 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:33.305944 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 154/301] 10.222.0.40 () {60 vars in 1134 bytes} [Wed Jul 27 15:11:33 2022] POST /identity/v3/groups => generated 229 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:11:33.350162 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5214a2-af8a-4b4d-afbf-d3507707bfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:33.350817 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5214a2-af8a-4b4d-afbf-d3507707bfef None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:33.351101 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5214a2-af8a-4b4d-afbf-d3507707bfef None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:33.351448 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5214a2-af8a-4b4d-afbf-d3507707bfef None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:33.352375 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5214a2-af8a-4b4d-afbf-d3507707bfef None admin] RBAC: Adding query filter params (name=reader) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:33.352631 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5214a2-af8a-4b4d-afbf-d3507707bfef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:33.354162 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5214a2-af8a-4b4d-afbf-d3507707bfef None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:33.364431 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 148/302] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jul 27 15:11:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:11:33.370582 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583f83c-ed26-4911-be24-7670f2194c36 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:33.478060 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:33.483956 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6583f83c-ed26-4911-be24-7670f2194c36 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:33.522619 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb505d-db60-4cd8-b93a-c317adb6100c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:33.523807 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb505d-db60-4cd8-b93a-c317adb6100c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:33.524126 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb505d-db60-4cd8-b93a-c317adb6100c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:33.524398 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb505d-db60-4cd8-b93a-c317adb6100c None admin] PATH_INFO: `/v3/users/cbcc3d438bc348fdab6fd71f943ba956` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:33.537905 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb505d-db60-4cd8-b93a-c317adb6100c None admin] RBAC: Authorizing `identity:get_user(user_id=cbcc3d438bc348fdab6fd71f943ba956)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:33.539641 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb505d-db60-4cd8-b93a-c317adb6100c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:33.541614 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 155/303] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:11:33 2022] GET /identity/v3/users/cbcc3d438bc348fdab6fd71f943ba956 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:33.547175 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5214a2-af8a-4b4d-afbf-d3507707bfef None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:33.656293 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5214a2-af8a-4b4d-afbf-d3507707bfef None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:33.664591 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:33.693319 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c65eba-6b08-4b0c-b3cc-a18cd8a9bc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:33.694280 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c65eba-6b08-4b0c-b3cc-a18cd8a9bc27 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:33.694786 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c65eba-6b08-4b0c-b3cc-a18cd8a9bc27 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:33.695281 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c65eba-6b08-4b0c-b3cc-a18cd8a9bc27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:33.696289 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c65eba-6b08-4b0c-b3cc-a18cd8a9bc27 None admin] RBAC: Adding query filter params (role.id=b5c62080008c4f3baa59ef8985befc47, user.id=cbcc3d438bc348fdab6fd71f943ba956, scope.system=all) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:33.696836 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c65eba-6b08-4b0c-b3cc-a18cd8a9bc27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:33.698453 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c65eba-6b08-4b0c-b3cc-a18cd8a9bc27 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:33.704179 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 149/304] 10.222.0.40 () {56 vars in 1308 bytes} [Wed Jul 27 15:11:33 2022] GET /identity/v3/role_assignments?user.id=cbcc3d438bc348fdab6fd71f943ba956&scope.system=all&role.id=b5c62080008c4f3baa59ef8985befc47 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:33.825135 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf3ef4-f472-4e7c-87eb-b1a3070cc138 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:33.825504 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf3ef4-f472-4e7c-87eb-b1a3070cc138 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:33.825712 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf3ef4-f472-4e7c-87eb-b1a3070cc138 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:33.827296 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 156/305] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:33.833341 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3401f-5a9f-4395-9b38-9e29715e9358 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:33.833854 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3401f-5a9f-4395-9b38-9e29715e9358 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:33.834277 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d3401f-5a9f-4395-9b38-9e29715e9358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:33.855621 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-61d3401f-5a9f-4395-9b38-9e29715e9358 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:33.857126 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-61d3401f-5a9f-4395-9b38-9e29715e9358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:33.927483 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 150/306] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 15:11:33.950211 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf3ef4-f472-4e7c-87eb-b1a3070cc138 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:34.059303 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf3ef4-f472-4e7c-87eb-b1a3070cc138 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:34.095914 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd570f83-9cd2-4098-8650-d25b3e3013d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:34.096635 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd570f83-9cd2-4098-8650-d25b3e3013d0 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:34.096871 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd570f83-9cd2-4098-8650-d25b3e3013d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:34.097149 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd570f83-9cd2-4098-8650-d25b3e3013d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:34.108088 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd570f83-9cd2-4098-8650-d25b3e3013d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:34.113196 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-fd570f83-9cd2-4098-8650-d25b3e3013d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 15:11:34.113196 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:34.113196 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:34.113196 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:34.113196 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:34.113196 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:34.113196 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:34.113196 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:34.113196 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:34.113196 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:34.113196 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:34.113196 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:34.113196 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:34.113196 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:34.113196 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:34.113196 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:34.114045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:34.114045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:34.114045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:34.114045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:34.114045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:34.114045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:34.114045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:34.114045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:34.114045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:34.114045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:34.114045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:34.114045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:34.114045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:34.114045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:34.114045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:34.114045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:34.114829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:34.114829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:34.114829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:34.114829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:34.114829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:34.114829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:34.114829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:34.114829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:34.114829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:34.114829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:34.114829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 15:11:34.114829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:11:34.114829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 157/307] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:11:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:34.122013 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3401f-5a9f-4395-9b38-9e29715e9358 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:34.225909 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:34.228952 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d3401f-5a9f-4395-9b38-9e29715e9358 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:34.265514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e1b581-8ef4-45b8-a304-15efa769643c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:34.266125 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1b581-8ef4-45b8-a304-15efa769643c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:34.266399 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1b581-8ef4-45b8-a304-15efa769643c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:34.266665 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e1b581-8ef4-45b8-a304-15efa769643c None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:34.267377 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1b581-8ef4-45b8-a304-15efa769643c None admin] RBAC: Adding query filter params (name=member) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:34.267678 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1b581-8ef4-45b8-a304-15efa769643c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:34.269062 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e1b581-8ef4-45b8-a304-15efa769643c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:34.279065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 151/308] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jul 27 15:11:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:34.284644 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd570f83-9cd2-4098-8650-d25b3e3013d0 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:34.301914 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:34.317536 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b7f53-99d5-46fe-84f0-8cfbd8a934b4 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:34.317816 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b7f53-99d5-46fe-84f0-8cfbd8a934b4 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:34.318245 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b7f53-99d5-46fe-84f0-8cfbd8a934b4 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:34.319706 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 152/309] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:11:34.325157 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd69ff3-0eec-4272-aee2-52fc5d80668f None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:34.325613 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd69ff3-0eec-4272-aee2-52fc5d80668f None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:34.326028 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd69ff3-0eec-4272-aee2-52fc5d80668f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:34.344029 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-8bd69ff3-0eec-4272-aee2-52fc5d80668f None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:34.345390 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8bd69ff3-0eec-4272-aee2-52fc5d80668f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:34.398428 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd570f83-9cd2-4098-8650-d25b3e3013d0 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:34.436159 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 153/310] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:34.439967 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06be22-adb3-4f32-90fd-32de5804d8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:34.440630 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06be22-adb3-4f32-90fd-32de5804d8b8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:34.440972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06be22-adb3-4f32-90fd-32de5804d8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:34.441255 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a06be22-adb3-4f32-90fd-32de5804d8b8 None admin] PATH_INFO: `/v3/users/f165aa3409d648579f1cc1e5559f5ab9` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:34.442459 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06be22-adb3-4f32-90fd-32de5804d8b8 None admin] RBAC: Authorizing `identity:get_user(user_id=f165aa3409d648579f1cc1e5559f5ab9)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:34.443891 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a06be22-adb3-4f32-90fd-32de5804d8b8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:34.446542 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 158/311] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:11:34 2022] GET /identity/v3/users/f165aa3409d648579f1cc1e5559f5ab9 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:34.451639 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd69ff3-0eec-4272-aee2-52fc5d80668f None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:34.456925 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06be22-adb3-4f32-90fd-32de5804d8b8 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:34.546830 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:34.551790 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:34.562143 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd69ff3-0eec-4272-aee2-52fc5d80668f None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:34.569077 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a06be22-adb3-4f32-90fd-32de5804d8b8 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:34.605622 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cfc602-b008-4fac-a9ba-0d1af45520cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:34.606573 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfc602-b008-4fac-a9ba-0d1af45520cd None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:34.607045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfc602-b008-4fac-a9ba-0d1af45520cd None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:34.607183 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9634e-0b05-4643-8e60-78b51b3e2270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:34.607607 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfc602-b008-4fac-a9ba-0d1af45520cd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:34.608043 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9634e-0b05-4643-8e60-78b51b3e2270 None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:34.608665 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9634e-0b05-4643-8e60-78b51b3e2270 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:34.609086 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9634e-0b05-4643-8e60-78b51b3e2270 None admin] PATH_INFO: `/v3/system/users/f165aa3409d648579f1cc1e5559f5ab9/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:34.610688 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf9634e-0b05-4643-8e60-78b51b3e2270 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f165aa3409d648579f1cc1e5559f5ab9, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:34.612217 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf9634e-0b05-4643-8e60-78b51b3e2270 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:34.619919 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cfc602-b008-4fac-a9ba-0d1af45520cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:34.628159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-87cfc602-b008-4fac-a9ba-0d1af45520cd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 15:11:34.628159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:34.628159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:34.628159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:34.628159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:34.628159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:34.628159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:34.628159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:34.628159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:34.628159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:34.628159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:34.628159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:34.628159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:34.628159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:34.628159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:34.628159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:34.629334 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:34.629334 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:34.629334 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:34.629334 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:34.629334 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:34.629334 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:34.629334 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:34.629334 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:34.629334 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:34.629334 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:34.629334 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:34.629334 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:34.629334 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:34.629334 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:34.629334 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:34.629334 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:34.630403 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:34.630403 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:34.630403 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:34.630403 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:34.630403 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:34.630403 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:34.630403 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:34.630403 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:34.630403 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:34.630403 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:34.630403 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 15:11:34.630403 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:11:34.631451 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 154/313] 10.222.0.40 () {58 vars in 1334 bytes} [Wed Jul 27 15:11:34 2022] PUT /identity/v3/system/users/f165aa3409d648579f1cc1e5559f5ab9/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:11:34.636045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 159/313] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:11:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:34.637444 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9634e-0b05-4643-8e60-78b51b3e2270 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:34.763512 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9634e-0b05-4643-8e60-78b51b3e2270 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:34.800045 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd63ece-14bf-4a12-8102-50b9f1fbb5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:34.800590 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd63ece-14bf-4a12-8102-50b9f1fbb5f1 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:34.800871 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd63ece-14bf-4a12-8102-50b9f1fbb5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:34.801144 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd63ece-14bf-4a12-8102-50b9f1fbb5f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:34.801856 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd63ece-14bf-4a12-8102-50b9f1fbb5f1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:34.802159 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd63ece-14bf-4a12-8102-50b9f1fbb5f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:34.803515 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd63ece-14bf-4a12-8102-50b9f1fbb5f1 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:34.812927 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 155/314] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jul 27 15:11:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:34.818547 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cfc602-b008-4fac-a9ba-0d1af45520cd None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:34.928277 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cfc602-b008-4fac-a9ba-0d1af45520cd None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:34.963375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa6289-15b4-4ed3-b891-3e2ca2975228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:34.964038 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa6289-15b4-4ed3-b891-3e2ca2975228 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:34.964455 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa6289-15b4-4ed3-b891-3e2ca2975228 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:34.964734 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fa6289-15b4-4ed3-b891-3e2ca2975228 None admin] PATH_INFO: `/v3/users/10993ef618c64eb09a79ded94b6259e0` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:34.965916 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa6289-15b4-4ed3-b891-3e2ca2975228 None admin] RBAC: Authorizing `identity:get_user(user_id=10993ef618c64eb09a79ded94b6259e0)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:34.967365 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fa6289-15b4-4ed3-b891-3e2ca2975228 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:34.969305 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 160/315] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:11:34 2022] GET /identity/v3/users/10993ef618c64eb09a79ded94b6259e0 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:11:34.974816 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd63ece-14bf-4a12-8102-50b9f1fbb5f1 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:34.996584 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:35.087642 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd63ece-14bf-4a12-8102-50b9f1fbb5f1 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:35.122849 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397e483-134b-4496-b8f3-2a530e4f1cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:35.124249 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397e483-134b-4496-b8f3-2a530e4f1cdd None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:35.124728 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397e483-134b-4496-b8f3-2a530e4f1cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:35.125213 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397e483-134b-4496-b8f3-2a530e4f1cdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:35.197561 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8397e483-134b-4496-b8f3-2a530e4f1cdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:35.199369 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8397e483-134b-4496-b8f3-2a530e4f1cdd None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:35.217927 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:35.310216 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 156/316] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:11:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 15:11:35.316051 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa6289-15b4-4ed3-b891-3e2ca2975228 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:35.330428 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:35.425997 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fa6289-15b4-4ed3-b891-3e2ca2975228 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:35.462346 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ca122-2de7-437d-9c00-a9a63c7b953c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:35.462924 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4435b4c-2fb5-45fe-9c04-b41f016b964b None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:35.463034 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ca122-2de7-437d-9c00-a9a63c7b953c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:35.463218 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4435b4c-2fb5-45fe-9c04-b41f016b964b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:35.463338 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ca122-2de7-437d-9c00-a9a63c7b953c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:35.463503 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4435b4c-2fb5-45fe-9c04-b41f016b964b None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:35.463597 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66ca122-2de7-437d-9c00-a9a63c7b953c None admin] PATH_INFO: `/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:35.464718 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ca122-2de7-437d-9c00-a9a63c7b953c None admin] RBAC: Authorizing `identity:get_project(project_id=cd46e34c8ff44b9abce25e0fd266ac70)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:35.465145 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 157/317] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:11:35.466219 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66ca122-2de7-437d-9c00-a9a63c7b953c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:35.468159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 161/318] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:35 2022] GET /identity/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:35.469935 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13dc1e-b67e-4d24-a93d-a89409f62b67 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:35.470224 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13dc1e-b67e-4d24-a93d-a89409f62b67 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:35.470501 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13dc1e-b67e-4d24-a93d-a89409f62b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:35.474279 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ca122-2de7-437d-9c00-a9a63c7b953c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:35.490615 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-5d13dc1e-b67e-4d24-a93d-a89409f62b67 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:35.492884 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5d13dc1e-b67e-4d24-a93d-a89409f62b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:35.560794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 158/319] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 15:11:35.561155 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:35.583821 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13dc1e-b67e-4d24-a93d-a89409f62b67 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:35.600477 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66ca122-2de7-437d-9c00-a9a63c7b953c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:35.639791 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:35.642728 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5858a-62d1-4722-b06b-44fd43c972c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:35.643553 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5858a-62d1-4722-b06b-44fd43c972c1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:35.644231 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5858a-62d1-4722-b06b-44fd43c972c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:35.644776 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c5858a-62d1-4722-b06b-44fd43c972c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:35.646355 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5858a-62d1-4722-b06b-44fd43c972c1 None admin] RBAC: Adding query filter params (role.id=b5c62080008c4f3baa59ef8985befc47, scope.project.id=cd46e34c8ff44b9abce25e0fd266ac70, user.id=10993ef618c64eb09a79ded94b6259e0) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:35.646819 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5858a-62d1-4722-b06b-44fd43c972c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:35.648929 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c5858a-62d1-4722-b06b-44fd43c972c1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:35.656322 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 162/320] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:11:35 2022] GET /identity/v3/role_assignments?user.id=10993ef618c64eb09a79ded94b6259e0&scope.project.id=cd46e34c8ff44b9abce25e0fd266ac70&role.id=b5c62080008c4f3baa59ef8985befc47 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:11:35.703980 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13dc1e-b67e-4d24-a93d-a89409f62b67 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:35.744136 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d41085-60c7-437c-96c4-5f932acf8198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:35.745051 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d41085-60c7-437c-96c4-5f932acf8198 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:35.745478 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d41085-60c7-437c-96c4-5f932acf8198 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:35.746002 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d41085-60c7-437c-96c4-5f932acf8198 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:35.747383 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d41085-60c7-437c-96c4-5f932acf8198 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:35.749026 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d41085-60c7-437c-96c4-5f932acf8198 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:35.751569 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 159/321] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:11:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:11:35.757592 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5858a-62d1-4722-b06b-44fd43c972c1 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:35.836729 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24486981-b3af-496c-a7c8-2d73369aa855 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:35.837019 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24486981-b3af-496c-a7c8-2d73369aa855 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:35.837304 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24486981-b3af-496c-a7c8-2d73369aa855 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:35.838782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 160/322] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:11:35.843664 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccc4de-232b-41b1-83b2-63b8e7ebdb3e None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:35.844253 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccc4de-232b-41b1-83b2-63b8e7ebdb3e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:35.844764 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ccc4de-232b-41b1-83b2-63b8e7ebdb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:35.870549 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-17ccc4de-232b-41b1-83b2-63b8e7ebdb3e None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:35.870549 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-17ccc4de-232b-41b1-83b2-63b8e7ebdb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:35.885176 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c5858a-62d1-4722-b06b-44fd43c972c1 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:35.933906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d5948-bad1-4869-be56-6b653e98f1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:35.934536 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d5948-bad1-4869-be56-6b653e98f1f1 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:35.935142 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d5948-bad1-4869-be56-6b653e98f1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:35.935425 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181d5948-bad1-4869-be56-6b653e98f1f1 None admin] PATH_INFO: `/v3/groups` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:35.936296 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d5948-bad1-4869-be56-6b653e98f1f1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:35.937759 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181d5948-bad1-4869-be56-6b653e98f1f1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:35.962255 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 163/323] 10.222.0.40 () {60 vars in 1134 bytes} [Wed Jul 27 15:11:35 2022] POST /identity/v3/groups => generated 226 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:11:35.963174 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 161/324] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 15:11:35.985757 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d5948-bad1-4869-be56-6b653e98f1f1 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:35.988988 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:36.096913 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181d5948-bad1-4869-be56-6b653e98f1f1 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:36.134670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1edd91-b839-4a85-80c3-1b1edfd2cb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:36.135312 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1edd91-b839-4a85-80c3-1b1edfd2cb16 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:36.135605 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1edd91-b839-4a85-80c3-1b1edfd2cb16 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:36.135877 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1edd91-b839-4a85-80c3-1b1edfd2cb16 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:36.146405 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1edd91-b839-4a85-80c3-1b1edfd2cb16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:36.152377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-1e1edd91-b839-4a85-80c3-1b1edfd2cb16 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 15:11:36.152377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:36.152377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:36.152377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:36.152377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:36.152377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:36.152377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:36.152377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:36.152377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:36.152377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:36.152377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:36.152377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:36.152377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:36.152377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:36.152377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:36.152377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:36.153249 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:36.153249 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:36.153249 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:36.153249 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:36.153249 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:36.153249 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:36.153249 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:36.153249 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:36.153249 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:36.153249 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:36.153249 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:36.153249 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:36.153249 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:36.153249 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:36.153249 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:36.153249 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:36.154434 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:36.154434 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:36.154434 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:36.154434 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:36.154434 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:36.154434 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:36.154434 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:36.154434 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:36.154434 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:36.154434 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:36.154434 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 15:11:36.154434 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:11:36.154434 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 164/325] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:11:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:36.159399 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ccc4de-232b-41b1-83b2-63b8e7ebdb3e None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:36.217034 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:36.279144 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ccc4de-232b-41b1-83b2-63b8e7ebdb3e None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:36.315744 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62dab0-9128-474d-9015-1f492a5f866d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:36.316445 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62dab0-9128-474d-9015-1f492a5f866d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:36.316771 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62dab0-9128-474d-9015-1f492a5f866d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:36.317011 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe62dab0-9128-474d-9015-1f492a5f866d None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:36.317748 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62dab0-9128-474d-9015-1f492a5f866d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:36.318057 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62dab0-9128-474d-9015-1f492a5f866d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:36.319434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe62dab0-9128-474d-9015-1f492a5f866d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:36.329280 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 162/326] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jul 27 15:11:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:36.334924 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1edd91-b839-4a85-80c3-1b1edfd2cb16 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:36.407298 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:36.450674 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1edd91-b839-4a85-80c3-1b1edfd2cb16 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:36.489072 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa58cf65-9685-4f46-a81f-4b427552da4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:36.489635 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58cf65-9685-4f46-a81f-4b427552da4a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:36.489918 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58cf65-9685-4f46-a81f-4b427552da4a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:36.490196 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa58cf65-9685-4f46-a81f-4b427552da4a None admin] PATH_INFO: `/v3/users/cbcc3d438bc348fdab6fd71f943ba956` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:36.491383 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58cf65-9685-4f46-a81f-4b427552da4a None admin] RBAC: Authorizing `identity:get_user(user_id=cbcc3d438bc348fdab6fd71f943ba956)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:36.492978 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa58cf65-9685-4f46-a81f-4b427552da4a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:36.495015 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 165/327] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:11:36 2022] GET /identity/v3/users/cbcc3d438bc348fdab6fd71f943ba956 => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:36.500650 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62dab0-9128-474d-9015-1f492a5f866d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:36.614602 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe62dab0-9128-474d-9015-1f492a5f866d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:36.628839 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:36.658005 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230ac24e-b7fe-447c-b28f-3fce6351c4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:36.658728 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ac24e-b7fe-447c-b28f-3fce6351c4ec None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:36.659011 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ac24e-b7fe-447c-b28f-3fce6351c4ec None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:36.659291 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230ac24e-b7fe-447c-b28f-3fce6351c4ec None admin] PATH_INFO: `/v3/system/users/cbcc3d438bc348fdab6fd71f943ba956/roles/b5c62080008c4f3baa59ef8985befc47` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:36.662858 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ac24e-b7fe-447c-b28f-3fce6351c4ec None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=cbcc3d438bc348fdab6fd71f943ba956, role_id=b5c62080008c4f3baa59ef8985befc47)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:36.664597 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230ac24e-b7fe-447c-b28f-3fce6351c4ec None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:36.676914 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 163/328] 10.222.0.40 () {58 vars in 1334 bytes} [Wed Jul 27 15:11:36 2022] PUT /identity/v3/system/users/cbcc3d438bc348fdab6fd71f943ba956/roles/b5c62080008c4f3baa59ef8985befc47 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:11:36.746944 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88f787-b04c-4ef4-9454-6a2f85668698 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:36.747572 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88f787-b04c-4ef4-9454-6a2f85668698 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:36.748158 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88f787-b04c-4ef4-9454-6a2f85668698 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:36.749793 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 166/329] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:36.756626 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1f5a2-928b-48cc-8da0-9114b4c9f8c6 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:36.757240 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1f5a2-928b-48cc-8da0-9114b4c9f8c6 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:36.758317 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1f5a2-928b-48cc-8da0-9114b4c9f8c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:36.778304 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-e0b1f5a2-928b-48cc-8da0-9114b4c9f8c6 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:36.779909 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e0b1f5a2-928b-48cc-8da0-9114b4c9f8c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:36.863211 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 164/330] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:36.886879 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88f787-b04c-4ef4-9454-6a2f85668698 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:36.994460 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88f787-b04c-4ef4-9454-6a2f85668698 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:37.026726 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:37.034864 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e16c6-6437-4ce1-aa3b-8ea9abbabafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:37.035519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e16c6-6437-4ce1-aa3b-8ea9abbabafa None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:37.035859 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e16c6-6437-4ce1-aa3b-8ea9abbabafa None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:37.036174 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e16c6-6437-4ce1-aa3b-8ea9abbabafa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:37.048270 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e16c6-6437-4ce1-aa3b-8ea9abbabafa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:37.053812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-824e16c6-6437-4ce1-aa3b-8ea9abbabafa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 15:11:37.053812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:37.053812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:37.053812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:37.053812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:37.053812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:37.053812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:37.053812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:37.053812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:37.053812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:37.053812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:37.053812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:37.053812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:37.053812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:37.053812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:37.053812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:37.055270 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:37.055270 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:37.055270 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:37.055270 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:37.055270 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:37.055270 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:37.055270 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:37.055270 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:37.055270 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:37.055270 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:37.055270 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:37.055270 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:37.055270 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:37.055270 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:37.055270 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:37.055270 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:37.057045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:37.057045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:37.057045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:37.057045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:37.057045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:37.057045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:37.057045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:37.057045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:37.057045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:37.057045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:37.057045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 15:11:37.057045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:11:37.057045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 167/331] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:11:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:37.061608 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1f5a2-928b-48cc-8da0-9114b4c9f8c6 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:37.168376 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1f5a2-928b-48cc-8da0-9114b4c9f8c6 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:37.169929 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:37.205751 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f541e-3974-40c7-b5cc-63d9c4548866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:37.206382 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f541e-3974-40c7-b5cc-63d9c4548866 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:37.206665 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f541e-3974-40c7-b5cc-63d9c4548866 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:37.206942 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f541e-3974-40c7-b5cc-63d9c4548866 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:37.207664 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f541e-3974-40c7-b5cc-63d9c4548866 None admin] RBAC: Adding query filter params (name=member) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:37.207970 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f541e-3974-40c7-b5cc-63d9c4548866 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:37.209381 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f541e-3974-40c7-b5cc-63d9c4548866 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:37.218390 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 165/332] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jul 27 15:11:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:37.223690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e16c6-6437-4ce1-aa3b-8ea9abbabafa None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:37.331794 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e16c6-6437-4ce1-aa3b-8ea9abbabafa None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:37.367128 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d57e8fe-eb12-4758-9b8f-0136168f804e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:37.367861 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57e8fe-eb12-4758-9b8f-0136168f804e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:37.368072 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57e8fe-eb12-4758-9b8f-0136168f804e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:37.368356 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d57e8fe-eb12-4758-9b8f-0136168f804e None admin] PATH_INFO: `/v3/users/f165aa3409d648579f1cc1e5559f5ab9` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:37.369546 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57e8fe-eb12-4758-9b8f-0136168f804e None admin] RBAC: Authorizing `identity:get_user(user_id=f165aa3409d648579f1cc1e5559f5ab9)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:37.371048 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d57e8fe-eb12-4758-9b8f-0136168f804e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:37.372757 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 168/333] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:11:37 2022] GET /identity/v3/users/f165aa3409d648579f1cc1e5559f5ab9 => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:37.378452 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f541e-3974-40c7-b5cc-63d9c4548866 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:37.487127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f541e-3974-40c7-b5cc-63d9c4548866 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:37.524504 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8964aee1-ab38-4ca0-ad01-625752d10677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:37.525135 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964aee1-ab38-4ca0-ad01-625752d10677 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:37.525419 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964aee1-ab38-4ca0-ad01-625752d10677 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:37.525695 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964aee1-ab38-4ca0-ad01-625752d10677 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:37.526495 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964aee1-ab38-4ca0-ad01-625752d10677 None admin] RBAC: Adding query filter params (role.id=05b155ad77f0416a85b84ab318160c53, user.id=f165aa3409d648579f1cc1e5559f5ab9, scope.system=all) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:37.526817 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964aee1-ab38-4ca0-ad01-625752d10677 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:37.528324 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8964aee1-ab38-4ca0-ad01-625752d10677 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:37.542226 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 166/334] 10.222.0.40 () {56 vars in 1308 bytes} [Wed Jul 27 15:11:37 2022] GET /identity/v3/role_assignments?user.id=f165aa3409d648579f1cc1e5559f5ab9&scope.system=all&role.id=05b155ad77f0416a85b84ab318160c53 => generated 510 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:38.601663 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dc420-0dac-4982-a1eb-cceb332e8dc4 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:38.602290 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dc420-0dac-4982-a1eb-cceb332e8dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:38.602290 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dc420-0dac-4982-a1eb-cceb332e8dc4 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:38.603715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 169/335] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:38.609562 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a19331-b6e4-40cb-ab9e-4251c5eed5c0 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:38.610087 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a19331-b6e4-40cb-ab9e-4251c5eed5c0 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:38.610240 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a19331-b6e4-40cb-ab9e-4251c5eed5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:38.637054 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-a3a19331-b6e4-40cb-ab9e-4251c5eed5c0 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:38.638268 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a3a19331-b6e4-40cb-ab9e-4251c5eed5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:38.656942 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:38.726712 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 167/336] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:38.749474 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5dc420-0dac-4982-a1eb-cceb332e8dc4 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:38.825579 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:38.879937 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5dc420-0dac-4982-a1eb-cceb332e8dc4 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:38.923103 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbb6e8-f1b2-45da-bd84-22bb16599048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:38.923751 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbb6e8-f1b2-45da-bd84-22bb16599048 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:38.924061 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbb6e8-f1b2-45da-bd84-22bb16599048 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:38.924338 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dbb6e8-f1b2-45da-bd84-22bb16599048 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:38.941003 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dbb6e8-f1b2-45da-bd84-22bb16599048 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:38.947165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-20dbb6e8-f1b2-45da-bd84-22bb16599048 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 15:11:38.947165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:38.947165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:38.947165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:38.947165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:38.947165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:38.947165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:38.947165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:38.947165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:38.947165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:38.947165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:38.947165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:38.947165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:38.947165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:38.947165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:38.947165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:38.948069 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:38.948069 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:38.948069 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:38.948069 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:38.948069 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:38.948069 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:38.948069 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:38.948069 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:38.948069 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:38.948069 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:38.948069 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:38.948069 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:38.948069 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:38.948069 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:38.948069 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:38.948069 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:38.948877 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:38.948877 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:38.948877 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:38.948877 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:38.948877 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:38.948877 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:38.948877 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:38.948877 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:38.948877 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:38.948877 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:38.948877 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 15:11:38.948877 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:11:38.952438 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 170/337] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:11:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:38.958226 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a19331-b6e4-40cb-ab9e-4251c5eed5c0 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:39.081392 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a19331-b6e4-40cb-ab9e-4251c5eed5c0 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:39.133369 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c50d4b-a00d-4507-8b25-5f2bc845e7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:39.133926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c50d4b-a00d-4507-8b25-5f2bc845e7b6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:39.134212 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c50d4b-a00d-4507-8b25-5f2bc845e7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:39.134492 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c50d4b-a00d-4507-8b25-5f2bc845e7b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:39.135224 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c50d4b-a00d-4507-8b25-5f2bc845e7b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:39.135534 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c50d4b-a00d-4507-8b25-5f2bc845e7b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:39.136970 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c50d4b-a00d-4507-8b25-5f2bc845e7b6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:39.145999 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 168/338] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jul 27 15:11:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:39.151441 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbb6e8-f1b2-45da-bd84-22bb16599048 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:39.190405 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e4e95-4fef-423b-b81a-0ee48bae4607 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:39.190720 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e4e95-4fef-423b-b81a-0ee48bae4607 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:39.190963 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177e4e95-4fef-423b-b81a-0ee48bae4607 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:39.196582 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 169/339] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:39.201840 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290ff4b-6688-413b-90c5-7839e75ddb2a None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:39.202131 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290ff4b-6688-413b-90c5-7839e75ddb2a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:39.202406 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f290ff4b-6688-413b-90c5-7839e75ddb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:39.237002 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-f290ff4b-6688-413b-90c5-7839e75ddb2a None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:39.238455 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f290ff4b-6688-413b-90c5-7839e75ddb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:39.257799 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:39.314073 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dbb6e8-f1b2-45da-bd84-22bb16599048 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:39.341017 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:39.359166 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99cfd2-4ec1-4bf5-a6d7-d73cc869ec1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:39.359787 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99cfd2-4ec1-4bf5-a6d7-d73cc869ec1a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:39.360132 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99cfd2-4ec1-4bf5-a6d7-d73cc869ec1a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:39.360414 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea99cfd2-4ec1-4bf5-a6d7-d73cc869ec1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:39.437930 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea99cfd2-4ec1-4bf5-a6d7-d73cc869ec1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:39.439324 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea99cfd2-4ec1-4bf5-a6d7-d73cc869ec1a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:39.489345 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 170/340] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:39.490651 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cb96a-4b35-413b-80aa-2be927913cd0 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:39.490937 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cb96a-4b35-413b-80aa-2be927913cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:39.491208 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cb96a-4b35-413b-80aa-2be927913cd0 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:39.493043 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 171/341] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:39.511665 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5f6d3-9173-461f-b7db-9715c84ce33b None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:39.511943 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5f6d3-9173-461f-b7db-9715c84ce33b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:39.512400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5f6d3-9173-461f-b7db-9715c84ce33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:39.566841 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 171/342] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:11:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 15:11:39.567917 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99cfd2-4ec1-4bf5-a6d7-d73cc869ec1a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:39.572981 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-21f5f6d3-9173-461f-b7db-9715c84ce33b None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:39.574347 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-21f5f6d3-9173-461f-b7db-9715c84ce33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:39.612361 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:39.734600 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 172/343] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 15:11:39.735391 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5f6d3-9173-461f-b7db-9715c84ce33b None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:39.752262 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea99cfd2-4ec1-4bf5-a6d7-d73cc869ec1a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:39.802400 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd32a5-3104-4454-a5e5-4fa046e9ef4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:39.803056 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd32a5-3104-4454-a5e5-4fa046e9ef4f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:39.803337 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd32a5-3104-4454-a5e5-4fa046e9ef4f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:39.803605 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd32a5-3104-4454-a5e5-4fa046e9ef4f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:39.830096 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cd32a5-3104-4454-a5e5-4fa046e9ef4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:39.835302 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-99cd32a5-3104-4454-a5e5-4fa046e9ef4f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 15:11:39.835302 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:39.835302 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:39.835302 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:39.835302 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:39.835302 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:39.835302 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:39.835302 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:39.835302 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:39.835302 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:39.835302 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:39.835302 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:39.835302 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:39.835302 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:39.835302 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:39.835302 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:39.837100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:39.837100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:39.837100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:39.837100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:39.837100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:39.837100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:39.837100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:39.837100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:39.837100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:39.837100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:39.837100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:39.837100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:39.837100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:39.837100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:39.837100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:39.837100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:39.837986 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:39.837986 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:39.837986 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:39.837986 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:39.837986 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:39.837986 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:39.837986 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:39.837986 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:39.837986 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:39.837986 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:39.837986 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 15:11:39.837986 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:11:39.839975 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 172/344] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:11:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:39.843268 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd32a5-3104-4454-a5e5-4fa046e9ef4f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:39.896783 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:39.933460 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5f6d3-9173-461f-b7db-9715c84ce33b None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:39.950342 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:39.970295 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64518f0-5578-4a33-86b1-eed09e9ff6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:39.971171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64518f0-5578-4a33-86b1-eed09e9ff6dd None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:39.971590 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64518f0-5578-4a33-86b1-eed09e9ff6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:39.972046 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64518f0-5578-4a33-86b1-eed09e9ff6dd None admin] PATH_INFO: `/v3/projects/db323e19e6ee4196a29be0d178ff0eb0` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:39.973346 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64518f0-5578-4a33-86b1-eed09e9ff6dd None admin] RBAC: Authorizing `identity:get_project(project_id=db323e19e6ee4196a29be0d178ff0eb0)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:39.974912 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64518f0-5578-4a33-86b1-eed09e9ff6dd None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:39.977288 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 173/345] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:39 2022] GET /identity/v3/projects/db323e19e6ee4196a29be0d178ff0eb0 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:39.977946 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd32a5-3104-4454-a5e5-4fa046e9ef4f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:39.978722 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d832e8d-afbf-4d3e-a555-7bcac94fd996 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:39.979142 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d832e8d-afbf-4d3e-a555-7bcac94fd996 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:39.979649 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d832e8d-afbf-4d3e-a555-7bcac94fd996 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:39.981233 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 174/346] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:39.982068 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d832e8d-afbf-4d3e-a555-7bcac94fd996 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:40.021091 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87272098-3d8e-42cc-a255-cede45d170e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:40.021659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87272098-3d8e-42cc-a255-cede45d170e9 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:40.021938 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87272098-3d8e-42cc-a255-cede45d170e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:40.022207 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87272098-3d8e-42cc-a255-cede45d170e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:40.035586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87272098-3d8e-42cc-a255-cede45d170e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:40.042670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-87272098-3d8e-42cc-a255-cede45d170e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 15:11:40.042670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:40.042670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:40.042670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:40.042670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:40.042670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:40.042670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:40.042670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:40.042670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:40.042670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:40.042670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:40.042670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:40.042670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:40.042670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:40.042670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:40.042670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:40.043569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:40.043569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:40.043569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:40.043569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:40.043569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:40.043569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:40.043569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:40.043569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:40.043569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:40.043569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:40.043569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:40.043569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:40.043569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:40.043569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:40.043569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:40.043569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:40.044519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:40.044519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:40.044519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:40.044519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:40.044519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:40.044519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:40.044519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:40.044519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:40.044519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:40.044519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:40.044519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 15:11:40.044519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:11:40.044519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 173/347] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jul 27 15:11:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:40.045183 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87272098-3d8e-42cc-a255-cede45d170e9 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:40.130583 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d832e8d-afbf-4d3e-a555-7bcac94fd996 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:40.161784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87272098-3d8e-42cc-a255-cede45d170e9 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:40.176875 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bfa93e-b531-4d59-943f-af47ebc9d3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:40.177076 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfa93e-b531-4d59-943f-af47ebc9d3a3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:40.177318 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfa93e-b531-4d59-943f-af47ebc9d3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:40.177559 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfa93e-b531-4d59-943f-af47ebc9d3a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:40.178260 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bfa93e-b531-4d59-943f-af47ebc9d3a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:40.178564 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bfa93e-b531-4d59-943f-af47ebc9d3a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:40.180208 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bfa93e-b531-4d59-943f-af47ebc9d3a3 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:40.192032 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 175/348] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jul 27 15:11:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:40.192032 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171bbdd-ddcc-4fe1-a042-603e4b3a4d78 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:40.192032 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171bbdd-ddcc-4fe1-a042-603e4b3a4d78 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:40.192032 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9171bbdd-ddcc-4fe1-a042-603e4b3a4d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:40.204500 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:40.216846 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fce47-f12c-4910-a360-ef97c799abd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:40.217498 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fce47-f12c-4910-a360-ef97c799abd5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:40.217779 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fce47-f12c-4910-a360-ef97c799abd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:40.218048 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fce47-f12c-4910-a360-ef97c799abd5 None admin] PATH_INFO: `/v3/groups/1cc1afb6965549708d8b9b4339430192` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:40.222612 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-9171bbdd-ddcc-4fe1-a042-603e4b3a4d78 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:40.224302 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9171bbdd-ddcc-4fe1-a042-603e4b3a4d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:40.227059 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8fce47-f12c-4910-a360-ef97c799abd5 None admin] RBAC: Authorizing `identity:get_group(group_id=1cc1afb6965549708d8b9b4339430192)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:40.229007 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8fce47-f12c-4910-a360-ef97c799abd5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:40.230962 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 174/349] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Jul 27 15:11:40 2022] GET /identity/v3/groups/1cc1afb6965549708d8b9b4339430192 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:40.231933 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fce47-f12c-4910-a360-ef97c799abd5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:40.235151 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:40.312642 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 176/350] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:40.313502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171bbdd-ddcc-4fe1-a042-603e4b3a4d78 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:40.396744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fce47-f12c-4910-a360-ef97c799abd5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:40.425290 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9171bbdd-ddcc-4fe1-a042-603e4b3a4d78 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:40.435252 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbd021-abdb-4c9a-a3ad-59015500c86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:40.436220 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbd021-abdb-4c9a-a3ad-59015500c86d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:40.436788 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbd021-abdb-4c9a-a3ad-59015500c86d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:40.437267 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcbd021-abdb-4c9a-a3ad-59015500c86d None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:40.438167 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbd021-abdb-4c9a-a3ad-59015500c86d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:40.438659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbd021-abdb-4c9a-a3ad-59015500c86d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:40.440464 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcbd021-abdb-4c9a-a3ad-59015500c86d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:40.449721 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 175/351] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:11:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:40.450896 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbd021-abdb-4c9a-a3ad-59015500c86d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:40.461469 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb7c88-e09c-45d1-be75-d9ae7734105d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:40.462123 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb7c88-e09c-45d1-be75-d9ae7734105d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:40.462780 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb7c88-e09c-45d1-be75-d9ae7734105d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:40.462780 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bb7c88-e09c-45d1-be75-d9ae7734105d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:40.465696 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:40.522718 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:40.544724 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb7c88-e09c-45d1-be75-d9ae7734105d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:40.546212 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bb7c88-e09c-45d1-be75-d9ae7734105d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:40.585945 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcbd021-abdb-4c9a-a3ad-59015500c86d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:40.629597 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fe22a-6835-42d3-a680-fa843c3ab3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:40.630332 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fe22a-6835-42d3-a680-fa843c3ab3c7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:40.630620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fe22a-6835-42d3-a680-fa843c3ab3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:40.630892 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fe22a-6835-42d3-a680-fa843c3ab3c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:40.631817 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888fe22a-6835-42d3-a680-fa843c3ab3c7 None admin] RBAC: Adding query filter params (group.id=1cc1afb6965549708d8b9b4339430192, role.id=05b155ad77f0416a85b84ab318160c53, scope.project.id=db323e19e6ee4196a29be0d178ff0eb0) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:40.632175 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888fe22a-6835-42d3-a680-fa843c3ab3c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:40.634127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888fe22a-6835-42d3-a680-fa843c3ab3c7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:40.641177 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 176/352] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Jul 27 15:11:40 2022] GET /identity/v3/role_assignments?group.id=1cc1afb6965549708d8b9b4339430192&scope.project.id=db323e19e6ee4196a29be0d178ff0eb0&role.id=05b155ad77f0416a85b84ab318160c53 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:40.641177 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fe22a-6835-42d3-a680-fa843c3ab3c7 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:40.686637 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 177/353] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:11:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 15:11:40.687527 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb7c88-e09c-45d1-be75-d9ae7734105d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:40.740621 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:40.760363 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fe22a-6835-42d3-a680-fa843c3ab3c7 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:40.798950 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:40.804669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24533dd6-ddb6-4b92-8ac6-a2a82078a0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:40.805583 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24533dd6-ddb6-4b92-8ac6-a2a82078a0f7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:40.806013 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24533dd6-ddb6-4b92-8ac6-a2a82078a0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:40.806538 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24533dd6-ddb6-4b92-8ac6-a2a82078a0f7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:40.822584 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24533dd6-ddb6-4b92-8ac6-a2a82078a0f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:40.828192 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bb7c88-e09c-45d1-be75-d9ae7734105d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:40.828871 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-24533dd6-ddb6-4b92-8ac6-a2a82078a0f7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 15:11:40.828871 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:40.828871 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:40.828871 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:40.828871 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:40.828871 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:40.828871 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:40.828871 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:40.828871 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:40.828871 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:40.828871 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:40.828871 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:40.828871 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:40.828871 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:40.828871 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:40.828871 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:40.829784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:40.829784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:40.829784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:40.829784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:40.829784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:40.829784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:40.829784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:40.829784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:40.829784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:40.829784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:40.829784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:40.829784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:40.829784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:40.829784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:40.829784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:40.829784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:40.830579 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:40.830579 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:40.830579 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:40.830579 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:40.830579 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:40.830579 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:40.830579 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:40.830579 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:40.830579 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:40.830579 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:40.830579 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 15:11:40.830579 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:11:40.833135 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 177/354] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:11:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:40.834686 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57043a26-f43e-4ce4-a8c7-6155be3ff017 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:40.835181 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57043a26-f43e-4ce4-a8c7-6155be3ff017 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:40.836283 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57043a26-f43e-4ce4-a8c7-6155be3ff017 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:40.838096 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 178/355] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:40.839002 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57043a26-f43e-4ce4-a8c7-6155be3ff017 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:40.880674 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390fccac-e169-435b-b110-0d22b5783226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:40.881299 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390fccac-e169-435b-b110-0d22b5783226 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:40.881588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390fccac-e169-435b-b110-0d22b5783226 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:40.881844 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390fccac-e169-435b-b110-0d22b5783226 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:40.970032 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390fccac-e169-435b-b110-0d22b5783226 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:40.971614 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390fccac-e169-435b-b110-0d22b5783226 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:40.981632 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57043a26-f43e-4ce4-a8c7-6155be3ff017 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:41.016094 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:41.028198 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3ed60-59e1-4eeb-b45c-f629c3f4113e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:41.029594 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3ed60-59e1-4eeb-b45c-f629c3f4113e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:41.029594 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3ed60-59e1-4eeb-b45c-f629c3f4113e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:41.029594 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3ed60-59e1-4eeb-b45c-f629c3f4113e None admin] PATH_INFO: `/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:41.031236 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a3ed60-59e1-4eeb-b45c-f629c3f4113e None admin] RBAC: Authorizing `identity:get_project(project_id=cd46e34c8ff44b9abce25e0fd266ac70)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:41.033354 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a3ed60-59e1-4eeb-b45c-f629c3f4113e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:41.035868 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 179/356] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:40 2022] GET /identity/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:41.037599 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908dbbb-05f4-43a6-9eb9-e52621f4bba2 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:41.038041 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908dbbb-05f4-43a6-9eb9-e52621f4bba2 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:41.038499 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e908dbbb-05f4-43a6-9eb9-e52621f4bba2 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:41.040156 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 180/357] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:41.045088 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908dbbb-05f4-43a6-9eb9-e52621f4bba2 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:41.107720 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 178/358] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:11:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 15:11:41.108949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a60acd-b102-4ec1-ae22-2045447d2cb2 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:41.109240 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a60acd-b102-4ec1-ae22-2045447d2cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:41.109516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a60acd-b102-4ec1-ae22-2045447d2cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:41.122509 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:41.132332 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-01a60acd-b102-4ec1-ae22-2045447d2cb2 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:41.134065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-01a60acd-b102-4ec1-ae22-2045447d2cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:41.178693 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e908dbbb-05f4-43a6-9eb9-e52621f4bba2 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:41.213335 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 179/359] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:41.216512 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a60acd-b102-4ec1-ae22-2045447d2cb2 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:41.227742 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fffba4-6c76-4eab-86e2-9fdefe488c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:41.228652 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fffba4-6c76-4eab-86e2-9fdefe488c4b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:41.229106 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fffba4-6c76-4eab-86e2-9fdefe488c4b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:41.229547 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fffba4-6c76-4eab-86e2-9fdefe488c4b None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:41.231142 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fffba4-6c76-4eab-86e2-9fdefe488c4b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:41.231457 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fffba4-6c76-4eab-86e2-9fdefe488c4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:41.233291 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fffba4-6c76-4eab-86e2-9fdefe488c4b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:41.244046 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 181/360] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jul 27 15:11:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:41.249511 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df713f55-2ef1-4c1b-978f-714cfcf4bc54 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:41.249511 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df713f55-2ef1-4c1b-978f-714cfcf4bc54 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:41.249935 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df713f55-2ef1-4c1b-978f-714cfcf4bc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:41.271573 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-df713f55-2ef1-4c1b-978f-714cfcf4bc54 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:41.273314 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-df713f55-2ef1-4c1b-978f-714cfcf4bc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:41.311000 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:41.354269 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a60acd-b102-4ec1-ae22-2045447d2cb2 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:41.361500 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 182/361] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:41.364333 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df713f55-2ef1-4c1b-978f-714cfcf4bc54 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:41.393890 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572919b-f8d0-4d59-bcc4-c62963db22bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:41.394561 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572919b-f8d0-4d59-bcc4-c62963db22bc None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:41.394828 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572919b-f8d0-4d59-bcc4-c62963db22bc None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:41.395162 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572919b-f8d0-4d59-bcc4-c62963db22bc None admin] PATH_INFO: `/v3/groups/1cc1afb6965549708d8b9b4339430192` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:41.396400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572919b-f8d0-4d59-bcc4-c62963db22bc None admin] RBAC: Authorizing `identity:get_group(group_id=1cc1afb6965549708d8b9b4339430192)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:41.397940 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572919b-f8d0-4d59-bcc4-c62963db22bc None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:41.399767 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 180/362] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Jul 27 15:11:41 2022] GET /identity/v3/groups/1cc1afb6965549708d8b9b4339430192 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:41.400556 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572919b-f8d0-4d59-bcc4-c62963db22bc None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:41.433482 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:41.500698 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df713f55-2ef1-4c1b-978f-714cfcf4bc54 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:41.532163 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572919b-f8d0-4d59-bcc4-c62963db22bc None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:41.555234 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec9e1f-2808-41ca-a358-d8feae855280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:41.555891 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec9e1f-2808-41ca-a358-d8feae855280 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:41.556197 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec9e1f-2808-41ca-a358-d8feae855280 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:41.556467 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec9e1f-2808-41ca-a358-d8feae855280 None admin] PATH_INFO: `/v3/projects/db323e19e6ee4196a29be0d178ff0eb0` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:41.557689 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ec9e1f-2808-41ca-a358-d8feae855280 None admin] RBAC: Authorizing `identity:get_project(project_id=db323e19e6ee4196a29be0d178ff0eb0)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:41.559141 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ec9e1f-2808-41ca-a358-d8feae855280 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:41.561705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 183/363] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:41 2022] GET /identity/v3/projects/db323e19e6ee4196a29be0d178ff0eb0 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:41.567161 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec9e1f-2808-41ca-a358-d8feae855280 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:41.567626 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:41.573409 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf38b97-bb99-405d-aaf8-0baa729fd404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:41.573409 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf38b97-bb99-405d-aaf8-0baa729fd404 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:41.573409 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf38b97-bb99-405d-aaf8-0baa729fd404 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:41.573409 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf38b97-bb99-405d-aaf8-0baa729fd404 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:41.587878 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf38b97-bb99-405d-aaf8-0baa729fd404 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:41.596021 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-4bf38b97-bb99-405d-aaf8-0baa729fd404 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 15:11:41.596021 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:41.596021 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:41.596021 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:41.596021 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:41.596021 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:41.596021 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:41.596021 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:41.596021 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:41.596021 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:41.596021 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:41.596021 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:41.596021 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:41.596021 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:41.596021 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:41.596021 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:41.596918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:41.596918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:41.596918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:41.596918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:41.596918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:41.596918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:41.596918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:41.596918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:41.596918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:41.596918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:41.596918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:41.596918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:41.596918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:41.596918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:41.596918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:41.596918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:41.597714 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:41.597714 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:41.597714 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:41.597714 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:41.597714 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:41.597714 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:41.597714 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:41.597714 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:41.597714 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:41.597714 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:41.597714 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 15:11:41.597714 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:11:41.597714 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 181/364] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jul 27 15:11:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:41.597714 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf38b97-bb99-405d-aaf8-0baa729fd404 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:41.683467 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec9e1f-2808-41ca-a358-d8feae855280 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:41.706374 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:41.708660 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf38b97-bb99-405d-aaf8-0baa729fd404 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:41.738923 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446996f0-a998-4eaf-b5c7-0b9af319c86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:41.738923 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446996f0-a998-4eaf-b5c7-0b9af319c86a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:41.738923 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446996f0-a998-4eaf-b5c7-0b9af319c86a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:41.738923 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446996f0-a998-4eaf-b5c7-0b9af319c86a None admin] PATH_INFO: `/v3/users/cbcc3d438bc348fdab6fd71f943ba956` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:41.740861 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446996f0-a998-4eaf-b5c7-0b9af319c86a None admin] RBAC: Authorizing `identity:get_user(user_id=cbcc3d438bc348fdab6fd71f943ba956)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:41.742755 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446996f0-a998-4eaf-b5c7-0b9af319c86a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:41.744724 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 184/365] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:11:41 2022] GET /identity/v3/users/cbcc3d438bc348fdab6fd71f943ba956 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:41.745969 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446996f0-a998-4eaf-b5c7-0b9af319c86a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:41.754471 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a16277-187a-461e-a93a-04ff3b3406d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:41.755808 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a16277-187a-461e-a93a-04ff3b3406d7 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:41.756392 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a16277-187a-461e-a93a-04ff3b3406d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:41.756872 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a16277-187a-461e-a93a-04ff3b3406d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:41.770747 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a16277-187a-461e-a93a-04ff3b3406d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:41.778435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-c4a16277-187a-461e-a93a-04ff3b3406d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:11:41.778435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:41.778435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:41.778435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:41.778435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:41.778435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:41.778435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:41.778435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:41.778435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:41.778435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:41.778435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:41.778435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:41.778435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:41.778435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:41.778435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:41.778435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:41.779340 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:41.779340 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:41.779340 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:41.779340 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:41.779340 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:41.779340 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:41.779340 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:41.779340 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:41.779340 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:41.779340 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:41.779340 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:41.779340 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:41.779340 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:41.779340 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:41.779340 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:41.779340 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:41.780216 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:41.780216 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:41.780216 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:41.780216 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:41.780216 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:41.780216 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:41.780216 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:41.780216 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:41.780216 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:41.780216 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:41.780216 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:11:41.780216 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:11:41.780216 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 182/366] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jul 27 15:11:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:41.780881 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a16277-187a-461e-a93a-04ff3b3406d7 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:41.850679 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:41.868970 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446996f0-a998-4eaf-b5c7-0b9af319c86a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:41.921153 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760999c-5838-451c-8f1a-7420acfac527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:41.922075 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760999c-5838-451c-8f1a-7420acfac527 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:41.922565 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760999c-5838-451c-8f1a-7420acfac527 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:41.923049 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5760999c-5838-451c-8f1a-7420acfac527 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:41.923931 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760999c-5838-451c-8f1a-7420acfac527 None admin] RBAC: Adding query filter params (group.id=1cc1afb6965549708d8b9b4339430192, role.id=05b155ad77f0416a85b84ab318160c53, scope.project.id=cd46e34c8ff44b9abce25e0fd266ac70) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:41.924464 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760999c-5838-451c-8f1a-7420acfac527 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:41.925955 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5760999c-5838-451c-8f1a-7420acfac527 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:41.933744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 185/367] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Jul 27 15:11:41 2022] GET /identity/v3/role_assignments?group.id=1cc1afb6965549708d8b9b4339430192&scope.project.id=cd46e34c8ff44b9abce25e0fd266ac70&role.id=05b155ad77f0416a85b84ab318160c53 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:41.937097 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760999c-5838-451c-8f1a-7420acfac527 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:41.937612 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a16277-187a-461e-a93a-04ff3b3406d7 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:41.984390 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6a158-7a64-4660-8f03-e4baa7757a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:41.985496 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6a158-7a64-4660-8f03-e4baa7757a5c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:41.985991 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6a158-7a64-4660-8f03-e4baa7757a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:41.986470 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6a158-7a64-4660-8f03-e4baa7757a5c None admin] PATH_INFO: `/v3/groups/1cc1afb6965549708d8b9b4339430192` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:41.987846 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6a158-7a64-4660-8f03-e4baa7757a5c None admin] RBAC: Authorizing `identity:get_group(group_id=1cc1afb6965549708d8b9b4339430192)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:41.990214 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6a158-7a64-4660-8f03-e4baa7757a5c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:41.992404 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 183/368] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Jul 27 15:11:41 2022] GET /identity/v3/groups/1cc1afb6965549708d8b9b4339430192 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:41.993431 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6a158-7a64-4660-8f03-e4baa7757a5c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:42.007123 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:42.073255 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5760999c-5838-451c-8f1a-7420acfac527 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:42.116227 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ab96a-40c0-4604-99c3-15ebc3b5bef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:42.117204 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ab96a-40c0-4604-99c3-15ebc3b5bef6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:42.117725 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ab96a-40c0-4604-99c3-15ebc3b5bef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:42.118209 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307ab96a-40c0-4604-99c3-15ebc3b5bef6 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:42.119146 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ab96a-40c0-4604-99c3-15ebc3b5bef6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:42.119684 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ab96a-40c0-4604-99c3-15ebc3b5bef6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:42.121287 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307ab96a-40c0-4604-99c3-15ebc3b5bef6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:42.131619 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 186/369] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:11:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:42.132970 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ab96a-40c0-4604-99c3-15ebc3b5bef6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:42.150592 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6a158-7a64-4660-8f03-e4baa7757a5c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:42.171953 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:42.189328 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d359a5-81db-417f-ad34-00c935775399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:42.189866 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d359a5-81db-417f-ad34-00c935775399 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:42.190149 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d359a5-81db-417f-ad34-00c935775399 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:42.190426 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d359a5-81db-417f-ad34-00c935775399 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:42.191226 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d359a5-81db-417f-ad34-00c935775399 None admin] RBAC: Adding query filter params (role.id=b5c62080008c4f3baa59ef8985befc47, user.id=cbcc3d438bc348fdab6fd71f943ba956, scope.system=all) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:42.191525 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d359a5-81db-417f-ad34-00c935775399 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:42.194073 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d359a5-81db-417f-ad34-00c935775399 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:42.207357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 184/370] 10.222.0.40 () {56 vars in 1308 bytes} [Wed Jul 27 15:11:41 2022] GET /identity/v3/role_assignments?user.id=cbcc3d438bc348fdab6fd71f943ba956&scope.system=all&role.id=b5c62080008c4f3baa59ef8985befc47 => generated 510 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:42.208028 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d359a5-81db-417f-ad34-00c935775399 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:42.268782 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307ab96a-40c0-4604-99c3-15ebc3b5bef6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:42.282558 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:42.322214 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06953a01-43d8-4885-b2ff-189012e688a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:42.323134 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06953a01-43d8-4885-b2ff-189012e688a6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:42.323590 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06953a01-43d8-4885-b2ff-189012e688a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:42.324046 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06953a01-43d8-4885-b2ff-189012e688a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:42.324956 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06953a01-43d8-4885-b2ff-189012e688a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:42.325429 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06953a01-43d8-4885-b2ff-189012e688a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:42.327006 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06953a01-43d8-4885-b2ff-189012e688a6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:42.336031 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d359a5-81db-417f-ad34-00c935775399 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:42.345615 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 187/371] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:11:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:42.346762 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06953a01-43d8-4885-b2ff-189012e688a6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:42.376030 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac1e14-6d3e-4ed2-ad59-f64c132198fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:42.376030 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac1e14-6d3e-4ed2-ad59-f64c132198fb None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:42.376030 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac1e14-6d3e-4ed2-ad59-f64c132198fb None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:42.376030 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac1e14-6d3e-4ed2-ad59-f64c132198fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:42.376464 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aac1e14-6d3e-4ed2-ad59-f64c132198fb None admin] RBAC: Adding query filter params (group.id=1cc1afb6965549708d8b9b4339430192, role.id=ce7d7a296f4e448dbb11ded292818043, scope.project.id=db323e19e6ee4196a29be0d178ff0eb0) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:42.376464 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aac1e14-6d3e-4ed2-ad59-f64c132198fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:42.377445 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aac1e14-6d3e-4ed2-ad59-f64c132198fb None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:42.384707 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 185/372] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Jul 27 15:11:42 2022] GET /identity/v3/role_assignments?group.id=1cc1afb6965549708d8b9b4339430192&scope.project.id=db323e19e6ee4196a29be0d178ff0eb0&role.id=ce7d7a296f4e448dbb11ded292818043 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:42.385755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac1e14-6d3e-4ed2-ad59-f64c132198fb None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:42.435547 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:42.508109 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac1e14-6d3e-4ed2-ad59-f64c132198fb None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:42.516041 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06953a01-43d8-4885-b2ff-189012e688a6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:42.545323 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39333878-ddae-44b8-8a38-29f776be69fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:42.545779 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39333878-ddae-44b8-8a38-29f776be69fd None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:42.546063 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39333878-ddae-44b8-8a38-29f776be69fd None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:42.546338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39333878-ddae-44b8-8a38-29f776be69fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:42.586694 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2455b3d-9203-49df-a591-4ac3e802bf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:42.587639 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2455b3d-9203-49df-a591-4ac3e802bf3a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:42.588109 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2455b3d-9203-49df-a591-4ac3e802bf3a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:42.588534 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2455b3d-9203-49df-a591-4ac3e802bf3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:42.630213 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39333878-ddae-44b8-8a38-29f776be69fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:42.631698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39333878-ddae-44b8-8a38-29f776be69fd None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:42.678576 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:42.689130 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:42.755081 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 186/373] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:11:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 15:11:42.761606 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39333878-ddae-44b8-8a38-29f776be69fd None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:42.774227 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2455b3d-9203-49df-a591-4ac3e802bf3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:42.775735 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2455b3d-9203-49df-a591-4ac3e802bf3a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:42.917388 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39333878-ddae-44b8-8a38-29f776be69fd None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:42.969694 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 188/374] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:11:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 623 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 15:11:42.975655 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2455b3d-9203-49df-a591-4ac3e802bf3a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:42.981421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21dd66-83a6-4a23-b486-264360d0c489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:42.982080 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21dd66-83a6-4a23-b486-264360d0c489 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:42.982362 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21dd66-83a6-4a23-b486-264360d0c489 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:42.982639 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21dd66-83a6-4a23-b486-264360d0c489 None admin] PATH_INFO: `/v3/projects/0cee0118499d467da89c121f8970b184` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:42.984439 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21dd66-83a6-4a23-b486-264360d0c489 None admin] RBAC: Authorizing `identity:get_project(project_id=0cee0118499d467da89c121f8970b184)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:42.986008 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21dd66-83a6-4a23-b486-264360d0c489 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:42.988197 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 187/375] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:42 2022] GET /identity/v3/projects/0cee0118499d467da89c121f8970b184 => generated 344 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:42.989425 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad6492-8c84-4f11-96de-43b9d8262cd6 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:42.989717 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad6492-8c84-4f11-96de-43b9d8262cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:42.989994 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ad6492-8c84-4f11-96de-43b9d8262cd6 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:42.992965 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 188/376] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:42.997065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad6492-8c84-4f11-96de-43b9d8262cd6 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:43.014559 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:43.065111 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:43.109730 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2455b3d-9203-49df-a591-4ac3e802bf3a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:43.153346 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05335fe-465d-4d51-a7b8-86d7be05af5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:43.154052 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05335fe-465d-4d51-a7b8-86d7be05af5d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:43.154333 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05335fe-465d-4d51-a7b8-86d7be05af5d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:43.154606 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05335fe-465d-4d51-a7b8-86d7be05af5d None admin] PATH_INFO: `/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:43.155817 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05335fe-465d-4d51-a7b8-86d7be05af5d None admin] RBAC: Authorizing `identity:get_project(project_id=cd46e34c8ff44b9abce25e0fd266ac70)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:43.156847 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ad6492-8c84-4f11-96de-43b9d8262cd6 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:43.157316 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05335fe-465d-4d51-a7b8-86d7be05af5d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:43.160110 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 189/377] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:42 2022] GET /identity/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:11:43.160852 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6ffaa-0a7f-47f1-8720-c9c834b09b59 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:43.161139 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6ffaa-0a7f-47f1-8720-c9c834b09b59 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:43.161413 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd6ffaa-0a7f-47f1-8720-c9c834b09b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:43.183282 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-5fd6ffaa-0a7f-47f1-8720-c9c834b09b59 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:43.184568 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5fd6ffaa-0a7f-47f1-8720-c9c834b09b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:43.202079 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d4df8-cf8d-4abd-8a4d-2e3700ad06a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:43.203498 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d4df8-cf8d-4abd-8a4d-2e3700ad06a3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:43.204140 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d4df8-cf8d-4abd-8a4d-2e3700ad06a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:43.204567 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d4df8-cf8d-4abd-8a4d-2e3700ad06a3 None admin] PATH_INFO: `/v3/groups/68fbe14af3e94475b2bc87815c159d2b` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:43.218944 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d4df8-cf8d-4abd-8a4d-2e3700ad06a3 None admin] RBAC: Authorizing `identity:get_group(group_id=68fbe14af3e94475b2bc87815c159d2b)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:43.220432 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d4df8-cf8d-4abd-8a4d-2e3700ad06a3 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:43.222415 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 189/378] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Jul 27 15:11:42 2022] GET /identity/v3/groups/68fbe14af3e94475b2bc87815c159d2b => generated 229 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:43.223289 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d4df8-cf8d-4abd-8a4d-2e3700ad06a3 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:43.282649 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 190/379] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:43.283812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6ffaa-0a7f-47f1-8720-c9c834b09b59 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:43.325655 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:43.360560 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d4df8-cf8d-4abd-8a4d-2e3700ad06a3 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:43.392166 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:43.400102 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed42c97-ef0f-4ae9-8540-36c8e490ccf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:43.400750 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed42c97-ef0f-4ae9-8540-36c8e490ccf5 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:43.401026 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed42c97-ef0f-4ae9-8540-36c8e490ccf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:43.401296 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed42c97-ef0f-4ae9-8540-36c8e490ccf5 None admin] PATH_INFO: `/v3/groups/1cc1afb6965549708d8b9b4339430192` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:43.402723 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed42c97-ef0f-4ae9-8540-36c8e490ccf5 None admin] RBAC: Authorizing `identity:get_group(group_id=1cc1afb6965549708d8b9b4339430192)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:43.404043 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed42c97-ef0f-4ae9-8540-36c8e490ccf5 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:43.405634 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 190/380] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Jul 27 15:11:43 2022] GET /identity/v3/groups/1cc1afb6965549708d8b9b4339430192 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:43.408453 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed42c97-ef0f-4ae9-8540-36c8e490ccf5 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:43.436077 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd6ffaa-0a7f-47f1-8720-c9c834b09b59 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:43.484436 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2140f-3c46-4aa0-addc-dc7f79139922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:43.485750 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2140f-3c46-4aa0-addc-dc7f79139922 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:43.486247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2140f-3c46-4aa0-addc-dc7f79139922 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:43.486930 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2140f-3c46-4aa0-addc-dc7f79139922 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:43.487893 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2140f-3c46-4aa0-addc-dc7f79139922 None admin] RBAC: Adding query filter params (group.id=68fbe14af3e94475b2bc87815c159d2b, role.id=6535f8b98008471dba33e89bd460880d, scope.project.id=0cee0118499d467da89c121f8970b184) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:43.488366 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2140f-3c46-4aa0-addc-dc7f79139922 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:43.490828 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2140f-3c46-4aa0-addc-dc7f79139922 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:43.500913 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 191/381] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Jul 27 15:11:43 2022] GET /identity/v3/role_assignments?group.id=68fbe14af3e94475b2bc87815c159d2b&scope.project.id=0cee0118499d467da89c121f8970b184&role.id=6535f8b98008471dba33e89bd460880d => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:43.503612 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2140f-3c46-4aa0-addc-dc7f79139922 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:43.540170 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed42c97-ef0f-4ae9-8540-36c8e490ccf5 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:43.586807 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddbf229-05bc-451c-b415-a554c1c5a86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:43.587747 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbf229-05bc-451c-b415-a554c1c5a86a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:43.588249 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbf229-05bc-451c-b415-a554c1c5a86a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:43.588703 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddbf229-05bc-451c-b415-a554c1c5a86a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:43.606256 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eddbf229-05bc-451c-b415-a554c1c5a86a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:43.614059 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-eddbf229-05bc-451c-b415-a554c1c5a86a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 15:11:43.614059 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:43.614059 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:43.614059 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:43.614059 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:43.614059 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:43.614059 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:43.614059 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:43.614059 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:43.614059 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:43.614059 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:43.614059 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:43.614059 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:43.614059 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:43.614059 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:43.614059 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:43.615092 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:43.615092 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:43.615092 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:43.615092 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:43.615092 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:43.615092 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:43.615092 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:43.615092 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:43.615092 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:43.615092 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:43.615092 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:43.615092 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:43.615092 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:43.615092 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:43.615092 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:43.615092 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:43.615920 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:43.615920 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:43.615920 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:43.615920 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:43.615920 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:43.615920 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:43.615920 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:43.615920 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:43.615920 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:43.615920 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:43.615920 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 15:11:43.615920 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:11:43.618830 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 191/382] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:11:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:43.624730 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddbf229-05bc-451c-b415-a554c1c5a86a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:43.630577 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:43.664331 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2140f-3c46-4aa0-addc-dc7f79139922 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:43.707432 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af469e-be01-4c62-a3dc-88c43aabdd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:43.708364 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af469e-be01-4c62-a3dc-88c43aabdd68 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:43.709299 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af469e-be01-4c62-a3dc-88c43aabdd68 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:43.709724 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3af469e-be01-4c62-a3dc-88c43aabdd68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:43.710729 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af469e-be01-4c62-a3dc-88c43aabdd68 None admin] RBAC: Adding query filter params (group.id=1cc1afb6965549708d8b9b4339430192, role.id=ce7d7a296f4e448dbb11ded292818043, scope.project.id=cd46e34c8ff44b9abce25e0fd266ac70) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:43.711188 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af469e-be01-4c62-a3dc-88c43aabdd68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:43.712826 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3af469e-be01-4c62-a3dc-88c43aabdd68 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:43.715902 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:43.721230 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 192/383] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Jul 27 15:11:43 2022] GET /identity/v3/role_assignments?group.id=1cc1afb6965549708d8b9b4339430192&scope.project.id=cd46e34c8ff44b9abce25e0fd266ac70&role.id=ce7d7a296f4e448dbb11ded292818043 => generated 260 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:43.801546 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddbf229-05bc-451c-b415-a554c1c5a86a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:43.840926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c12796-6cba-403e-b482-12f5eec3d66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:43.841861 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c12796-6cba-403e-b482-12f5eec3d66d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:43.842297 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c12796-6cba-403e-b482-12f5eec3d66d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:43.842723 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c12796-6cba-403e-b482-12f5eec3d66d None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:43.843706 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c12796-6cba-403e-b482-12f5eec3d66d None admin] RBAC: Adding query filter params (name=member) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:43.844221 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c12796-6cba-403e-b482-12f5eec3d66d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:43.845799 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c12796-6cba-403e-b482-12f5eec3d66d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:43.856703 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 192/384] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jul 27 15:11:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:11:43.861896 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af469e-be01-4c62-a3dc-88c43aabdd68 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:43.994727 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3af469e-be01-4c62-a3dc-88c43aabdd68 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:44.040730 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc1b1f-d88c-4845-b08d-7cb88121cd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:44.041668 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc1b1f-d88c-4845-b08d-7cb88121cd95 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:44.042096 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc1b1f-d88c-4845-b08d-7cb88121cd95 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:44.042511 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfc1b1f-d88c-4845-b08d-7cb88121cd95 None admin] PATH_INFO: `/v3/groups/1cc1afb6965549708d8b9b4339430192` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:44.043820 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc1b1f-d88c-4845-b08d-7cb88121cd95 None admin] RBAC: Authorizing `identity:get_group(group_id=1cc1afb6965549708d8b9b4339430192)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:44.045438 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfc1b1f-d88c-4845-b08d-7cb88121cd95 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:44.047563 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 193/385] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Jul 27 15:11:43 2022] GET /identity/v3/groups/1cc1afb6965549708d8b9b4339430192 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:44.052990 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c12796-6cba-403e-b482-12f5eec3d66d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:44.136761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:44.173347 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c12796-6cba-403e-b482-12f5eec3d66d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:44.209715 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c5e8b-de90-4550-9757-dc5dd6a569fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:44.211153 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c5e8b-de90-4550-9757-dc5dd6a569fa None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:44.211609 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c5e8b-de90-4550-9757-dc5dd6a569fa None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:44.212058 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c5e8b-de90-4550-9757-dc5dd6a569fa None admin] PATH_INFO: `/v3/projects/db323e19e6ee4196a29be0d178ff0eb0` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:44.213370 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c5e8b-de90-4550-9757-dc5dd6a569fa None admin] RBAC: Authorizing `identity:get_project(project_id=db323e19e6ee4196a29be0d178ff0eb0)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:44.215011 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574c5e8b-de90-4550-9757-dc5dd6a569fa None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:44.217008 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 193/386] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:44 2022] GET /identity/v3/projects/db323e19e6ee4196a29be0d178ff0eb0 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:44.222679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc1b1f-d88c-4845-b08d-7cb88121cd95 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:44.294931 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:44.337697 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfc1b1f-d88c-4845-b08d-7cb88121cd95 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:44.383287 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c4e5c5-974b-4b72-91a3-3255302df1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:44.384249 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4e5c5-974b-4b72-91a3-3255302df1b6 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:44.384696 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4e5c5-974b-4b72-91a3-3255302df1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:44.385117 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4e5c5-974b-4b72-91a3-3255302df1b6 None admin] PATH_INFO: `/v3/projects/db323e19e6ee4196a29be0d178ff0eb0/groups/1cc1afb6965549708d8b9b4339430192/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:44.387263 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4e5c5-974b-4b72-91a3-3255302df1b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=db323e19e6ee4196a29be0d178ff0eb0, group_id=1cc1afb6965549708d8b9b4339430192, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:44.388955 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c4e5c5-974b-4b72-91a3-3255302df1b6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:44.414918 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 194/387] 10.222.0.40 () {58 vars in 1442 bytes} [Wed Jul 27 15:11:44 2022] PUT /identity/v3/projects/db323e19e6ee4196a29be0d178ff0eb0/groups/1cc1afb6965549708d8b9b4339430192/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:11:44.638756 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc9e86-cfaa-4139-a1e7-a9b28348fb39 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:44.639398 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc9e86-cfaa-4139-a1e7-a9b28348fb39 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:44.640018 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc9e86-cfaa-4139-a1e7-a9b28348fb39 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:44.641874 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 194/388] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:44.657730 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8b9b8-6040-4f80-b931-68276bec18cc None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:44.658041 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8b9b8-6040-4f80-b931-68276bec18cc None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:44.658294 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8b9b8-6040-4f80-b931-68276bec18cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:44.683893 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-ece8b9b8-6040-4f80-b931-68276bec18cc None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:44.685167 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ece8b9b8-6040-4f80-b931-68276bec18cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:44.768410 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 195/389] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:44.802155 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc9e86-cfaa-4139-a1e7-a9b28348fb39 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:44.930742 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9dc91-230d-4ef3-83a4-0a7f7ca19042 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:44.931241 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9dc91-230d-4ef3-83a4-0a7f7ca19042 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:44.931241 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c9dc91-230d-4ef3-83a4-0a7f7ca19042 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:44.932852 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 196/390] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:44.938114 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27599739-f924-4406-a1d0-7192a0a68d33 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:44.938665 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27599739-f924-4406-a1d0-7192a0a68d33 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:44.939486 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27599739-f924-4406-a1d0-7192a0a68d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:44.942783 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fc9e86-cfaa-4139-a1e7-a9b28348fb39 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:44.977977 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-27599739-f924-4406-a1d0-7192a0a68d33 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:44.982259 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-27599739-f924-4406-a1d0-7192a0a68d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:45.011423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:45.023584 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989d4b6-51fb-4159-83d4-412836dfc966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:45.024808 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989d4b6-51fb-4159-83d4-412836dfc966 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:45.025096 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989d4b6-51fb-4159-83d4-412836dfc966 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:45.025377 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989d4b6-51fb-4159-83d4-412836dfc966 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:45.055102 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2989d4b6-51fb-4159-83d4-412836dfc966 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:45.060962 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-2989d4b6-51fb-4159-83d4-412836dfc966 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 15:11:45.060962 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:45.060962 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:45.060962 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:45.060962 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:45.060962 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:45.060962 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:45.060962 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:45.060962 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:45.060962 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:45.060962 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:45.060962 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:45.060962 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:45.060962 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:45.060962 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:45.060962 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:45.061821 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:45.061821 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:45.061821 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:45.061821 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:45.061821 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:45.061821 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:45.061821 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:45.061821 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:45.061821 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:45.061821 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:45.061821 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:45.061821 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:45.061821 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:45.061821 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:45.061821 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:45.061821 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:45.062705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:45.062705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:45.062705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:45.062705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:45.062705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:45.062705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:45.062705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:45.062705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:45.062705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:45.062705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:45.062705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 15:11:45.062705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:11:45.073233 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 195/391] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:11:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:45.077069 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989d4b6-51fb-4159-83d4-412836dfc966 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:45.090456 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:45.134045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 197/392] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:45.164478 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27599739-f924-4406-a1d0-7192a0a68d33 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:45.211907 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989d4b6-51fb-4159-83d4-412836dfc966 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:45.258746 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02afda-4418-488c-8269-2eb9b7bb7230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:45.259634 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02afda-4418-488c-8269-2eb9b7bb7230 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:45.260108 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02afda-4418-488c-8269-2eb9b7bb7230 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:45.260542 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02afda-4418-488c-8269-2eb9b7bb7230 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:45.261462 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c02afda-4418-488c-8269-2eb9b7bb7230 None admin] RBAC: Adding query filter params (name=member) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:45.261923 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c02afda-4418-488c-8269-2eb9b7bb7230 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:45.263663 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c02afda-4418-488c-8269-2eb9b7bb7230 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:45.281343 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 196/393] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jul 27 15:11:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:45.286514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02afda-4418-488c-8269-2eb9b7bb7230 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:45.299277 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27599739-f924-4406-a1d0-7192a0a68d33 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:45.347266 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:45.352692 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d05f2-aa40-472a-ba9a-46fccc32dd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:45.353343 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d05f2-aa40-472a-ba9a-46fccc32dd0b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:45.353623 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d05f2-aa40-472a-ba9a-46fccc32dd0b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:45.353902 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d05f2-aa40-472a-ba9a-46fccc32dd0b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:45.368945 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d05f2-aa40-472a-ba9a-46fccc32dd0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:45.373969 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-c38d05f2-aa40-472a-ba9a-46fccc32dd0b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 15:11:45.373969 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:45.373969 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:45.373969 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:45.373969 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:45.373969 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:45.373969 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:45.373969 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:45.373969 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:45.373969 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:45.373969 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:45.373969 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:45.373969 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:45.373969 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:45.373969 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:45.373969 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:45.374863 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:45.374863 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:45.374863 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:45.374863 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:45.374863 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:45.374863 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:45.374863 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:45.374863 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:45.374863 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:45.374863 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:45.374863 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:45.374863 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:45.374863 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:45.374863 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:45.374863 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:45.374863 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:45.375687 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:45.375687 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:45.375687 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:45.375687 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:45.375687 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:45.375687 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:45.375687 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:45.375687 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:45.375687 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:45.375687 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:45.375687 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 15:11:45.375687 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:11:45.375687 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 198/394] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jul 27 15:11:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:11:45.385613 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d05f2-aa40-472a-ba9a-46fccc32dd0b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:45.402661 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02afda-4418-488c-8269-2eb9b7bb7230 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:45.453845 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9eb5b-d5e5-48d9-b97f-d2944bad1157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:45.454868 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9eb5b-d5e5-48d9-b97f-d2944bad1157 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:45.456660 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9eb5b-d5e5-48d9-b97f-d2944bad1157 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:45.457154 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a9eb5b-d5e5-48d9-b97f-d2944bad1157 None admin] PATH_INFO: `/v3/groups/1cc1afb6965549708d8b9b4339430192` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:45.461106 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a9eb5b-d5e5-48d9-b97f-d2944bad1157 None admin] RBAC: Authorizing `identity:get_group(group_id=1cc1afb6965549708d8b9b4339430192)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:45.463013 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a9eb5b-d5e5-48d9-b97f-d2944bad1157 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:45.465428 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 197/395] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Jul 27 15:11:45 2022] GET /identity/v3/groups/1cc1afb6965549708d8b9b4339430192 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:45.473518 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:45.474665 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9eb5b-d5e5-48d9-b97f-d2944bad1157 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:45.551222 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d05f2-aa40-472a-ba9a-46fccc32dd0b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:45.585902 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a9eb5b-d5e5-48d9-b97f-d2944bad1157 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:45.615710 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:45.615883 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53f78b-880d-4372-b7af-a2baab9dfb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:45.616370 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53f78b-880d-4372-b7af-a2baab9dfb92 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:45.617470 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53f78b-880d-4372-b7af-a2baab9dfb92 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:45.617470 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a53f78b-880d-4372-b7af-a2baab9dfb92 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:45.618198 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53f78b-880d-4372-b7af-a2baab9dfb92 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:45.618498 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53f78b-880d-4372-b7af-a2baab9dfb92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:45.620048 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a53f78b-880d-4372-b7af-a2baab9dfb92 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:45.631639 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033d25a-8fd6-40fc-bd1a-379cfb009e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:45.640012 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033d25a-8fd6-40fc-bd1a-379cfb009e29 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:45.640169 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 199/396] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:11:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:45.640273 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033d25a-8fd6-40fc-bd1a-379cfb009e29 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:45.640273 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033d25a-8fd6-40fc-bd1a-379cfb009e29 None admin] PATH_INFO: `/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:45.641295 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53f78b-880d-4372-b7af-a2baab9dfb92 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:45.645726 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033d25a-8fd6-40fc-bd1a-379cfb009e29 None admin] RBAC: Authorizing `identity:get_project(project_id=cd46e34c8ff44b9abce25e0fd266ac70)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:45.647207 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033d25a-8fd6-40fc-bd1a-379cfb009e29 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:45.649194 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 198/397] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:45 2022] GET /identity/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:45.654778 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033d25a-8fd6-40fc-bd1a-379cfb009e29 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:45.786519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a53f78b-880d-4372-b7af-a2baab9dfb92 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:45.808384 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:45.854876 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e64b4-7981-475e-bc2d-d40da7609edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:45.855536 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e64b4-7981-475e-bc2d-d40da7609edc None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:45.855818 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e64b4-7981-475e-bc2d-d40da7609edc None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:45.856872 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063e64b4-7981-475e-bc2d-d40da7609edc None admin] PATH_INFO: `/v3/groups/1cc1afb6965549708d8b9b4339430192` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:45.860386 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e64b4-7981-475e-bc2d-d40da7609edc None admin] RBAC: Authorizing `identity:get_group(group_id=1cc1afb6965549708d8b9b4339430192)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:45.862561 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063e64b4-7981-475e-bc2d-d40da7609edc None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:45.864800 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033d25a-8fd6-40fc-bd1a-379cfb009e29 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:45.868444 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 200/398] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Jul 27 15:11:45 2022] GET /identity/v3/groups/1cc1afb6965549708d8b9b4339430192 => generated 226 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:45.881199 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e64b4-7981-475e-bc2d-d40da7609edc None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:45.942179 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf321a-1a6e-4b0f-ab0c-3fa64e0d4bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:45.942864 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf321a-1a6e-4b0f-ab0c-3fa64e0d4bb9 None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:45.943150 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf321a-1a6e-4b0f-ab0c-3fa64e0d4bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:45.943430 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf321a-1a6e-4b0f-ab0c-3fa64e0d4bb9 None admin] PATH_INFO: `/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70/groups/1cc1afb6965549708d8b9b4339430192/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:45.949290 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf321a-1a6e-4b0f-ab0c-3fa64e0d4bb9 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd46e34c8ff44b9abce25e0fd266ac70, group_id=1cc1afb6965549708d8b9b4339430192, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:45.951984 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf321a-1a6e-4b0f-ab0c-3fa64e0d4bb9 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:45.976340 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 199/399] 10.222.0.40 () {58 vars in 1442 bytes} [Wed Jul 27 15:11:45 2022] PUT /identity/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70/groups/1cc1afb6965549708d8b9b4339430192/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:11:46.040825 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063e64b4-7981-475e-bc2d-d40da7609edc None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:46.080427 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0203eb1-3b9a-43ad-a217-24e9187812ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:46.081510 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0203eb1-3b9a-43ad-a217-24e9187812ba None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:46.081992 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0203eb1-3b9a-43ad-a217-24e9187812ba None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:46.082502 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0203eb1-3b9a-43ad-a217-24e9187812ba None admin] PATH_INFO: `/v3/projects/db323e19e6ee4196a29be0d178ff0eb0` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:46.083924 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0203eb1-3b9a-43ad-a217-24e9187812ba None admin] RBAC: Authorizing `identity:get_project(project_id=db323e19e6ee4196a29be0d178ff0eb0)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:46.086408 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0203eb1-3b9a-43ad-a217-24e9187812ba None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:46.088437 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 201/400] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:45 2022] GET /identity/v3/projects/db323e19e6ee4196a29be0d178ff0eb0 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:46.094518 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf321a-1a6e-4b0f-ab0c-3fa64e0d4bb9 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:46.151738 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:46.207608 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf321a-1a6e-4b0f-ab0c-3fa64e0d4bb9 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:46.244302 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5133c2-9f55-4d6a-8da2-e91476ac2783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:46.245393 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5133c2-9f55-4d6a-8da2-e91476ac2783 None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:46.245874 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5133c2-9f55-4d6a-8da2-e91476ac2783 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:46.246376 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5133c2-9f55-4d6a-8da2-e91476ac2783 None admin] PATH_INFO: `/v3/projects/db323e19e6ee4196a29be0d178ff0eb0/groups/1cc1afb6965549708d8b9b4339430192/roles/ce7d7a296f4e448dbb11ded292818043` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:46.248828 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5133c2-9f55-4d6a-8da2-e91476ac2783 None admin] RBAC: Authorizing `identity:create_grant(project_id=db323e19e6ee4196a29be0d178ff0eb0, group_id=1cc1afb6965549708d8b9b4339430192, role_id=ce7d7a296f4e448dbb11ded292818043)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:46.250468 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5133c2-9f55-4d6a-8da2-e91476ac2783 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:46.270651 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 200/401] 10.222.0.40 () {58 vars in 1442 bytes} [Wed Jul 27 15:11:46 2022] PUT /identity/v3/projects/db323e19e6ee4196a29be0d178ff0eb0/groups/1cc1afb6965549708d8b9b4339430192/roles/ce7d7a296f4e448dbb11ded292818043 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:11:46.378620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b3143-b4ec-4b53-a994-2b0eb7bb41bc None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:46.379341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b3143-b4ec-4b53-a994-2b0eb7bb41bc None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:46.379817 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b3143-b4ec-4b53-a994-2b0eb7bb41bc None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:46.381397 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 202/402] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:46.387080 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2037ed-c5fc-40f4-8a1d-fb7d378307ab None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:46.387665 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2037ed-c5fc-40f4-8a1d-fb7d378307ab None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:46.388190 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2037ed-c5fc-40f4-8a1d-fb7d378307ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:46.408825 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-5c2037ed-c5fc-40f4-8a1d-fb7d378307ab None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:46.410422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5c2037ed-c5fc-40f4-8a1d-fb7d378307ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:46.499880 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 201/403] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:46.533519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b3143-b4ec-4b53-a994-2b0eb7bb41bc None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:46.601836 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:46.627053 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972b764-3800-4cd5-a6c2-83fa58cfb44b None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:46.627358 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972b764-3800-4cd5-a6c2-83fa58cfb44b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:46.627619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d972b764-3800-4cd5-a6c2-83fa58cfb44b None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:46.629108 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 202/404] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:11:46.636827 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb2454-4db7-4e7c-a6d3-8ca0f0eb8edf None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:46.637114 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb2454-4db7-4e7c-a6d3-8ca0f0eb8edf None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:46.637394 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb2454-4db7-4e7c-a6d3-8ca0f0eb8edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:46.666744 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-dfcb2454-4db7-4e7c-a6d3-8ca0f0eb8edf None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:46.668339 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-dfcb2454-4db7-4e7c-a6d3-8ca0f0eb8edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:46.708811 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b3143-b4ec-4b53-a994-2b0eb7bb41bc None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:46.727264 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:46.771596 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 203/405] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 15:11:46.780491 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a3d96-b2ca-4343-a284-9b4e6fac344a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:46.781150 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a3d96-b2ca-4343-a284-9b4e6fac344a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:46.781429 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a3d96-b2ca-4343-a284-9b4e6fac344a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:46.781701 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9a3d96-b2ca-4343-a284-9b4e6fac344a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:46.792713 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9a3d96-b2ca-4343-a284-9b4e6fac344a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:46.798087 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-7a9a3d96-b2ca-4343-a284-9b4e6fac344a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:11:46.798087 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:46.798087 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:46.798087 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:46.798087 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:46.798087 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:46.798087 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:46.798087 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:46.798087 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:46.798087 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:46.798087 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:46.798087 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:46.798087 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:46.798087 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:46.798087 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:46.798087 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:46.798972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:46.798972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:46.798972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:46.798972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:46.798972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:46.798972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:46.798972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:46.798972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:46.798972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:46.798972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:46.798972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:46.798972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:46.798972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:46.798972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:46.798972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:46.798972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:46.799839 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:46.799839 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:46.799839 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:46.799839 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:46.799839 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:46.799839 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:46.799839 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:46.799839 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:46.799839 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:46.799839 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:46.799839 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:11:46.799839 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:11:46.799839 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 203/406] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jul 27 15:11:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:46.809050 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb2454-4db7-4e7c-a6d3-8ca0f0eb8edf None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:46.817048 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a3d96-b2ca-4343-a284-9b4e6fac344a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:46.914692 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb2454-4db7-4e7c-a6d3-8ca0f0eb8edf None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:46.953522 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762edef-e39c-49c1-a406-368307dfded8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:46.954508 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762edef-e39c-49c1-a406-368307dfded8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:46.954990 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762edef-e39c-49c1-a406-368307dfded8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:46.955456 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762edef-e39c-49c1-a406-368307dfded8 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:46.956450 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8762edef-e39c-49c1-a406-368307dfded8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:46.956975 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8762edef-e39c-49c1-a406-368307dfded8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:46.958570 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8762edef-e39c-49c1-a406-368307dfded8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:46.967800 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 204/407] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:11:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:11:46.969585 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bac49-378b-4455-9141-697fd402df66 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:46.970071 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bac49-378b-4455-9141-697fd402df66 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:46.970552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0bac49-378b-4455-9141-697fd402df66 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:46.972228 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 205/408] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:46.973112 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0bac49-378b-4455-9141-697fd402df66 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:46.982499 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9a3d96-b2ca-4343-a284-9b4e6fac344a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:46.984974 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:47.008602 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:47.019793 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9fa649-9954-4251-aa66-32b183d927ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:47.020473 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fa649-9954-4251-aa66-32b183d927ca None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:47.020756 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fa649-9954-4251-aa66-32b183d927ca None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:47.021031 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9fa649-9954-4251-aa66-32b183d927ca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:47.032568 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9fa649-9954-4251-aa66-32b183d927ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:47.038044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-5f9fa649-9954-4251-aa66-32b183d927ca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 15:11:47.038044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:47.038044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:47.038044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:47.038044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:47.038044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:47.038044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:47.038044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:47.038044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:47.038044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:47.038044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:47.038044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:47.038044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:47.038044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:47.038044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:47.038044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:47.039623 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:47.039623 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:47.039623 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:47.039623 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:47.039623 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:47.039623 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:47.039623 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:47.039623 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:47.039623 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:47.039623 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:47.039623 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:47.039623 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:47.039623 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:47.039623 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:47.039623 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:47.039623 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:47.040432 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:47.040432 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:47.040432 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:47.040432 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:47.040432 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:47.040432 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:47.040432 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:47.040432 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:47.040432 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:47.040432 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:47.040432 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 15:11:47.040432 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:11:47.041452 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 204/409] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jul 27 15:11:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:11:47.046870 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb8308-fbaa-4214-8a32-d323e5a82b61 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:47.047158 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb8308-fbaa-4214-8a32-d323e5a82b61 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:47.047527 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb8308-fbaa-4214-8a32-d323e5a82b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:47.065157 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-fcfb8308-fbaa-4214-8a32-d323e5a82b61 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:47.066397 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-fcfb8308-fbaa-4214-8a32-d323e5a82b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:47.093736 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0bac49-378b-4455-9141-697fd402df66 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:47.130237 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd06f36-db86-423c-a96e-d9ce34369442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:47.131216 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd06f36-db86-423c-a96e-d9ce34369442 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:47.131697 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd06f36-db86-423c-a96e-d9ce34369442 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:47.132257 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd06f36-db86-423c-a96e-d9ce34369442 None admin] PATH_INFO: `/v3/groups/68fbe14af3e94475b2bc87815c159d2b` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:47.133654 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd06f36-db86-423c-a96e-d9ce34369442 None admin] RBAC: Authorizing `identity:get_group(group_id=68fbe14af3e94475b2bc87815c159d2b)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:47.139261 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd06f36-db86-423c-a96e-d9ce34369442 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:47.139400 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 205/410] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:47.140791 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb8308-fbaa-4214-8a32-d323e5a82b61 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:47.141869 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 206/411] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Jul 27 15:11:46 2022] GET /identity/v3/groups/68fbe14af3e94475b2bc87815c159d2b => generated 229 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:47.153606 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd06f36-db86-423c-a96e-d9ce34369442 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:47.239306 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:47.247678 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb8308-fbaa-4214-8a32-d323e5a82b61 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:47.283882 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:47.284086 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d094c6-7758-4ec5-b8a5-f66ae0737b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:47.284807 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d094c6-7758-4ec5-b8a5-f66ae0737b72 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:47.285111 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d094c6-7758-4ec5-b8a5-f66ae0737b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:47.285491 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d094c6-7758-4ec5-b8a5-f66ae0737b72 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:47.286277 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d094c6-7758-4ec5-b8a5-f66ae0737b72 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:47.286648 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d094c6-7758-4ec5-b8a5-f66ae0737b72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:47.288114 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d094c6-7758-4ec5-b8a5-f66ae0737b72 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:47.289835 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd06f36-db86-423c-a96e-d9ce34369442 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:47.296869 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 206/412] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:11:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:47.302158 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d094c6-7758-4ec5-b8a5-f66ae0737b72 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:47.342873 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d21890-81d0-43c3-8547-51623c7577a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:47.344117 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d21890-81d0-43c3-8547-51623c7577a7 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:47.344634 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d21890-81d0-43c3-8547-51623c7577a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:47.345100 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d21890-81d0-43c3-8547-51623c7577a7 None admin] PATH_INFO: `/v3/projects/0cee0118499d467da89c121f8970b184` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:47.347574 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d21890-81d0-43c3-8547-51623c7577a7 None admin] RBAC: Authorizing `identity:get_project(project_id=0cee0118499d467da89c121f8970b184)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:47.349235 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d21890-81d0-43c3-8547-51623c7577a7 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:47.356621 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 207/413] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:47 2022] GET /identity/v3/projects/0cee0118499d467da89c121f8970b184 => generated 344 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:11:47.356917 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d21890-81d0-43c3-8547-51623c7577a7 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:47.431778 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d094c6-7758-4ec5-b8a5-f66ae0737b72 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:47.470364 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c352c25-d137-484b-b1f3-6ec13f262023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:47.471218 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c352c25-d137-484b-b1f3-6ec13f262023 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:47.471352 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c352c25-d137-484b-b1f3-6ec13f262023 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:47.471542 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c352c25-d137-484b-b1f3-6ec13f262023 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:47.483134 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c352c25-d137-484b-b1f3-6ec13f262023 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:47.488719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-5c352c25-d137-484b-b1f3-6ec13f262023 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 15:11:47.488719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:47.488719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:47.488719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:47.488719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:47.488719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:47.488719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:47.488719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:47.488719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:47.488719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:47.488719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:47.488719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:47.488719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:47.488719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:47.488719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:47.488719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:47.489663 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:47.489663 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:47.489663 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:47.489663 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:47.489663 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:47.489663 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:47.489663 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:47.489663 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:47.489663 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:47.489663 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:47.489663 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:47.489663 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:47.489663 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:47.489663 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:47.489663 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:47.489663 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:47.490482 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:47.490482 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:47.490482 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:47.490482 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:47.490482 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:47.490482 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:47.490482 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:47.490482 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:47.490482 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:47.490482 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:47.490482 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 15:11:47.490482 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:11:47.490482 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 207/414] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:11:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:47.491143 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c352c25-d137-484b-b1f3-6ec13f262023 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:47.506286 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d21890-81d0-43c3-8547-51623c7577a7 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:47.518989 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:47.545031 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831bbec-4921-4a48-8348-312f52cba78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:47.545760 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831bbec-4921-4a48-8348-312f52cba78d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:47.546112 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831bbec-4921-4a48-8348-312f52cba78d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:47.546502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831bbec-4921-4a48-8348-312f52cba78d None admin] PATH_INFO: `/v3/groups/1cc1afb6965549708d8b9b4339430192` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:47.547777 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831bbec-4921-4a48-8348-312f52cba78d None admin] RBAC: Authorizing `identity:get_group(group_id=1cc1afb6965549708d8b9b4339430192)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:47.549428 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831bbec-4921-4a48-8348-312f52cba78d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:47.551597 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 208/415] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Jul 27 15:11:47 2022] GET /identity/v3/groups/1cc1afb6965549708d8b9b4339430192 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:47.552586 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831bbec-4921-4a48-8348-312f52cba78d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:47.595348 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:47.640492 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c352c25-d137-484b-b1f3-6ec13f262023 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:47.670402 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831bbec-4921-4a48-8348-312f52cba78d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:47.685621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c259f-43aa-4d1a-a770-986d7d288468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:47.686301 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c259f-43aa-4d1a-a770-986d7d288468 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:47.686586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c259f-43aa-4d1a-a770-986d7d288468 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:47.686865 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4c259f-43aa-4d1a-a770-986d7d288468 None admin] PATH_INFO: `/v3/projects/0cee0118499d467da89c121f8970b184/groups/68fbe14af3e94475b2bc87815c159d2b/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:47.689304 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c259f-43aa-4d1a-a770-986d7d288468 None admin] RBAC: Authorizing `identity:create_grant(project_id=0cee0118499d467da89c121f8970b184, group_id=68fbe14af3e94475b2bc87815c159d2b, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:47.691023 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4c259f-43aa-4d1a-a770-986d7d288468 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:47.716061 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 208/416] 10.222.0.40 () {58 vars in 1442 bytes} [Wed Jul 27 15:11:47 2022] PUT /identity/v3/projects/0cee0118499d467da89c121f8970b184/groups/68fbe14af3e94475b2bc87815c159d2b/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:11:47.716061 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c259f-43aa-4d1a-a770-986d7d288468 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:47.716611 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be3f63-e0b2-4218-8859-928aa9bdd138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:47.717638 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be3f63-e0b2-4218-8859-928aa9bdd138 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:47.718150 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be3f63-e0b2-4218-8859-928aa9bdd138 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:47.718706 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6be3f63-e0b2-4218-8859-928aa9bdd138 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:47.719749 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be3f63-e0b2-4218-8859-928aa9bdd138 None admin] RBAC: Adding query filter params (name=member) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:47.720322 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be3f63-e0b2-4218-8859-928aa9bdd138 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:47.722044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6be3f63-e0b2-4218-8859-928aa9bdd138 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:47.738635 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 209/417] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jul 27 15:11:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:47.745624 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be3f63-e0b2-4218-8859-928aa9bdd138 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:47.854802 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:47.909016 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4c259f-43aa-4d1a-a770-986d7d288468 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:47.937840 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:47.943850 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6be3f63-e0b2-4218-8859-928aa9bdd138 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:47.963930 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224fb2d-7466-4abf-b571-d2a2ba817c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:47.965030 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224fb2d-7466-4abf-b571-d2a2ba817c04 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:47.965321 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224fb2d-7466-4abf-b571-d2a2ba817c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:47.965601 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f224fb2d-7466-4abf-b571-d2a2ba817c04 None admin] PATH_INFO: `/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:47.967014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224fb2d-7466-4abf-b571-d2a2ba817c04 None admin] RBAC: Authorizing `identity:get_project(project_id=cd46e34c8ff44b9abce25e0fd266ac70)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:47.968546 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f224fb2d-7466-4abf-b571-d2a2ba817c04 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:47.971084 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 209/418] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:47 2022] GET /identity/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70 => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:47.978203 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224fb2d-7466-4abf-b571-d2a2ba817c04 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:47.990176 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c82402-8515-49f4-8b2a-ad677c375055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:47.991115 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c82402-8515-49f4-8b2a-ad677c375055 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:47.991693 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c82402-8515-49f4-8b2a-ad677c375055 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:47.992206 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c82402-8515-49f4-8b2a-ad677c375055 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:48.090144 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c82402-8515-49f4-8b2a-ad677c375055 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:48.091970 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c82402-8515-49f4-8b2a-ad677c375055 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:48.093851 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f224fb2d-7466-4abf-b571-d2a2ba817c04 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:48.130704 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b9c16-455d-4b7e-914a-ec126c7bdc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:48.131413 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b9c16-455d-4b7e-914a-ec126c7bdc30 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:48.131696 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b9c16-455d-4b7e-914a-ec126c7bdc30 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:48.132510 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b9c16-455d-4b7e-914a-ec126c7bdc30 None admin] PATH_INFO: `/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70/groups/1cc1afb6965549708d8b9b4339430192/roles/ce7d7a296f4e448dbb11ded292818043` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:48.134812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b9c16-455d-4b7e-914a-ec126c7bdc30 None admin] RBAC: Authorizing `identity:create_grant(project_id=cd46e34c8ff44b9abce25e0fd266ac70, group_id=1cc1afb6965549708d8b9b4339430192, role_id=ce7d7a296f4e448dbb11ded292818043)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:48.136280 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b9c16-455d-4b7e-914a-ec126c7bdc30 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:48.162950 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 210/419] 10.222.0.40 () {58 vars in 1442 bytes} [Wed Jul 27 15:11:47 2022] PUT /identity/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70/groups/1cc1afb6965549708d8b9b4339430192/roles/ce7d7a296f4e448dbb11ded292818043 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:11:48.257932 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:48.263496 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 210/420] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:11:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 15:11:48.269775 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b9c16-455d-4b7e-914a-ec126c7bdc30 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:48.274527 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:48.439393 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b9c16-455d-4b7e-914a-ec126c7bdc30 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:48.477851 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a022af8-67dd-4d45-8ade-336b1ce69887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:48.478863 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a022af8-67dd-4d45-8ade-336b1ce69887 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:48.479348 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a022af8-67dd-4d45-8ade-336b1ce69887 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:48.479844 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a022af8-67dd-4d45-8ade-336b1ce69887 None admin] PATH_INFO: `/v3/projects/db323e19e6ee4196a29be0d178ff0eb0` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:48.481245 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a022af8-67dd-4d45-8ade-336b1ce69887 None admin] RBAC: Authorizing `identity:get_project(project_id=db323e19e6ee4196a29be0d178ff0eb0)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:48.482900 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a022af8-67dd-4d45-8ade-336b1ce69887 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:48.485087 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 211/421] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:48 2022] GET /identity/v3/projects/db323e19e6ee4196a29be0d178ff0eb0 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:48.490842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c82402-8515-49f4-8b2a-ad677c375055 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:48.503096 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a7f49-63da-4358-8070-6ba48a0e6527 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:48.503401 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a7f49-63da-4358-8070-6ba48a0e6527 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:48.503657 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a7f49-63da-4358-8070-6ba48a0e6527 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:48.505399 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 212/422] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:48.515414 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2f6da-7cae-49f1-bbfe-83cb6dcbc445 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:48.515699 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2f6da-7cae-49f1-bbfe-83cb6dcbc445 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:48.515982 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2f6da-7cae-49f1-bbfe-83cb6dcbc445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:48.543363 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-18b2f6da-7cae-49f1-bbfe-83cb6dcbc445 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:48.544715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-18b2f6da-7cae-49f1-bbfe-83cb6dcbc445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:48.636414 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c82402-8515-49f4-8b2a-ad677c375055 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:48.641024 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 213/423] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:48.642535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b759a3c-c8cf-48f3-a85d-3d0ac684143d None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:48.643019 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b759a3c-c8cf-48f3-a85d-3d0ac684143d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:48.643504 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b759a3c-c8cf-48f3-a85d-3d0ac684143d None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:48.645206 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 214/424] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:48.650536 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531f82c-1c03-4e1b-b038-de67f2c1ad3f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:48.651042 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531f82c-1c03-4e1b-b038-de67f2c1ad3f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:48.651525 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531f82c-1c03-4e1b-b038-de67f2c1ad3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:48.659874 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:48.675531 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-0531f82c-1c03-4e1b-b038-de67f2c1ad3f None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:48.677472 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0531f82c-1c03-4e1b-b038-de67f2c1ad3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:48.696245 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ec88a-b1e8-4c23-b012-6249f5dafb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:48.696809 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ec88a-b1e8-4c23-b012-6249f5dafb45 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:48.697092 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ec88a-b1e8-4c23-b012-6249f5dafb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:48.697371 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ec88a-b1e8-4c23-b012-6249f5dafb45 None admin] PATH_INFO: `/v3/groups/1cc1afb6965549708d8b9b4339430192` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:48.698534 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ec88a-b1e8-4c23-b012-6249f5dafb45 None admin] RBAC: Authorizing `identity:get_group(group_id=1cc1afb6965549708d8b9b4339430192)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:48.699977 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01ec88a-b1e8-4c23-b012-6249f5dafb45 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:48.701992 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 211/425] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Jul 27 15:11:48 2022] GET /identity/v3/groups/1cc1afb6965549708d8b9b4339430192 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:48.702714 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ec88a-b1e8-4c23-b012-6249f5dafb45 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:48.776013 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 215/426] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 15:11:48.776013 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531f82c-1c03-4e1b-b038-de67f2c1ad3f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:48.785084 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:48.835030 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ec88a-b1e8-4c23-b012-6249f5dafb45 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:48.870244 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206c0e5-1305-4435-ba30-d41c7394f381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:48.870893 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206c0e5-1305-4435-ba30-d41c7394f381 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:48.871175 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206c0e5-1305-4435-ba30-d41c7394f381 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:48.871453 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206c0e5-1305-4435-ba30-d41c7394f381 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:48.882743 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206c0e5-1305-4435-ba30-d41c7394f381 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:48.888201 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-5206c0e5-1305-4435-ba30-d41c7394f381 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 15:11:48.888201 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:48.888201 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:48.888201 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:48.888201 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:48.888201 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:48.888201 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:48.888201 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:48.888201 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:48.888201 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:48.888201 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:48.888201 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:48.888201 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:48.888201 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:48.888201 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:48.888201 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:48.889128 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:48.889128 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:48.889128 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:48.889128 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:48.889128 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:48.889128 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:48.889128 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:48.889128 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:48.889128 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:48.889128 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:48.889128 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:48.889128 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:48.889128 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:48.889128 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:48.889128 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:48.889128 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:48.889905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:48.889905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:48.889905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:48.889905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:48.889905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:48.889905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:48.889905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:48.889905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:48.889905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:48.889905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:48.889905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 15:11:48.889905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:11:48.889905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 212/427] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:11:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:48.890600 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206c0e5-1305-4435-ba30-d41c7394f381 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:48.915379 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531f82c-1c03-4e1b-b038-de67f2c1ad3f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:48.949163 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:48.957117 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c6001-444f-4373-8b71-463a3adca59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:48.958228 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c6001-444f-4373-8b71-463a3adca59a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:48.959259 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c6001-444f-4373-8b71-463a3adca59a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:48.959741 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75c6001-444f-4373-8b71-463a3adca59a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:48.961047 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c6001-444f-4373-8b71-463a3adca59a None admin] RBAC: Adding query filter params (group.id=1cc1afb6965549708d8b9b4339430192, role.id=05b155ad77f0416a85b84ab318160c53, scope.project.id=db323e19e6ee4196a29be0d178ff0eb0) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:48.961831 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c6001-444f-4373-8b71-463a3adca59a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:48.964418 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75c6001-444f-4373-8b71-463a3adca59a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:48.971775 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 216/428] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Jul 27 15:11:48 2022] GET /identity/v3/role_assignments?group.id=1cc1afb6965549708d8b9b4339430192&scope.project.id=db323e19e6ee4196a29be0d178ff0eb0&role.id=05b155ad77f0416a85b84ab318160c53 => generated 611 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:48.972831 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c6001-444f-4373-8b71-463a3adca59a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:49.002589 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206c0e5-1305-4435-ba30-d41c7394f381 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:49.037904 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:49.050793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51cdaf0-f2fd-40f8-81fd-d7cede63a1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:49.051472 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cdaf0-f2fd-40f8-81fd-d7cede63a1d1 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:49.051753 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cdaf0-f2fd-40f8-81fd-d7cede63a1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:49.052050 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51cdaf0-f2fd-40f8-81fd-d7cede63a1d1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:49.068428 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51cdaf0-f2fd-40f8-81fd-d7cede63a1d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:49.076649 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-e51cdaf0-f2fd-40f8-81fd-d7cede63a1d1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 15:11:49.076649 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:49.076649 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:49.076649 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:49.076649 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:49.076649 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:49.076649 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:49.076649 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:49.076649 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:49.076649 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:49.076649 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:49.076649 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:49.076649 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:49.076649 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:49.076649 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:49.076649 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:49.077622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:49.077622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:49.077622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:49.077622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:49.077622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:49.077622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:49.077622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:49.077622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:49.077622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:49.077622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:49.077622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:49.077622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:49.077622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:49.077622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:49.077622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:49.077622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:49.078431 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:49.078431 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:49.078431 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:49.078431 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:49.078431 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:49.078431 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:49.078431 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:49.078431 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:49.078431 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:49.078431 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:49.078431 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 15:11:49.078431 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:11:49.081752 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 213/429] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jul 27 15:11:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:49.091225 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51cdaf0-f2fd-40f8-81fd-d7cede63a1d1 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:49.150578 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75c6001-444f-4373-8b71-463a3adca59a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:49.227215 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07824af4-cc9a-4ef4-8899-435763619ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:49.227755 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07824af4-cc9a-4ef4-8899-435763619ead None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:49.228052 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07824af4-cc9a-4ef4-8899-435763619ead None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:49.228333 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07824af4-cc9a-4ef4-8899-435763619ead None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:49.229054 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07824af4-cc9a-4ef4-8899-435763619ead None admin] RBAC: Adding query filter params (name=member) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:49.229363 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07824af4-cc9a-4ef4-8899-435763619ead None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:49.230723 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07824af4-cc9a-4ef4-8899-435763619ead None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:49.240593 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 217/430] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jul 27 15:11:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:49.247463 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07824af4-cc9a-4ef4-8899-435763619ead None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:49.253904 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51cdaf0-f2fd-40f8-81fd-d7cede63a1d1 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:49.298611 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5641668-d1db-4619-8809-bd94d4623a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:49.299803 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5641668-d1db-4619-8809-bd94d4623a1e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:49.300284 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5641668-d1db-4619-8809-bd94d4623a1e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:49.300875 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5641668-d1db-4619-8809-bd94d4623a1e None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:49.302103 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5641668-d1db-4619-8809-bd94d4623a1e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:49.302597 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5641668-d1db-4619-8809-bd94d4623a1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:49.304698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5641668-d1db-4619-8809-bd94d4623a1e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:49.312484 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:49.316957 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 214/431] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:11:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:49.323559 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5641668-d1db-4619-8809-bd94d4623a1e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:49.368880 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07824af4-cc9a-4ef4-8899-435763619ead None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:49.384238 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:49.414707 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4e6a7-3a0b-4fc8-a2be-b6c5ab3b505c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:49.414943 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4e6a7-3a0b-4fc8-a2be-b6c5ab3b505c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:49.415170 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4e6a7-3a0b-4fc8-a2be-b6c5ab3b505c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:49.415349 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4e6a7-3a0b-4fc8-a2be-b6c5ab3b505c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:49.456901 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5641668-d1db-4619-8809-bd94d4623a1e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:49.492564 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667ae49-4812-4563-86dd-08fd80373e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:49.493511 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667ae49-4812-4563-86dd-08fd80373e9b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:49.494010 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667ae49-4812-4563-86dd-08fd80373e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:49.494481 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c667ae49-4812-4563-86dd-08fd80373e9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:49.494652 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4e6a7-3a0b-4fc8-a2be-b6c5ab3b505c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:49.496134 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4e6a7-3a0b-4fc8-a2be-b6c5ab3b505c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:49.561057 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:49.571253 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c667ae49-4812-4563-86dd-08fd80373e9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:49.573170 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c667ae49-4812-4563-86dd-08fd80373e9b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:49.612687 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 218/432] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:11:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 15:11:49.618813 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4e6a7-3a0b-4fc8-a2be-b6c5ab3b505c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:49.626639 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:49.683772 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 215/433] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:11:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 15:11:49.690050 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667ae49-4812-4563-86dd-08fd80373e9b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:49.732974 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4e6a7-3a0b-4fc8-a2be-b6c5ab3b505c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:49.770530 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e13a5-cf91-45f3-b68d-32309f7013f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:49.770530 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e13a5-cf91-45f3-b68d-32309f7013f0 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:49.770799 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e13a5-cf91-45f3-b68d-32309f7013f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:49.771023 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2e13a5-cf91-45f3-b68d-32309f7013f0 None admin] PATH_INFO: `/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:49.772197 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2e13a5-cf91-45f3-b68d-32309f7013f0 None admin] RBAC: Authorizing `identity:get_project(project_id=cd46e34c8ff44b9abce25e0fd266ac70)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:49.773681 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2e13a5-cf91-45f3-b68d-32309f7013f0 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:49.775651 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 219/434] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:49 2022] GET /identity/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:49.781063 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e13a5-cf91-45f3-b68d-32309f7013f0 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:49.805100 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c667ae49-4812-4563-86dd-08fd80373e9b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:49.810264 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:49.843167 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c90a27-40e2-4a66-b8e3-45210fa093ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:49.844206 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c90a27-40e2-4a66-b8e3-45210fa093ed None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:49.844692 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c90a27-40e2-4a66-b8e3-45210fa093ed None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:49.845165 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c90a27-40e2-4a66-b8e3-45210fa093ed None admin] PATH_INFO: `/v3/projects/db323e19e6ee4196a29be0d178ff0eb0` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:49.846552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c90a27-40e2-4a66-b8e3-45210fa093ed None admin] RBAC: Authorizing `identity:get_project(project_id=db323e19e6ee4196a29be0d178ff0eb0)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:49.848193 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c90a27-40e2-4a66-b8e3-45210fa093ed None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:49.850350 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 216/435] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:49 2022] GET /identity/v3/projects/db323e19e6ee4196a29be0d178ff0eb0 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:49.859195 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c90a27-40e2-4a66-b8e3-45210fa093ed None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:49.878696 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:49.889387 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2e13a5-cf91-45f3-b68d-32309f7013f0 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:49.925951 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3c6f4-0fca-421c-8fff-5566f4d92c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:49.926636 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3c6f4-0fca-421c-8fff-5566f4d92c36 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:49.926923 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3c6f4-0fca-421c-8fff-5566f4d92c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:49.927206 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3c6f4-0fca-421c-8fff-5566f4d92c36 None admin] PATH_INFO: `/v3/groups/1cc1afb6965549708d8b9b4339430192` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:49.928426 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3c6f4-0fca-421c-8fff-5566f4d92c36 None admin] RBAC: Authorizing `identity:get_group(group_id=1cc1afb6965549708d8b9b4339430192)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:49.929916 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3c6f4-0fca-421c-8fff-5566f4d92c36 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:49.931531 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 220/436] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Jul 27 15:11:49 2022] GET /identity/v3/groups/1cc1afb6965549708d8b9b4339430192 => generated 226 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:11:49.937338 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3c6f4-0fca-421c-8fff-5566f4d92c36 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:49.971228 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c90a27-40e2-4a66-b8e3-45210fa093ed None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:50.010186 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ea7a0-a95e-4b43-8636-8d762f4aa7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:50.011601 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ea7a0-a95e-4b43-8636-8d762f4aa7dd None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:50.012133 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ea7a0-a95e-4b43-8636-8d762f4aa7dd None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:50.012640 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18ea7a0-a95e-4b43-8636-8d762f4aa7dd None admin] PATH_INFO: `/v3/groups/1cc1afb6965549708d8b9b4339430192` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:50.014414 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ea7a0-a95e-4b43-8636-8d762f4aa7dd None admin] RBAC: Authorizing `identity:get_group(group_id=1cc1afb6965549708d8b9b4339430192)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:50.016700 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18ea7a0-a95e-4b43-8636-8d762f4aa7dd None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:50.018529 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 217/437] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Jul 27 15:11:49 2022] GET /identity/v3/groups/1cc1afb6965549708d8b9b4339430192 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:11:50.025111 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ea7a0-a95e-4b43-8636-8d762f4aa7dd None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:50.047808 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3c6f4-0fca-421c-8fff-5566f4d92c36 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:50.052339 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:50.087230 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2708cf31-cea2-4b55-99b7-d7f1aeaa2475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:50.087845 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708cf31-cea2-4b55-99b7-d7f1aeaa2475 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:50.088168 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708cf31-cea2-4b55-99b7-d7f1aeaa2475 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:50.088447 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2708cf31-cea2-4b55-99b7-d7f1aeaa2475 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:50.089672 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708cf31-cea2-4b55-99b7-d7f1aeaa2475 None admin] RBAC: Adding query filter params (group.id=1cc1afb6965549708d8b9b4339430192, role.id=05b155ad77f0416a85b84ab318160c53, scope.project.id=cd46e34c8ff44b9abce25e0fd266ac70) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:50.089672 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708cf31-cea2-4b55-99b7-d7f1aeaa2475 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:50.093678 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2708cf31-cea2-4b55-99b7-d7f1aeaa2475 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:50.097530 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 221/438] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Jul 27 15:11:49 2022] GET /identity/v3/role_assignments?group.id=1cc1afb6965549708d8b9b4339430192&scope.project.id=cd46e34c8ff44b9abce25e0fd266ac70&role.id=05b155ad77f0416a85b84ab318160c53 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:11:50.098832 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981a509-8411-45ed-b587-35de1380bbd5 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:50.099408 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981a509-8411-45ed-b587-35de1380bbd5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:50.099689 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981a509-8411-45ed-b587-35de1380bbd5 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:50.101583 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 222/439] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:50.107125 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c919b1-5626-4fa4-ad86-33627e4e2627 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:50.107424 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c919b1-5626-4fa4-ad86-33627e4e2627 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:50.107691 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c919b1-5626-4fa4-ad86-33627e4e2627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:50.127376 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-02c919b1-5626-4fa4-ad86-33627e4e2627 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:50.128656 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-02c919b1-5626-4fa4-ad86-33627e4e2627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:50.135434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:50.157784 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18ea7a0-a95e-4b43-8636-8d762f4aa7dd None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:50.196942 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2e7be-df7a-48fd-8fdf-24a2736b22f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:50.197578 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2e7be-df7a-48fd-8fdf-24a2736b22f3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:50.197943 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2e7be-df7a-48fd-8fdf-24a2736b22f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:50.198223 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b2e7be-df7a-48fd-8fdf-24a2736b22f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:50.199037 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b2e7be-df7a-48fd-8fdf-24a2736b22f3 None admin] RBAC: Adding query filter params (group.id=1cc1afb6965549708d8b9b4339430192, role.id=ce7d7a296f4e448dbb11ded292818043, scope.project.id=db323e19e6ee4196a29be0d178ff0eb0) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:50.199348 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b2e7be-df7a-48fd-8fdf-24a2736b22f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:50.200863 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b2e7be-df7a-48fd-8fdf-24a2736b22f3 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:50.205794 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 223/440] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 15:11:50.216230 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 218/441] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Jul 27 15:11:50 2022] GET /identity/v3/role_assignments?group.id=1cc1afb6965549708d8b9b4339430192&scope.project.id=db323e19e6ee4196a29be0d178ff0eb0&role.id=ce7d7a296f4e448dbb11ded292818043 => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:11:50.231469 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c919b1-5626-4fa4-ad86-33627e4e2627 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:50.340133 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:50.355948 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c919b1-5626-4fa4-ad86-33627e4e2627 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:50.393252 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7bad8-3745-4383-b14c-9016f2f6d108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:50.393900 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7bad8-3745-4383-b14c-9016f2f6d108 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:50.394179 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7bad8-3745-4383-b14c-9016f2f6d108 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:50.394453 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7bad8-3745-4383-b14c-9016f2f6d108 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:50.406834 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7bad8-3745-4383-b14c-9016f2f6d108 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:50.411797 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-fad7bad8-3745-4383-b14c-9016f2f6d108 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:11:50.411797 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:50.411797 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:50.411797 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:50.411797 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:50.411797 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:50.411797 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:50.411797 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:50.411797 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:50.411797 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:50.411797 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:50.411797 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:50.411797 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:50.411797 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:50.411797 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:50.411797 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:50.412895 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:50.412895 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:50.412895 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:50.412895 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:50.412895 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:50.412895 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:50.412895 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:50.412895 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:50.412895 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:50.412895 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:50.412895 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:50.412895 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:50.412895 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:50.412895 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:50.412895 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:50.412895 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:50.414107 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:50.414107 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:50.414107 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:50.414107 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:50.414107 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:50.414107 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:50.414107 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:50.414107 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:50.414107 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:50.414107 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:50.414107 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:11:50.414107 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:11:50.414107 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 224/442] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jul 27 15:11:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:50.419030 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2e7be-df7a-48fd-8fdf-24a2736b22f3 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:50.527717 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b2e7be-df7a-48fd-8fdf-24a2736b22f3 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:50.564574 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacda59a-93eb-4fdd-9528-72496a3cfd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:50.565250 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacda59a-93eb-4fdd-9528-72496a3cfd2c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:50.565534 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacda59a-93eb-4fdd-9528-72496a3cfd2c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:50.565809 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacda59a-93eb-4fdd-9528-72496a3cfd2c None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:50.566533 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacda59a-93eb-4fdd-9528-72496a3cfd2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:50.566844 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacda59a-93eb-4fdd-9528-72496a3cfd2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:50.568254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacda59a-93eb-4fdd-9528-72496a3cfd2c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:50.576590 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238aab28-8764-4d94-b9bd-2d212120564c None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:50.576908 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238aab28-8764-4d94-b9bd-2d212120564c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:50.577208 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238aab28-8764-4d94-b9bd-2d212120564c None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:50.578187 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 219/443] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:11:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:50.578940 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 225/444] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:50.584191 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e53b8d-703a-419f-baeb-206ba72f452d None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:50.584480 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e53b8d-703a-419f-baeb-206ba72f452d None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:50.584675 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238aab28-8764-4d94-b9bd-2d212120564c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:50.584789 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e53b8d-703a-419f-baeb-206ba72f452d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:50.606347 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-05e53b8d-703a-419f-baeb-206ba72f452d None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:50.607733 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-05e53b8d-703a-419f-baeb-206ba72f452d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:50.612402 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:50.687321 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 220/445] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 15:11:50.710938 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e53b8d-703a-419f-baeb-206ba72f452d None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:50.723853 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238aab28-8764-4d94-b9bd-2d212120564c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:50.763553 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6608a6-b8c7-477f-833a-428721ab08a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:50.764227 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6608a6-b8c7-477f-833a-428721ab08a2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:50.765216 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6608a6-b8c7-477f-833a-428721ab08a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:50.765216 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6608a6-b8c7-477f-833a-428721ab08a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:50.784691 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:50.828949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e53b8d-703a-419f-baeb-206ba72f452d None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:50.834448 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6608a6-b8c7-477f-833a-428721ab08a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:50.836469 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6608a6-b8c7-477f-833a-428721ab08a2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:50.862432 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621719b0-5578-4286-9593-c4c2a28e5450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:50.862991 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621719b0-5578-4286-9593-c4c2a28e5450 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:50.863276 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621719b0-5578-4286-9593-c4c2a28e5450 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:50.863550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621719b0-5578-4286-9593-c4c2a28e5450 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:50.870838 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:50.874432 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621719b0-5578-4286-9593-c4c2a28e5450 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:50.879581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-621719b0-5578-4286-9593-c4c2a28e5450 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 15:11:50.879581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:50.879581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:50.879581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:50.879581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:50.879581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:50.879581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:50.879581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:50.879581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:50.879581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:50.879581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:50.879581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:50.879581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:50.879581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:50.879581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:50.879581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:50.880698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:50.880698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:50.880698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:50.880698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:50.880698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:50.880698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:50.880698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:50.880698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:50.880698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:50.880698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:50.880698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:50.880698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:50.880698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:50.880698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:50.880698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:50.880698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:50.881637 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:50.881637 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:50.881637 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:50.881637 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:50.881637 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:50.881637 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:50.881637 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:50.881637 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:50.881637 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:50.881637 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:50.881637 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 15:11:50.881637 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:11:50.885722 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 221/446] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jul 27 15:11:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:11:50.886561 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621719b0-5578-4286-9593-c4c2a28e5450 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:50.933910 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 226/447] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:11:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 15:11:50.939288 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6608a6-b8c7-477f-833a-428721ab08a2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:50.984963 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621719b0-5578-4286-9593-c4c2a28e5450 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:50.985826 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:51.017687 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0899d-30e6-41d8-a127-911819273eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:51.018303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0899d-30e6-41d8-a127-911819273eae None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:51.018589 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0899d-30e6-41d8-a127-911819273eae None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:51.018865 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff0899d-30e6-41d8-a127-911819273eae None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:51.019575 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff0899d-30e6-41d8-a127-911819273eae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:51.019882 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff0899d-30e6-41d8-a127-911819273eae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:51.021279 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff0899d-30e6-41d8-a127-911819273eae None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:51.029595 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 222/448] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:11:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:11:51.034984 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0899d-30e6-41d8-a127-911819273eae None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:51.037240 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6608a6-b8c7-477f-833a-428721ab08a2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:51.075234 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b945e23-052a-4c10-8b47-0819803975c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:51.075234 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b945e23-052a-4c10-8b47-0819803975c1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:51.075234 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b945e23-052a-4c10-8b47-0819803975c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:51.075234 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b945e23-052a-4c10-8b47-0819803975c1 None admin] PATH_INFO: `/v3/projects/0cee0118499d467da89c121f8970b184` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:51.077894 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b945e23-052a-4c10-8b47-0819803975c1 None admin] RBAC: Authorizing `identity:get_project(project_id=0cee0118499d467da89c121f8970b184)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:51.079319 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b945e23-052a-4c10-8b47-0819803975c1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:51.081974 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 227/449] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:50 2022] GET /identity/v3/projects/0cee0118499d467da89c121f8970b184 => generated 344 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:11:51.087943 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b945e23-052a-4c10-8b47-0819803975c1 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:51.109321 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:51.149009 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff0899d-30e6-41d8-a127-911819273eae None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:51.183014 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b320ef-17fc-4696-84dd-9e57f522a1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:51.183628 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b320ef-17fc-4696-84dd-9e57f522a1c2 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:51.183904 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b320ef-17fc-4696-84dd-9e57f522a1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:51.184214 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b320ef-17fc-4696-84dd-9e57f522a1c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:51.188929 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b945e23-052a-4c10-8b47-0819803975c1 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:51.205361 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:51.224524 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0b11b-376d-45e9-a53f-1e9472ce54a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:51.225231 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0b11b-376d-45e9-a53f-1e9472ce54a4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:51.225534 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0b11b-376d-45e9-a53f-1e9472ce54a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:51.225821 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0b11b-376d-45e9-a53f-1e9472ce54a4 None admin] PATH_INFO: `/v3/groups/68fbe14af3e94475b2bc87815c159d2b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:51.226973 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0b11b-376d-45e9-a53f-1e9472ce54a4 None admin] RBAC: Authorizing `identity:get_group(group_id=68fbe14af3e94475b2bc87815c159d2b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:51.228431 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0b11b-376d-45e9-a53f-1e9472ce54a4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:51.230019 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 228/450] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Jul 27 15:11:51 2022] GET /identity/v3/groups/68fbe14af3e94475b2bc87815c159d2b => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:11:51.235692 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0b11b-376d-45e9-a53f-1e9472ce54a4 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:51.251411 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b320ef-17fc-4696-84dd-9e57f522a1c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:51.252922 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b320ef-17fc-4696-84dd-9e57f522a1c2 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:51.312429 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:51.335948 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0b11b-376d-45e9-a53f-1e9472ce54a4 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:51.352613 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 223/451] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:11:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 15:11:51.358145 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b320ef-17fc-4696-84dd-9e57f522a1c2 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:51.372749 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dac54a-7962-4a33-83c9-e43da4464321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:51.373369 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dac54a-7962-4a33-83c9-e43da4464321 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:51.373650 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dac54a-7962-4a33-83c9-e43da4464321 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:51.374804 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dac54a-7962-4a33-83c9-e43da4464321 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:51.375610 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dac54a-7962-4a33-83c9-e43da4464321 None admin] RBAC: Adding query filter params (group.id=68fbe14af3e94475b2bc87815c159d2b, role.id=6535f8b98008471dba33e89bd460880d, scope.project.id=0cee0118499d467da89c121f8970b184) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:51.375926 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dac54a-7962-4a33-83c9-e43da4464321 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:51.377415 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dac54a-7962-4a33-83c9-e43da4464321 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:51.385097 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 229/452] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Jul 27 15:11:51 2022] GET /identity/v3/role_assignments?group.id=68fbe14af3e94475b2bc87815c159d2b&scope.project.id=0cee0118499d467da89c121f8970b184&role.id=6535f8b98008471dba33e89bd460880d => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:11:51.463495 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b320ef-17fc-4696-84dd-9e57f522a1c2 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:51.497701 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb5725-6bf0-4618-96e8-05e783591645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:51.498354 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb5725-6bf0-4618-96e8-05e783591645 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:51.498633 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb5725-6bf0-4618-96e8-05e783591645 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:51.498905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fb5725-6bf0-4618-96e8-05e783591645 None admin] PATH_INFO: `/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:51.500140 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fb5725-6bf0-4618-96e8-05e783591645 None admin] RBAC: Authorizing `identity:get_project(project_id=cd46e34c8ff44b9abce25e0fd266ac70)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:51.501591 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fb5725-6bf0-4618-96e8-05e783591645 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:51.503283 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 224/453] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:11:51 2022] GET /identity/v3/projects/cd46e34c8ff44b9abce25e0fd266ac70 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:11:51.509447 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dac54a-7962-4a33-83c9-e43da4464321 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:51.561260 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:51.616952 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dac54a-7962-4a33-83c9-e43da4464321 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:51.649762 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd666f-493d-44b3-bb3c-e863ffbb7b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:51.650390 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd666f-493d-44b3-bb3c-e863ffbb7b49 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:51.650677 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd666f-493d-44b3-bb3c-e863ffbb7b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:51.650955 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd666f-493d-44b3-bb3c-e863ffbb7b49 None admin] PATH_INFO: `/v3/groups/1cc1afb6965549708d8b9b4339430192` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:51.652134 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd666f-493d-44b3-bb3c-e863ffbb7b49 None admin] RBAC: Authorizing `identity:get_group(group_id=1cc1afb6965549708d8b9b4339430192)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:51.653559 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd666f-493d-44b3-bb3c-e863ffbb7b49 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:51.655154 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 230/454] 10.222.0.40 () {56 vars in 1180 bytes} [Wed Jul 27 15:11:51 2022] GET /identity/v3/groups/1cc1afb6965549708d8b9b4339430192 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:51.661160 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb5725-6bf0-4618-96e8-05e783591645 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:51.691744 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:51.759871 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fb5725-6bf0-4618-96e8-05e783591645 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:51.792068 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94820569-99ee-408d-a81b-36d62377d31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:51.792671 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94820569-99ee-408d-a81b-36d62377d31e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:51.792954 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94820569-99ee-408d-a81b-36d62377d31e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:51.793230 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94820569-99ee-408d-a81b-36d62377d31e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:51.794021 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94820569-99ee-408d-a81b-36d62377d31e None admin] RBAC: Adding query filter params (group.id=1cc1afb6965549708d8b9b4339430192, role.id=ce7d7a296f4e448dbb11ded292818043, scope.project.id=cd46e34c8ff44b9abce25e0fd266ac70) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:51.794333 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94820569-99ee-408d-a81b-36d62377d31e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:51.795754 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94820569-99ee-408d-a81b-36d62377d31e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:51.801435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 225/455] 10.222.0.40 () {56 vars in 1376 bytes} [Wed Jul 27 15:11:51 2022] GET /identity/v3/role_assignments?group.id=1cc1afb6965549708d8b9b4339430192&scope.project.id=cd46e34c8ff44b9abce25e0fd266ac70&role.id=ce7d7a296f4e448dbb11ded292818043 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:54.347221 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddff93c-67e2-4c19-8f5f-c3f786111105 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:54.348258 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddff93c-67e2-4c19-8f5f-c3f786111105 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:54.348751 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddff93c-67e2-4c19-8f5f-c3f786111105 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:54.351063 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 231/456] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:54.357080 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e0912-72b3-4c7f-b0cc-f8c30b15dfd8 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:54.357986 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e0912-72b3-4c7f-b0cc-f8c30b15dfd8 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:54.358463 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e0912-72b3-4c7f-b0cc-f8c30b15dfd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:54.388988 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-116e0912-72b3-4c7f-b0cc-f8c30b15dfd8 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:54.390519 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-116e0912-72b3-4c7f-b0cc-f8c30b15dfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:54.482434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 226/457] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 15:11:54.525216 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddff93c-67e2-4c19-8f5f-c3f786111105 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:54.653969 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c3018-7441-4a8f-a36f-d617fc02ef53 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:54.654251 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c3018-7441-4a8f-a36f-d617fc02ef53 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:54.654447 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9c3018-7441-4a8f-a36f-d617fc02ef53 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:54.656048 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 227/458] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:54.660991 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674ce46-a125-4474-8878-277b7355e970 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:54.661532 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674ce46-a125-4474-8878-277b7355e970 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:54.662009 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e674ce46-a125-4474-8878-277b7355e970 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:54.674603 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddff93c-67e2-4c19-8f5f-c3f786111105 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:54.692385 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:54.709025 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-e674ce46-a125-4474-8878-277b7355e970 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:54.710852 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e674ce46-a125-4474-8878-277b7355e970 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:54.712835 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b15903-08f8-4687-9135-e7e89f1b2bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:54.713684 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b15903-08f8-4687-9135-e7e89f1b2bed None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:54.714165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b15903-08f8-4687-9135-e7e89f1b2bed None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:54.714606 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b15903-08f8-4687-9135-e7e89f1b2bed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:54.726686 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b15903-08f8-4687-9135-e7e89f1b2bed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:54.728468 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b15903-08f8-4687-9135-e7e89f1b2bed None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:54.744343 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-89b15903-08f8-4687-9135-e7e89f1b2bed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:11:54.744343 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:54.744343 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:54.744343 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:54.744343 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:54.744343 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:54.744343 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:54.744343 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:54.744343 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:54.744343 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:54.744343 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:54.744343 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:54.744343 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:11:54.744343 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:11:54.744343 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:11:54.745275 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:11:54.745275 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:54.745275 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:54.745275 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:54.745275 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:54.745275 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:54.745275 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:54.745275 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:54.745275 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:54.745275 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:54.745275 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:54.745275 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:54.745275 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:54.745275 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:54.745275 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:54.745275 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:54.745275 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:54.746113 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:11:54.746113 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:11:54.746113 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:11:54.746113 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:11:54.748487 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 232/459] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:11:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:54.757627 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b15903-08f8-4687-9135-e7e89f1b2bed None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:54.757805 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:54.828256 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 228/460] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:54.829686 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e69c6-99d5-4b75-bfa4-7d17886892a0 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:54.829976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e69c6-99d5-4b75-bfa4-7d17886892a0 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:54.830293 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44e69c6-99d5-4b75-bfa4-7d17886892a0 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:54.831504 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 229/461] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:54.845336 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48906328-c086-4fde-bf07-c8da50b165d7 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:54.845622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48906328-c086-4fde-bf07-c8da50b165d7 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:54.845903 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48906328-c086-4fde-bf07-c8da50b165d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:54.873289 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-48906328-c086-4fde-bf07-c8da50b165d7 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:54.873957 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b15903-08f8-4687-9135-e7e89f1b2bed None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:54.874475 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-48906328-c086-4fde-bf07-c8da50b165d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:54.916775 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103d84e-40f8-4318-acb6-632d89ca9523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:54.918114 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103d84e-40f8-4318-acb6-632d89ca9523 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:54.918578 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103d84e-40f8-4318-acb6-632d89ca9523 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:54.919355 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103d84e-40f8-4318-acb6-632d89ca9523 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:54.920269 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103d84e-40f8-4318-acb6-632d89ca9523 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:54.921072 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103d84e-40f8-4318-acb6-632d89ca9523 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:54.923029 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103d84e-40f8-4318-acb6-632d89ca9523 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:54.939353 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 233/462] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:54.941021 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103d84e-40f8-4318-acb6-632d89ca9523 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:54.950135 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 230/463] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 15:11:54.950944 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48906328-c086-4fde-bf07-c8da50b165d7 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:54.972396 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:55.056347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103d84e-40f8-4318-acb6-632d89ca9523 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:55.073275 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:55.092298 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915877e1-6dd0-4e47-afc6-137c8403c011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:55.093026 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915877e1-6dd0-4e47-afc6-137c8403c011 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:55.093419 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915877e1-6dd0-4e47-afc6-137c8403c011 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:55.093761 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915877e1-6dd0-4e47-afc6-137c8403c011 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:55.095964 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48906328-c086-4fde-bf07-c8da50b165d7 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:55.107733 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915877e1-6dd0-4e47-afc6-137c8403c011 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:55.109909 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915877e1-6dd0-4e47-afc6-137c8403c011 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:55.128676 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-915877e1-6dd0-4e47-afc6-137c8403c011 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:11:55.128676 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:55.128676 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:55.128676 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:55.128676 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:55.128676 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:55.128676 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:55.128676 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:55.128676 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:55.128676 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:55.128676 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:55.128676 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:55.128676 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:11:55.128676 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:11:55.128676 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:11:55.129552 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:11:55.129552 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:55.129552 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:55.129552 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:55.129552 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:55.129552 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:55.129552 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:55.129552 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:55.129552 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:55.129552 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:55.129552 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:55.129552 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:55.129552 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:55.129552 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:55.129552 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:55.129552 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:55.129552 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:55.130462 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:11:55.130462 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:11:55.130462 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:11:55.130462 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:11:55.130462 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 234/464] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:11:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:55.130714 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915877e1-6dd0-4e47-afc6-137c8403c011 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:55.141219 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0972806e-d157-4b9c-8b90-35e73cf21077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:55.142246 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972806e-d157-4b9c-8b90-35e73cf21077 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:55.142572 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972806e-d157-4b9c-8b90-35e73cf21077 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:55.142852 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0972806e-d157-4b9c-8b90-35e73cf21077 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:55.143802 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0972806e-d157-4b9c-8b90-35e73cf21077 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:55.145285 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0972806e-d157-4b9c-8b90-35e73cf21077 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:55.171166 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 231/465] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Jul 27 15:11:54 2022] POST /identity/v3/users => generated 246 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:11:55.172709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7f98a-8f9f-4094-b1c9-7c2b104530fc None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:55.173179 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7f98a-8f9f-4094-b1c9-7c2b104530fc None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:55.173634 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7f98a-8f9f-4094-b1c9-7c2b104530fc None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:55.175842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 232/466] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:55.181643 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7f98a-8f9f-4094-b1c9-7c2b104530fc None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:55.230101 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:55.254511 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915877e1-6dd0-4e47-afc6-137c8403c011 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:55.310453 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87138f36-54e6-4730-92ef-fb1eec02b448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:55.311117 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87138f36-54e6-4730-92ef-fb1eec02b448 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:55.311406 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87138f36-54e6-4730-92ef-fb1eec02b448 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:55.311682 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87138f36-54e6-4730-92ef-fb1eec02b448 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:55.325496 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87138f36-54e6-4730-92ef-fb1eec02b448 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:55.326990 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87138f36-54e6-4730-92ef-fb1eec02b448 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:55.331726 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7f98a-8f9f-4094-b1c9-7c2b104530fc None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:55.343741 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-87138f36-54e6-4730-92ef-fb1eec02b448 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:11:55.343741 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:55.343741 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:55.343741 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:55.343741 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:55.343741 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:55.343741 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:55.343741 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:55.343741 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:55.343741 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:55.343741 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:55.343741 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:55.343741 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:11:55.343741 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:11:55.343741 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:11:55.344698 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:11:55.344698 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:55.344698 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:55.344698 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:55.344698 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:55.344698 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:55.344698 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:55.344698 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:55.344698 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:55.344698 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:55.344698 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:55.344698 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:55.344698 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:55.344698 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:55.344698 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:55.344698 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:55.344698 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:55.345541 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:11:55.345541 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:11:55.345541 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:11:55.345541 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:11:55.350008 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 235/467] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:11:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:55.351939 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb53d4a-ffab-4673-af61-cee9aed5fb27 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:55.352262 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb53d4a-ffab-4673-af61-cee9aed5fb27 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:55.352576 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb53d4a-ffab-4673-af61-cee9aed5fb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:55.373025 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4cb53d4a-ffab-4673-af61-cee9aed5fb27 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:55.373477 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4cb53d4a-ffab-4673-af61-cee9aed5fb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:55.386562 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952cc07-af0c-4b9b-b84d-286babb824b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:55.387294 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952cc07-af0c-4b9b-b84d-286babb824b5 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:55.387468 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952cc07-af0c-4b9b-b84d-286babb824b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:55.387724 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4952cc07-af0c-4b9b-b84d-286babb824b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:55.389002 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952cc07-af0c-4b9b-b84d-286babb824b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:55.389002 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952cc07-af0c-4b9b-b84d-286babb824b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:55.390474 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4952cc07-af0c-4b9b-b84d-286babb824b5 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:55.400656 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:55.406363 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 233/468] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:55.407727 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952cc07-af0c-4b9b-b84d-286babb824b5 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:55.453297 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 236/469] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:55.454189 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb53d4a-ffab-4673-af61-cee9aed5fb27 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:55.525233 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4952cc07-af0c-4b9b-b84d-286babb824b5 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:55.525996 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:55.563717 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c366a4-937c-428a-a393-91f8c08cf307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:55.564382 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c366a4-937c-428a-a393-91f8c08cf307 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:55.564667 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c366a4-937c-428a-a393-91f8c08cf307 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:55.564968 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c366a4-937c-428a-a393-91f8c08cf307 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:55.565780 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c366a4-937c-428a-a393-91f8c08cf307 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:55.566084 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c366a4-937c-428a-a393-91f8c08cf307 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:55.567444 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c366a4-937c-428a-a393-91f8c08cf307 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:55.568873 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb53d4a-ffab-4673-af61-cee9aed5fb27 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:55.591042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 234/470] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:55.592231 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c366a4-937c-428a-a393-91f8c08cf307 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:55.607695 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0baba3-2357-45a4-9a36-d8c6bd5cd3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:55.608680 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0baba3-2357-45a4-9a36-d8c6bd5cd3a6 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:55.609164 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0baba3-2357-45a4-9a36-d8c6bd5cd3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:55.609638 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0baba3-2357-45a4-9a36-d8c6bd5cd3a6 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:55.610532 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0baba3-2357-45a4-9a36-d8c6bd5cd3a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:55.612196 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0baba3-2357-45a4-9a36-d8c6bd5cd3a6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:55.638174 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 237/471] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Jul 27 15:11:55 2022] POST /identity/v3/users => generated 248 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:11:55.645312 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0baba3-2357-45a4-9a36-d8c6bd5cd3a6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:55.656412 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:55.704504 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c366a4-937c-428a-a393-91f8c08cf307 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:55.744304 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fef4641-0156-4e1b-9132-9de090b83a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:55.744956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef4641-0156-4e1b-9132-9de090b83a23 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:55.745240 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef4641-0156-4e1b-9132-9de090b83a23 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:55.745513 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef4641-0156-4e1b-9132-9de090b83a23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:55.758096 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef4641-0156-4e1b-9132-9de090b83a23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:55.759690 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fef4641-0156-4e1b-9132-9de090b83a23 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:55.777469 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-1fef4641-0156-4e1b-9132-9de090b83a23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:11:55.777469 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:55.777469 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:55.777469 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:55.777469 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:55.777469 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:55.777469 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:55.777469 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:55.777469 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:55.777469 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:55.777469 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:55.777469 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:55.777469 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:11:55.777469 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:11:55.777469 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:11:55.778422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:11:55.778422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:55.778422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:55.778422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:55.778422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:55.778422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:55.778422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:55.778422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:55.778422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:55.778422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:55.778422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:55.778422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:55.778422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:55.778422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:55.778422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:55.778422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:55.778422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:55.779320 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:11:55.779320 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:11:55.779320 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:11:55.779320 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:11:55.779320 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 235/472] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:11:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:55.784028 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6253e9a-ab81-4864-ae3e-8b172b780e90 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:55.784028 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6253e9a-ab81-4864-ae3e-8b172b780e90 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:55.784028 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6253e9a-ab81-4864-ae3e-8b172b780e90 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:55.784301 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0baba3-2357-45a4-9a36-d8c6bd5cd3a6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:55.784376 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 236/473] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:55.789347 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6253e9a-ab81-4864-ae3e-8b172b780e90 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:55.805519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:55.830463 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906367d8-c065-471d-bb7c-f257f5f58fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:55.831105 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906367d8-c065-471d-bb7c-f257f5f58fff None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:55.831390 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906367d8-c065-471d-bb7c-f257f5f58fff None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:55.831669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906367d8-c065-471d-bb7c-f257f5f58fff None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:55.832698 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906367d8-c065-471d-bb7c-f257f5f58fff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:55.835544 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906367d8-c065-471d-bb7c-f257f5f58fff None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:55.863287 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 238/474] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Jul 27 15:11:55 2022] POST /identity/v3/users => generated 248 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:11:55.865424 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42be17d-903c-4b83-847c-c9c0cfc0ecdc None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:55.865424 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42be17d-903c-4b83-847c-c9c0cfc0ecdc None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:55.865593 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42be17d-903c-4b83-847c-c9c0cfc0ecdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:55.885645 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a42be17d-903c-4b83-847c-c9c0cfc0ecdc None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:55.887221 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a42be17d-903c-4b83-847c-c9c0cfc0ecdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:55.934745 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6253e9a-ab81-4864-ae3e-8b172b780e90 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:55.951701 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:55.979707 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ec193-26b7-4f03-8bb9-c78f9a490098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:55.980135 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ec193-26b7-4f03-8bb9-c78f9a490098 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:55.980441 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ec193-26b7-4f03-8bb9-c78f9a490098 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:55.980701 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ec193-26b7-4f03-8bb9-c78f9a490098 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:55.981664 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8ec193-26b7-4f03-8bb9-c78f9a490098 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:55.981970 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8ec193-26b7-4f03-8bb9-c78f9a490098 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:55.984583 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8ec193-26b7-4f03-8bb9-c78f9a490098 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:55.990475 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 239/475] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:56.006614 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 237/476] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:56.013135 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42be17d-903c-4b83-847c-c9c0cfc0ecdc None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:56.024099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ec193-26b7-4f03-8bb9-c78f9a490098 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:56.142987 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ec193-26b7-4f03-8bb9-c78f9a490098 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:56.147560 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42be17d-903c-4b83-847c-c9c0cfc0ecdc None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:56.150718 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:56.187453 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f6ec30-73fc-4e0c-83a6-f5726e39dc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:56.188097 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f6ec30-73fc-4e0c-83a6-f5726e39dc88 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:56.188379 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f6ec30-73fc-4e0c-83a6-f5726e39dc88 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:56.188723 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f6ec30-73fc-4e0c-83a6-f5726e39dc88 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:56.189352 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f6ec30-73fc-4e0c-83a6-f5726e39dc88 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:56.190703 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f6ec30-73fc-4e0c-83a6-f5726e39dc88 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:56.197820 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed1bc8-fab7-4757-8108-30f455337923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:56.198987 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed1bc8-fab7-4757-8108-30f455337923 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:56.199166 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.sql.core [None req-19f6ec30-73fc-4e0c-83a6-f5726e39dc88 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 27 15:11:56.199166 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 27 15:11:56.199166 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [parameters: {'id': 'fb0d0027c1474c41996eacce0510a1ef', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 27 15:11:56.199166 dv-cinder-841315-2-smb devstack@keystone.service[80057]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80057) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 15:11:56.199851 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed1bc8-fab7-4757-8108-30f455337923 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:56.200366 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ed1bc8-fab7-4757-8108-30f455337923 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:56.201251 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed1bc8-fab7-4757-8108-30f455337923 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:56.202876 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ed1bc8-fab7-4757-8108-30f455337923 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:56.217784 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-19f6ec30-73fc-4e0c-83a6-f5726e39dc88 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 27 15:11:56.217784 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:56.217784 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 15:11:56.217784 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 15:11:56.217784 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 15:11:56.217784 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 15:11:56.217784 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 15:11:56.217784 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 15:11:56.217784 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 15:11:56.217784 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application conn.query(q) Jul 27 15:11:56.217784 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 15:11:56.217784 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 15:11:56.217784 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 15:11:56.217784 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application result.read() Jul 27 15:11:56.217784 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 15:11:56.218811 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 15:11:56.218811 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 15:11:56.218811 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 15:11:56.218811 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 15:11:56.218811 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 15:11:56.218811 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 15:11:56.218811 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 15:11:56.218811 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 27 15:11:56.218811 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:11:56.218811 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 15:11:56.218811 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:11:56.218811 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:56.218811 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 15:11:56.218811 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 15:11:56.218811 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 27 15:11:56.218811 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return ref.to_dict() Jul 27 15:11:56.218811 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 15:11:56.218811 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application next(self.gen) Jul 27 15:11:56.219733 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 15:11:56.219733 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application yield resource Jul 27 15:11:56.219733 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 15:11:56.219733 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application next(self.gen) Jul 27 15:11:56.219733 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 15:11:56.219733 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 15:11:56.219733 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 15:11:56.219733 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 15:11:56.219733 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 15:11:56.219733 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise self.value Jul 27 15:11:56.219733 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 15:11:56.219733 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 15:11:56.219733 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 15:11:56.219733 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application session.commit() Jul 27 15:11:56.219733 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 15:11:56.219733 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 15:11:56.219733 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 15:11:56.220619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 15:11:56.220619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 15:11:56.220619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self.session.flush() Jul 27 15:11:56.220619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 15:11:56.220619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 15:11:56.220619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 15:11:56.220619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 15:11:56.220619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 15:11:56.220619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application compat.raise_( Jul 27 15:11:56.220619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 15:11:56.220619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception Jul 27 15:11:56.220619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 15:11:56.220619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 15:11:56.220619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 15:11:56.220619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 15:11:56.220619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 15:11:56.220619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 15:11:56.221507 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 15:11:56.221507 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 15:11:56.221507 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 27 15:11:56.221507 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 27 15:11:56.221507 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 15:11:56.221507 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 15:11:56.221507 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 15:11:56.221507 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 15:11:56.221507 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 15:11:56.221507 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 15:11:56.221507 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 15:11:56.221507 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 15:11:56.221507 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 15:11:56.221507 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 15:11:56.221507 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 15:11:56.221507 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception Jul 27 15:11:56.222319 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 15:11:56.222319 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 15:11:56.222319 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 15:11:56.222319 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 15:11:56.222319 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 15:11:56.222319 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 15:11:56.222319 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 15:11:56.222319 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application conn.query(q) Jul 27 15:11:56.222319 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 15:11:56.222319 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 15:11:56.222319 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 15:11:56.222319 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application result.read() Jul 27 15:11:56.222319 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 15:11:56.222319 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 15:11:56.222319 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 15:11:56.222319 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 15:11:56.223099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 15:11:56.223099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 15:11:56.223099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 15:11:56.223099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 15:11:56.223099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 27 15:11:56.223099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 27 15:11:56.223099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [parameters: {'id': 'fb0d0027c1474c41996eacce0510a1ef', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 27 15:11:56.223099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 15:11:56.223099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:11:56.223099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 15:11:56.223099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:11:56.223099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:56.223099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:56.223099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:56.223099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:56.223099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:56.223899 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:56.223899 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:56.223899 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:56.223899 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:56.223899 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:56.223899 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:56.223899 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 27 15:11:56.223899 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 27 15:11:56.223899 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:56.223899 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:56.223899 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 27 15:11:56.223899 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 27 15:11:56.223899 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 15:11:56.223899 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 15:11:56.223899 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 27 15:11:56.223899 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:11:56.226979 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 238/477] 10.222.0.40 () {60 vars in 1131 bytes} [Wed Jul 27 15:11:56 2022] POST /identity/v3/roles => generated 144 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:56.228398 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f6ec30-73fc-4e0c-83a6-f5726e39dc88 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:56.235810 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 240/478] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Jul 27 15:11:56 2022] POST /identity/v3/users => generated 249 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:11:56.275187 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:56.350638 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f6ec30-73fc-4e0c-83a6-f5726e39dc88 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:56.389261 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82847373-8de8-430b-968d-1efa9381b7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:56.389913 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82847373-8de8-430b-968d-1efa9381b7c2 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:56.390235 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82847373-8de8-430b-968d-1efa9381b7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:56.390511 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82847373-8de8-430b-968d-1efa9381b7c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:56.404997 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82847373-8de8-430b-968d-1efa9381b7c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:56.410037 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-82847373-8de8-430b-968d-1efa9381b7c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 15:11:56.410037 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:56.410037 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:56.410037 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:56.410037 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:56.410037 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:56.410037 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:56.410037 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:56.410037 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:56.410037 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:56.410037 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:56.410037 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:56.410037 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:56.410037 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:56.410037 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:56.410037 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:56.410981 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:56.410981 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:56.410981 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:56.410981 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:56.410981 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:56.410981 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:56.410981 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:56.410981 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:56.410981 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:56.410981 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:56.410981 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:56.410981 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:56.410981 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:56.410981 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:56.410981 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:56.410981 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:56.411782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:56.411782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:56.411782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:56.411782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:56.411782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:56.411782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:56.411782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:56.411782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:56.411782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:56.411782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:56.411782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 15:11:56.411782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:11:56.411782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 239/479] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jul 27 15:11:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:56.418127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed1bc8-fab7-4757-8108-30f455337923 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:56.559544 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ed1bc8-fab7-4757-8108-30f455337923 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:56.607907 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e074772-b5fd-4666-a43b-1ba5eb5d73a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:56.608563 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e074772-b5fd-4666-a43b-1ba5eb5d73a4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:56.608848 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e074772-b5fd-4666-a43b-1ba5eb5d73a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:56.609125 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e074772-b5fd-4666-a43b-1ba5eb5d73a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:56.609861 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e074772-b5fd-4666-a43b-1ba5eb5d73a4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:56.610168 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e074772-b5fd-4666-a43b-1ba5eb5d73a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:56.611539 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e074772-b5fd-4666-a43b-1ba5eb5d73a4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:56.621488 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 241/480] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:11:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:57.555342 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c931b7-c71c-40e5-8b40-88c0e6be96c1 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:57.555896 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c931b7-c71c-40e5-8b40-88c0e6be96c1 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:57.556219 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c931b7-c71c-40e5-8b40-88c0e6be96c1 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:57.557905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 240/481] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:57.562990 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45dbcff-757a-42ab-b77f-b32dff43e6f4 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:57.563388 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45dbcff-757a-42ab-b77f-b32dff43e6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:57.563531 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45dbcff-757a-42ab-b77f-b32dff43e6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:57.593813 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a45dbcff-757a-42ab-b77f-b32dff43e6f4 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:57.594987 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a45dbcff-757a-42ab-b77f-b32dff43e6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:57.619883 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:57.694911 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 242/482] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:57.732900 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c931b7-c71c-40e5-8b40-88c0e6be96c1 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:57.862329 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:57.869803 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c931b7-c71c-40e5-8b40-88c0e6be96c1 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:57.914695 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71764f2-8470-4657-93f6-609451b4eea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:57.915339 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71764f2-8470-4657-93f6-609451b4eea2 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:57.915622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71764f2-8470-4657-93f6-609451b4eea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:57.915895 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71764f2-8470-4657-93f6-609451b4eea2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:57.934825 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71764f2-8470-4657-93f6-609451b4eea2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:57.939755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-e71764f2-8470-4657-93f6-609451b4eea2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:11:57.939755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:57.939755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:57.939755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:57.939755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:57.939755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:57.939755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:57.939755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:57.939755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:57.939755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:57.939755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:57.939755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:57.939755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:57.939755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:57.939755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:57.939755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:57.940662 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:57.940662 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:57.940662 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:57.940662 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:57.940662 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:57.940662 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:57.940662 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:57.940662 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:57.940662 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:57.940662 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:57.940662 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:57.940662 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:57.940662 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:57.940662 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:57.940662 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:57.940662 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:57.941543 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:57.941543 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:57.941543 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:57.941543 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:57.941543 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:57.941543 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:57.941543 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:57.941543 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:57.941543 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:57.941543 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:57.941543 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:11:57.941543 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:11:57.941543 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 241/483] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jul 27 15:11:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:57.948932 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45dbcff-757a-42ab-b77f-b32dff43e6f4 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:58.119928 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45dbcff-757a-42ab-b77f-b32dff43e6f4 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:58.169569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd99266-87af-4306-86f7-53b344caa896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:58.170198 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd99266-87af-4306-86f7-53b344caa896 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:58.170477 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd99266-87af-4306-86f7-53b344caa896 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:58.170743 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd99266-87af-4306-86f7-53b344caa896 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:58.171465 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd99266-87af-4306-86f7-53b344caa896 None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:58.171769 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd99266-87af-4306-86f7-53b344caa896 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:58.173163 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd99266-87af-4306-86f7-53b344caa896 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:58.187326 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 243/484] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jul 27 15:11:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:58.193078 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71764f2-8470-4657-93f6-609451b4eea2 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:58.347981 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71764f2-8470-4657-93f6-609451b4eea2 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:58.401323 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efd9c33-b2a6-4c70-a6cd-e80e1740a1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:58.401877 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd9c33-b2a6-4c70-a6cd-e80e1740a1ef None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:58.402158 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd9c33-b2a6-4c70-a6cd-e80e1740a1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:58.402440 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efd9c33-b2a6-4c70-a6cd-e80e1740a1ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:58.418415 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd9c33-b2a6-4c70-a6cd-e80e1740a1ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:58.419878 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efd9c33-b2a6-4c70-a6cd-e80e1740a1ef None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:58.442393 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-9efd9c33-b2a6-4c70-a6cd-e80e1740a1ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:11:58.442393 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:58.442393 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:58.442393 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:58.442393 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:58.442393 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:58.442393 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:58.442393 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:58.442393 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:58.442393 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:58.442393 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:58.442393 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:58.442393 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:11:58.442393 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:11:58.442393 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:11:58.443303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:11:58.443303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:58.443303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:58.443303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:58.443303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:58.443303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:58.443303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:58.443303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:58.443303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:58.443303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:58.443303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:58.443303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:58.443303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:58.443303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:58.443303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:58.443303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:58.443303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:58.444237 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:11:58.444237 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:11:58.444237 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:11:58.444237 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:11:58.444237 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 242/485] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:11:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:58.451085 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd99266-87af-4306-86f7-53b344caa896 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:58.479015 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b29635-cbf9-457f-ab94-abaf3b8525f7 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:58.479311 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b29635-cbf9-457f-ab94-abaf3b8525f7 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:58.479578 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b29635-cbf9-457f-ab94-abaf3b8525f7 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:58.481205 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 243/486] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:58.482290 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:58.486419 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8dc667-e2cc-4658-bd13-bacb9fa100d2 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:58.486720 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8dc667-e2cc-4658-bd13-bacb9fa100d2 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:58.486992 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8dc667-e2cc-4658-bd13-bacb9fa100d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:58.518453 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-ee8dc667-e2cc-4658-bd13-bacb9fa100d2 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:58.519650 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ee8dc667-e2cc-4658-bd13-bacb9fa100d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:58.523021 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:58.648000 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd99266-87af-4306-86f7-53b344caa896 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:58.654830 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 244/487] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 15:11:58.684505 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387bf826-5130-4a3f-810c-c5086dd676cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:58.685125 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bf826-5130-4a3f-810c-c5086dd676cf None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:58.685407 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bf826-5130-4a3f-810c-c5086dd676cf None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:58.685683 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bf826-5130-4a3f-810c-c5086dd676cf None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:58.686384 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387bf826-5130-4a3f-810c-c5086dd676cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:58.686693 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387bf826-5130-4a3f-810c-c5086dd676cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:58.688078 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387bf826-5130-4a3f-810c-c5086dd676cf None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:58.690322 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8dc667-e2cc-4658-bd13-bacb9fa100d2 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:58.717932 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 244/488] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:58.723947 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c890b-45fc-4a46-ba9d-8559d2dec4e7 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:58.724372 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c890b-45fc-4a46-ba9d-8559d2dec4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:58.724748 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c890b-45fc-4a46-ba9d-8559d2dec4e7 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:58.728071 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 245/489] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:58.728906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c890b-45fc-4a46-ba9d-8559d2dec4e7 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:58.809260 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8dc667-e2cc-4658-bd13-bacb9fa100d2 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:58.812327 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:58.836740 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c890b-45fc-4a46-ba9d-8559d2dec4e7 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:58.845862 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c9f1b9-cf46-40e9-9be0-9d61d4089a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:58.846563 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9f1b9-cf46-40e9-9be0-9d61d4089a69 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:58.846848 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9f1b9-cf46-40e9-9be0-9d61d4089a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:58.847126 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c9f1b9-cf46-40e9-9be0-9d61d4089a69 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:58.855347 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:58.859633 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c9f1b9-cf46-40e9-9be0-9d61d4089a69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:58.865161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-24c9f1b9-cf46-40e9-9be0-9d61d4089a69 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:11:58.865161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:58.865161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:58.865161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:58.865161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:58.865161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:58.865161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:58.865161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:58.865161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:58.865161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:58.865161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:58.865161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:58.865161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:58.865161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:58.865161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:58.865161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:58.866073 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:58.866073 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:58.866073 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:58.866073 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:58.866073 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:58.866073 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:58.866073 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:58.866073 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:58.866073 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:58.866073 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:58.866073 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:58.866073 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:58.866073 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:58.866073 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:58.866073 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:58.866073 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:58.867417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:58.867417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:58.867417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:58.867417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:58.867417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:58.867417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:58.867417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:58.867417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:58.867417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:58.867417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:58.867417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:11:58.867417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:11:58.867417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 245/490] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jul 27 15:11:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:11:58.868319 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e171b-8550-4efb-9225-cbaee406c98b None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:58.868621 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e171b-8550-4efb-9225-cbaee406c98b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:58.869233 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e171b-8550-4efb-9225-cbaee406c98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:58.879512 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa69d65-ab9b-4c47-bf35-6df6c0152038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:58.880379 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa69d65-ab9b-4c47-bf35-6df6c0152038 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:58.880818 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa69d65-ab9b-4c47-bf35-6df6c0152038 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:58.881226 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa69d65-ab9b-4c47-bf35-6df6c0152038 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:58.888734 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-494e171b-8550-4efb-9225-cbaee406c98b None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:58.889540 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa69d65-ab9b-4c47-bf35-6df6c0152038 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:58.890091 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-494e171b-8550-4efb-9225-cbaee406c98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:58.891348 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa69d65-ab9b-4c47-bf35-6df6c0152038 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:58.906387 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-6aa69d65-ab9b-4c47-bf35-6df6c0152038 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 15:11:58.906387 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:58.906387 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:58.906387 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:58.906387 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:58.906387 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:58.906387 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:58.906387 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:58.906387 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:58.906387 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:58.906387 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:58.906387 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:58.906387 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:11:58.906387 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:11:58.906387 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:11:58.906387 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:11:58.907308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:58.907308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:58.907308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:11:58.907308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:11:58.907308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:11:58.907308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:11:58.907308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:58.907308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:58.907308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:58.907308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:58.907308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:58.907308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:58.907308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:58.907308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:58.907308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:58.907308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:58.907308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:58.907308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:58.908235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:58.908235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:58.908235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:11:58.908235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:11:58.908235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:11:58.908235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:11:58.908235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:11:58.908235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:11:58.908235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 15:11:58.908235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:11:58.910222 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 246/491] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Jul 27 15:11:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:58.911238 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa69d65-ab9b-4c47-bf35-6df6c0152038 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:58.976013 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 246/492] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:58.976013 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e171b-8550-4efb-9225-cbaee406c98b None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:59.036747 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa69d65-ab9b-4c47-bf35-6df6c0152038 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:59.076221 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bbab0-a34c-403b-b7c5-5de63871bdb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:59.077351 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bbab0-a34c-403b-b7c5-5de63871bdb0 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:59.078140 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bbab0-a34c-403b-b7c5-5de63871bdb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:59.078569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217bbab0-a34c-403b-b7c5-5de63871bdb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:59.079422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217bbab0-a34c-403b-b7c5-5de63871bdb0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:59.079861 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217bbab0-a34c-403b-b7c5-5de63871bdb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:59.082189 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217bbab0-a34c-403b-b7c5-5de63871bdb0 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:59.084327 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:59.092728 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e171b-8550-4efb-9225-cbaee406c98b None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:59.093150 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 247/493] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jul 27 15:11:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:59.094002 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bbab0-a34c-403b-b7c5-5de63871bdb0 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:59.121062 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:59.129001 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67da79d-6977-4ccd-88f9-67ba348a701a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:59.129611 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67da79d-6977-4ccd-88f9-67ba348a701a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:59.129892 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67da79d-6977-4ccd-88f9-67ba348a701a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:59.130162 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67da79d-6977-4ccd-88f9-67ba348a701a None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:59.130946 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67da79d-6977-4ccd-88f9-67ba348a701a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:59.131253 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67da79d-6977-4ccd-88f9-67ba348a701a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:59.133379 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67da79d-6977-4ccd-88f9-67ba348a701a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:59.168950 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 247/494] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Jul 27 15:11:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:59.170147 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de13bf6-9206-4036-8a21-312d2f4234ba None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:59.170434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de13bf6-9206-4036-8a21-312d2f4234ba None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:59.170712 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de13bf6-9206-4036-8a21-312d2f4234ba None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:59.172274 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 248/495] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:59.173481 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95264ea-1fad-4546-8df1-4bfd1540ac9a None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:59.173765 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95264ea-1fad-4546-8df1-4bfd1540ac9a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:59.174038 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95264ea-1fad-4546-8df1-4bfd1540ac9a None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:59.176031 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 249/496] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:11:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:11:59.176031 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95264ea-1fad-4546-8df1-4bfd1540ac9a None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:59.193424 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217bbab0-a34c-403b-b7c5-5de63871bdb0 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:59.227266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf12f12-98ec-452b-bd79-92cba13e68e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:59.227894 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf12f12-98ec-452b-bd79-92cba13e68e0 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:59.228205 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf12f12-98ec-452b-bd79-92cba13e68e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:59.228480 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf12f12-98ec-452b-bd79-92cba13e68e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:59.238779 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf12f12-98ec-452b-bd79-92cba13e68e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:59.244560 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-2bf12f12-98ec-452b-bd79-92cba13e68e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:11:59.244560 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:59.244560 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:59.244560 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:59.244560 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:59.244560 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:59.244560 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:59.244560 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:59.244560 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:59.244560 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:59.244560 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:59.244560 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:59.244560 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:59.244560 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:59.244560 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:59.244560 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:59.245446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:59.245446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:59.245446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:59.245446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:59.245446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:59.245446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:59.245446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:59.245446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:59.245446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:59.245446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:59.245446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:59.245446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:59.245446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:59.245446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:59.245446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:59.245446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:59.246233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:59.246233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:59.246233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:59.246233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:59.246233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:59.246233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:59.246233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:59.246233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:59.246233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:59.246233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:59.246233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:11:59.246233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:11:59.246233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 248/497] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jul 27 15:11:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:59.247157 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf12f12-98ec-452b-bd79-92cba13e68e0 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:59.286915 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95264ea-1fad-4546-8df1-4bfd1540ac9a None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:59.303024 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:59.322435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b66a7f0-e59f-47fa-ad13-de8203e4707e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:59.323065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66a7f0-e59f-47fa-ad13-de8203e4707e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:59.323345 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66a7f0-e59f-47fa-ad13-de8203e4707e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:59.323616 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b66a7f0-e59f-47fa-ad13-de8203e4707e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:59.333386 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b66a7f0-e59f-47fa-ad13-de8203e4707e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:59.334826 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b66a7f0-e59f-47fa-ad13-de8203e4707e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:59.348516 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf12f12-98ec-452b-bd79-92cba13e68e0 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:59.349914 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-8b66a7f0-e59f-47fa-ad13-de8203e4707e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:11:59.349914 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:59.349914 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:59.349914 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:59.349914 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:59.349914 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:59.349914 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:59.349914 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:59.349914 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:59.349914 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:59.349914 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:59.349914 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:59.349914 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:11:59.349914 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:11:59.349914 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:11:59.350729 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:11:59.350729 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:59.350729 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:59.350729 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:59.350729 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:59.350729 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:59.350729 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:59.350729 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:59.350729 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:59.350729 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:59.350729 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:59.350729 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:59.350729 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:59.350729 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:59.350729 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:59.350729 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:59.350729 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:59.351555 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:11:59.351555 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:11:59.351555 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:11:59.351555 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:11:59.351555 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 250/498] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:59.352575 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92640b90-372e-4a6c-873d-825357590047 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:59.352861 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92640b90-372e-4a6c-873d-825357590047 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:59.353136 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92640b90-372e-4a6c-873d-825357590047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:59.377357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-92640b90-372e-4a6c-873d-825357590047 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:59.378574 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-92640b90-372e-4a6c-873d-825357590047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:59.383513 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0346e-37e2-4ed4-a592-b7957f66c99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:59.384173 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0346e-37e2-4ed4-a592-b7957f66c99f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:59.384461 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0346e-37e2-4ed4-a592-b7957f66c99f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:59.384737 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb0346e-37e2-4ed4-a592-b7957f66c99f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:59.409519 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:59.447583 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 251/499] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:59.448837 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138a85c-59a8-4949-9629-dcdb6ece0312 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:59.449142 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138a85c-59a8-4949-9629-dcdb6ece0312 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:59.449445 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7138a85c-59a8-4949-9629-dcdb6ece0312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:59.453712 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0346e-37e2-4ed4-a592-b7957f66c99f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:59.455176 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb0346e-37e2-4ed4-a592-b7957f66c99f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:59.467367 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-7138a85c-59a8-4949-9629-dcdb6ece0312 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:11:59.468592 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-7138a85c-59a8-4949-9629-dcdb6ece0312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:11:59.510293 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:59.533949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 252/500] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:11:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:11:59.534775 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138a85c-59a8-4949-9629-dcdb6ece0312 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:59.560554 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 249/501] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:11:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 15:11:59.560554 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0346e-37e2-4ed4-a592-b7957f66c99f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:59.632908 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:59.637332 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7138a85c-59a8-4949-9629-dcdb6ece0312 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:59.659658 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb0346e-37e2-4ed4-a592-b7957f66c99f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:59.671017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ade3e3-40d5-4776-b36d-6fe842a8b6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:59.671621 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ade3e3-40d5-4776-b36d-6fe842a8b6c2 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:59.671899 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ade3e3-40d5-4776-b36d-6fe842a8b6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:59.672196 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ade3e3-40d5-4776-b36d-6fe842a8b6c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:59.672902 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ade3e3-40d5-4776-b36d-6fe842a8b6c2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:59.673206 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ade3e3-40d5-4776-b36d-6fe842a8b6c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:59.674572 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ade3e3-40d5-4776-b36d-6fe842a8b6c2 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:59.682787 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 253/502] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jul 27 15:11:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:59.683547 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ade3e3-40d5-4776-b36d-6fe842a8b6c2 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:59.693739 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b3b1e-bd00-4c4f-a547-ab5d63e6cbf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:59.694374 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b3b1e-bd00-4c4f-a547-ab5d63e6cbf9 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:59.694650 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b3b1e-bd00-4c4f-a547-ab5d63e6cbf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:59.694921 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257b3b1e-bd00-4c4f-a547-ab5d63e6cbf9 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:59.695604 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b3b1e-bd00-4c4f-a547-ab5d63e6cbf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:11:59.695901 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b3b1e-bd00-4c4f-a547-ab5d63e6cbf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:59.697274 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257b3b1e-bd00-4c4f-a547-ab5d63e6cbf9 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:59.708144 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 250/503] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:11:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:11:59.708857 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b3b1e-bd00-4c4f-a547-ab5d63e6cbf9 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:59.727776 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:59.782014 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ade3e3-40d5-4776-b36d-6fe842a8b6c2 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:59.808539 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257b3b1e-bd00-4c4f-a547-ab5d63e6cbf9 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:59.815340 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a6bb0-e047-4b8d-b6a0-655781f7f9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:59.815962 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a6bb0-e047-4b8d-b6a0-655781f7f9af None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:59.816266 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a6bb0-e047-4b8d-b6a0-655781f7f9af None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:59.816535 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a6bb0-e047-4b8d-b6a0-655781f7f9af None admin] PATH_INFO: `/v3/roles/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:59.826369 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a6bb0-e047-4b8d-b6a0-655781f7f9af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:11:59.831152 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-cc5a6bb0-e047-4b8d-b6a0-655781f7f9af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:11:59.831152 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:59.831152 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:59.831152 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:59.831152 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:59.831152 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:59.831152 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:59.831152 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:59.831152 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:59.831152 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:59.831152 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:59.831152 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:59.831152 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:11:59.831152 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:11:59.831152 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:11:59.831152 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:11:59.832145 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:11:59.832145 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:11:59.832145 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:11:59.832145 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:11:59.832145 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:59.832145 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:59.832145 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:59.832145 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:59.832145 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:59.832145 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:59.832145 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:59.832145 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:59.832145 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:59.832145 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:59.832145 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:59.832145 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:59.832958 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:59.832958 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:59.832958 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:59.832958 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:59.832958 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:11:59.832958 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:11:59.832958 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:11:59.832958 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:11:59.832958 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:11:59.832958 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:11:59.832958 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:11:59.832958 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:11:59.837823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 254/504] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jul 27 15:11:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:59.838484 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a6bb0-e047-4b8d-b6a0-655781f7f9af None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:59.840913 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5521e3-e191-4d75-8e7b-7460fcd21777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:59.841531 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5521e3-e191-4d75-8e7b-7460fcd21777 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:59.841808 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5521e3-e191-4d75-8e7b-7460fcd21777 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:59.842076 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5521e3-e191-4d75-8e7b-7460fcd21777 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:59.853060 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5521e3-e191-4d75-8e7b-7460fcd21777 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:59.854482 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5521e3-e191-4d75-8e7b-7460fcd21777 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:59.859636 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:59.869025 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-6d5521e3-e191-4d75-8e7b-7460fcd21777 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:11:59.869025 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:59.869025 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:59.869025 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:59.869025 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:59.869025 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:59.869025 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:59.869025 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:59.869025 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:59.869025 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:59.869025 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:59.869025 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:59.869025 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:11:59.869025 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:11:59.869025 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:11:59.869919 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:11:59.869919 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:11:59.869919 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:11:59.869919 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:11:59.869919 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:11:59.869919 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:11:59.869919 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:11:59.869919 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:11:59.869919 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:11:59.869919 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:11:59.869919 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:11:59.869919 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:11:59.869919 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:11:59.869919 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:11:59.869919 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:11:59.869919 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:11:59.869919 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:11:59.870740 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:11:59.870740 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:11:59.870740 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:11:59.870740 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:11:59.870740 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 251/505] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:11:59.871345 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5521e3-e191-4d75-8e7b-7460fcd21777 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:11:59.937332 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:11:59.938434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a6bb0-e047-4b8d-b6a0-655781f7f9af None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:59.970113 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5521e3-e191-4d75-8e7b-7460fcd21777 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:11:59.972007 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1afc7-b84b-4df8-98ef-e7e9653a1f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:11:59.972714 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1afc7-b84b-4df8-98ef-e7e9653a1f99 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:11:59.972999 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1afc7-b84b-4df8-98ef-e7e9653a1f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:11:59.973273 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1afc7-b84b-4df8-98ef-e7e9653a1f99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:11:59.983762 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1afc7-b84b-4df8-98ef-e7e9653a1f99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:11:59.985601 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1afc7-b84b-4df8-98ef-e7e9653a1f99 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:11:59.999905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-5eb1afc7-b84b-4df8-98ef-e7e9653a1f99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:11:59.999905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:11:59.999905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:11:59.999905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:11:59.999905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:11:59.999905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:11:59.999905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:11:59.999905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:11:59.999905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:11:59.999905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:11:59.999905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:11:59.999905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:11:59.999905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:11:59.999905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:11:59.999905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:00.000755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:00.000755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:00.000755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:00.000755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:00.000755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:00.000755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:00.000755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:00.000755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:00.000755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:00.000755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:00.000755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:00.000755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:00.000755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:00.000755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:00.000755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:00.000755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:00.000755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:00.001588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:00.001588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:00.001588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:00.001588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:00.001588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 255/506] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:00.002393 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1afc7-b84b-4df8-98ef-e7e9653a1f99 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:00.003555 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc85b40-cde6-4be9-a76a-5901c410d2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:00.004202 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc85b40-cde6-4be9-a76a-5901c410d2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:00.004481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc85b40-cde6-4be9-a76a-5901c410d2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:00.004751 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc85b40-cde6-4be9-a76a-5901c410d2b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:00.016984 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc85b40-cde6-4be9-a76a-5901c410d2b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:00.018411 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc85b40-cde6-4be9-a76a-5901c410d2b4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:00.032653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-3fc85b40-cde6-4be9-a76a-5901c410d2b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:00.032653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:00.032653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:00.032653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:00.032653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:00.032653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:00.032653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:00.032653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:00.032653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:00.032653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:00.032653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:00.032653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:00.032653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:00.032653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:00.032653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:00.033526 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:00.033526 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:00.033526 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:00.033526 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:00.033526 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:00.033526 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:00.033526 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:00.033526 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:00.033526 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:00.033526 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:00.033526 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:00.033526 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:00.033526 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:00.033526 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:00.033526 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:00.033526 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:00.033526 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:00.034345 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:00.034345 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:00.034345 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:00.034345 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:00.034345 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 252/507] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:00.034594 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc85b40-cde6-4be9-a76a-5901c410d2b4 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:00.077714 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:00.106801 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1afc7-b84b-4df8-98ef-e7e9653a1f99 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:00.131060 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc85b40-cde6-4be9-a76a-5901c410d2b4 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:00.139853 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b53a2-4165-48d1-9627-e118f6e9393c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:00.140515 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b53a2-4165-48d1-9627-e118f6e9393c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:00.140798 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b53a2-4165-48d1-9627-e118f6e9393c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:00.141075 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b53a2-4165-48d1-9627-e118f6e9393c None admin] PATH_INFO: `/v3/users/glance` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:00.148380 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b53a2-4165-48d1-9627-e118f6e9393c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:00.149818 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b53a2-4165-48d1-9627-e118f6e9393c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:00.150181 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:00.162434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-4d8b53a2-4165-48d1-9627-e118f6e9393c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 15:12:00.162434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:00.162434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:00.162434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:00.162434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:00.162434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:00.162434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:00.162434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:00.162434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:00.162434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:00.162434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:00.162434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:00.162434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:12:00.162434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:12:00.162434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:12:00.162434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:12:00.164162 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:00.164162 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:00.164162 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:12:00.164162 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:00.164162 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:12:00.164162 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:00.164162 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:00.164162 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:00.164162 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:00.164162 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:00.164162 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:00.164162 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:00.164162 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:00.164162 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:00.164162 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:00.164162 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:00.164162 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:00.164162 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:00.165065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:00.165065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:00.165065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:12:00.165065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:12:00.165065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:12:00.165065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:12:00.165065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:12:00.165065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:12:00.165065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 15:12:00.165065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:00.165065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 256/508] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:12:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:00.165614 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b53a2-4165-48d1-9627-e118f6e9393c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:00.166676 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a736c27-c730-476f-baaf-c98dae48cb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:00.167323 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a736c27-c730-476f-baaf-c98dae48cb52 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:00.167577 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a736c27-c730-476f-baaf-c98dae48cb52 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:00.167852 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a736c27-c730-476f-baaf-c98dae48cb52 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:00.168602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a736c27-c730-476f-baaf-c98dae48cb52 None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:00.168910 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a736c27-c730-476f-baaf-c98dae48cb52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:00.170261 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a736c27-c730-476f-baaf-c98dae48cb52 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:00.178305 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 253/509] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jul 27 15:12:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:00.179642 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a736c27-c730-476f-baaf-c98dae48cb52 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:00.266698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b53a2-4165-48d1-9627-e118f6e9393c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:00.275731 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a736c27-c730-476f-baaf-c98dae48cb52 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:00.295273 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:00.300636 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f356a97-bebe-4a5c-9f8a-f5c0b1a9bfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:00.301252 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f356a97-bebe-4a5c-9f8a-f5c0b1a9bfe6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:00.301533 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f356a97-bebe-4a5c-9f8a-f5c0b1a9bfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:00.301806 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f356a97-bebe-4a5c-9f8a-f5c0b1a9bfe6 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:00.302779 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f356a97-bebe-4a5c-9f8a-f5c0b1a9bfe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:00.303091 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f356a97-bebe-4a5c-9f8a-f5c0b1a9bfe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:00.305090 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f356a97-bebe-4a5c-9f8a-f5c0b1a9bfe6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:00.309735 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36704d53-3f17-490c-b7f8-79593ab980ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:00.310333 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36704d53-3f17-490c-b7f8-79593ab980ba None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:00.310614 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36704d53-3f17-490c-b7f8-79593ab980ba None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:00.310886 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36704d53-3f17-490c-b7f8-79593ab980ba None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:00.311563 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36704d53-3f17-490c-b7f8-79593ab980ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:00.311871 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36704d53-3f17-490c-b7f8-79593ab980ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:00.313242 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36704d53-3f17-490c-b7f8-79593ab980ba None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:00.316514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 257/510] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:00.317301 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f356a97-bebe-4a5c-9f8a-f5c0b1a9bfe6 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:00.326165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 254/511] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:00.326962 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36704d53-3f17-490c-b7f8-79593ab980ba None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:00.370127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:00.419490 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f356a97-bebe-4a5c-9f8a-f5c0b1a9bfe6 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:00.425262 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36704d53-3f17-490c-b7f8-79593ab980ba None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:00.452759 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78915424-a560-41d5-8b57-aa78eb26d7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:00.453366 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78915424-a560-41d5-8b57-aa78eb26d7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:00.453647 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78915424-a560-41d5-8b57-aa78eb26d7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:00.453918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78915424-a560-41d5-8b57-aa78eb26d7e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:00.454602 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78915424-a560-41d5-8b57-aa78eb26d7e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:00.454903 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78915424-a560-41d5-8b57-aa78eb26d7e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:00.456285 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78915424-a560-41d5-8b57-aa78eb26d7e6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:00.459121 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05684ac2-a63a-4fc7-a814-4a705f08feb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:00.459775 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05684ac2-a63a-4fc7-a814-4a705f08feb4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:00.460628 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05684ac2-a63a-4fc7-a814-4a705f08feb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:00.460912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05684ac2-a63a-4fc7-a814-4a705f08feb4 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:00.461703 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05684ac2-a63a-4fc7-a814-4a705f08feb4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:00.462011 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05684ac2-a63a-4fc7-a814-4a705f08feb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:00.463410 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05684ac2-a63a-4fc7-a814-4a705f08feb4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:00.467757 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 258/512] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:00.468569 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78915424-a560-41d5-8b57-aa78eb26d7e6 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:00.502240 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 255/513] 10.222.0.40 () {56 vars in 1137 bytes} [Wed Jul 27 15:12:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:00.503062 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05684ac2-a63a-4fc7-a814-4a705f08feb4 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:00.520486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:00.569932 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78915424-a560-41d5-8b57-aa78eb26d7e6 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:00.601111 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:00.604720 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05684ac2-a63a-4fc7-a814-4a705f08feb4 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:00.607490 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6a70a-d12b-467d-9b1b-2cd351e7b422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:00.608160 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6a70a-d12b-467d-9b1b-2cd351e7b422 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:00.608443 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6a70a-d12b-467d-9b1b-2cd351e7b422 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:00.608717 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6a70a-d12b-467d-9b1b-2cd351e7b422 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:00.619760 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6a70a-d12b-467d-9b1b-2cd351e7b422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:00.621260 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6a70a-d12b-467d-9b1b-2cd351e7b422 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:00.635796 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-57a6a70a-d12b-467d-9b1b-2cd351e7b422 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:00.635796 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:00.635796 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:00.635796 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:00.635796 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:00.635796 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:00.635796 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:00.635796 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:00.635796 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:00.635796 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:00.635796 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:00.635796 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:00.635796 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:00.635796 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:00.635796 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:00.636860 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:00.636860 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:00.636860 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:00.636860 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:00.636860 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:00.636860 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:00.636860 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:00.636860 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:00.636860 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:00.636860 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:00.636860 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:00.636860 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:00.636860 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:00.636860 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:00.636860 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:00.636860 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:00.636860 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:00.637697 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:00.637697 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:00.637697 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:00.637697 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:00.637697 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 259/514] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:00.637697 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6a70a-d12b-467d-9b1b-2cd351e7b422 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:00.643067 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59607a0a-c0bd-4225-a0d6-f62f63634bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:00.643684 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59607a0a-c0bd-4225-a0d6-f62f63634bc1 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:00.643966 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59607a0a-c0bd-4225-a0d6-f62f63634bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:00.644272 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59607a0a-c0bd-4225-a0d6-f62f63634bc1 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:00.644951 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59607a0a-c0bd-4225-a0d6-f62f63634bc1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:00.646388 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59607a0a-c0bd-4225-a0d6-f62f63634bc1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:00.667484 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 256/515] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Jul 27 15:12:00 2022] POST /identity/v3/users => generated 247 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:12:00.668942 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59607a0a-c0bd-4225-a0d6-f62f63634bc1 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:00.758122 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6a70a-d12b-467d-9b1b-2cd351e7b422 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:00.761399 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:00.781933 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59607a0a-c0bd-4225-a0d6-f62f63634bc1 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:00.799864 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416a7f4-229a-4063-8f7e-2f4f2d136908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:00.800546 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416a7f4-229a-4063-8f7e-2f4f2d136908 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:00.800836 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416a7f4-229a-4063-8f7e-2f4f2d136908 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:00.801117 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416a7f4-229a-4063-8f7e-2f4f2d136908 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:00.809616 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416a7f4-229a-4063-8f7e-2f4f2d136908 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:00.813384 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c416a7f4-229a-4063-8f7e-2f4f2d136908 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:00.823418 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f57878-1e56-42d7-acc0-861967c01ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:00.824183 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f57878-1e56-42d7-acc0-861967c01ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:00.824405 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f57878-1e56-42d7-acc0-861967c01ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:00.824672 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f57878-1e56-42d7-acc0-861967c01ee0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:00.828246 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-c416a7f4-229a-4063-8f7e-2f4f2d136908 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:00.828246 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:00.828246 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:00.828246 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:00.828246 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:00.828246 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:00.828246 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:00.828246 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:00.828246 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:00.828246 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:00.828246 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:00.828246 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:00.828246 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:12:00.828246 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:12:00.828246 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:12:00.829067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:12:00.829067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:00.829067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:00.829067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:00.829067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:00.829067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:00.829067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:00.829067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:00.829067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:00.829067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:00.829067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:00.829067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:00.829067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:00.829067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:00.829067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:00.829067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:00.829067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:00.830486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:12:00.830486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:12:00.830486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:12:00.830486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:12:00.830486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:12:00.830486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:12:00.830486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:00.830486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:00.830486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 260/516] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:12:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:00.830486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416a7f4-229a-4063-8f7e-2f4f2d136908 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:00.832503 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f57878-1e56-42d7-acc0-861967c01ee0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:00.834180 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f57878-1e56-42d7-acc0-861967c01ee0 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:00.845669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-f1f57878-1e56-42d7-acc0-861967c01ee0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 15:12:00.845669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:00.845669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:00.845669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:00.845669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:00.845669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:00.845669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:00.845669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:00.845669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:00.845669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:00.845669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:00.845669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:00.845669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:12:00.845669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:12:00.845669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:12:00.845669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:12:00.846784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:00.846784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:00.846784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:12:00.846784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:00.846784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:12:00.846784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:00.846784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:00.846784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:00.846784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:00.846784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:00.846784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:00.846784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:00.846784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:00.846784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:00.846784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:00.846784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:00.846784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:00.846784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:00.848090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:00.848090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:00.848090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:12:00.848090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:12:00.848090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:12:00.848090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:12:00.848090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:12:00.848090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:12:00.848090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 15:12:00.848090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:00.848090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 257/517] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:12:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:00.848090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f57878-1e56-42d7-acc0-861967c01ee0 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:00.869631 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:00.952252 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416a7f4-229a-4063-8f7e-2f4f2d136908 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:00.957228 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f57878-1e56-42d7-acc0-861967c01ee0 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:00.990017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc1be1-2c50-416b-9692-d5e559d7e3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:00.990637 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc1be1-2c50-416b-9692-d5e559d7e3ea None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:00.990926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc1be1-2c50-416b-9692-d5e559d7e3ea None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:00.991803 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fc1be1-2c50-416b-9692-d5e559d7e3ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:00.993993 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c33a9-b593-4198-b259-61c79a7e37ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:00.994598 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c33a9-b593-4198-b259-61c79a7e37ed None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:00.994877 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c33a9-b593-4198-b259-61c79a7e37ed None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:00.995150 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c33a9-b593-4198-b259-61c79a7e37ed None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:00.995839 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c33a9-b593-4198-b259-61c79a7e37ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:00.996168 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c33a9-b593-4198-b259-61c79a7e37ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:00.997533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9c33a9-b593-4198-b259-61c79a7e37ed None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:01.013906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 258/518] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:01.013906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c33a9-b593-4198-b259-61c79a7e37ed None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:01.029679 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:01.071938 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc1be1-2c50-416b-9692-d5e559d7e3ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:01.073577 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fc1be1-2c50-416b-9692-d5e559d7e3ea None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:01.091682 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:01.115391 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9c33a9-b593-4198-b259-61c79a7e37ed None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:01.151338 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de80cfd-6661-42ab-bb88-a16f87ea0504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:01.151961 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de80cfd-6661-42ab-bb88-a16f87ea0504 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:01.152274 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de80cfd-6661-42ab-bb88-a16f87ea0504 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:01.152556 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de80cfd-6661-42ab-bb88-a16f87ea0504 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:01.153315 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de80cfd-6661-42ab-bb88-a16f87ea0504 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:01.153629 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de80cfd-6661-42ab-bb88-a16f87ea0504 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:01.155059 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de80cfd-6661-42ab-bb88-a16f87ea0504 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:01.174641 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 259/519] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jul 27 15:12:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:01.175561 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de80cfd-6661-42ab-bb88-a16f87ea0504 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:01.196918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 261/520] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:12:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 15:12:01.196918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc1be1-2c50-416b-9692-d5e559d7e3ea None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:01.258381 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:01.292669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de80cfd-6661-42ab-bb88-a16f87ea0504 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:01.302055 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fc1be1-2c50-416b-9692-d5e559d7e3ea None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:01.329187 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbcf0e-ffbb-4742-aca6-4544e6204502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:01.329861 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbcf0e-ffbb-4742-aca6-4544e6204502 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:01.330149 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbcf0e-ffbb-4742-aca6-4544e6204502 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:01.330436 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbcf0e-ffbb-4742-aca6-4544e6204502 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:01.331212 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fbcf0e-ffbb-4742-aca6-4544e6204502 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:01.331518 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fbcf0e-ffbb-4742-aca6-4544e6204502 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:01.333035 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fbcf0e-ffbb-4742-aca6-4544e6204502 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:01.337001 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:01.338318 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e0605-23e1-4dd3-80c7-a2fd97eba2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:01.338959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e0605-23e1-4dd3-80c7-a2fd97eba2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:01.339243 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e0605-23e1-4dd3-80c7-a2fd97eba2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:01.339518 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e0605-23e1-4dd3-80c7-a2fd97eba2d8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:01.347305 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e0605-23e1-4dd3-80c7-a2fd97eba2d8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:01.348782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e0605-23e1-4dd3-80c7-a2fd97eba2d8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:01.357731 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 260/521] 10.222.0.40 () {56 vars in 1137 bytes} [Wed Jul 27 15:12:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:01.357731 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbcf0e-ffbb-4742-aca6-4544e6204502 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:01.364027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-c50e0605-23e1-4dd3-80c7-a2fd97eba2d8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 15:12:01.364027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:01.364027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:01.364027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:01.364027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:01.364027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:01.364027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:01.364027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:01.364027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:01.364027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:01.364027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:01.364027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:01.364027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:12:01.364027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:12:01.364027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:12:01.364027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:12:01.365074 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:01.365074 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:01.365074 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:12:01.365074 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:01.365074 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:12:01.365074 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:01.365074 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:01.365074 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:01.365074 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:01.365074 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:01.365074 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:01.365074 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:01.365074 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:01.365074 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:01.365074 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:01.365074 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:01.365074 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:01.365074 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:01.365994 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:01.365994 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:01.365994 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:12:01.365994 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:12:01.365994 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:12:01.365994 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:12:01.365994 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:12:01.365994 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:12:01.365994 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 15:12:01.365994 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:01.365994 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 262/522] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jul 27 15:12:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:01.365994 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e0605-23e1-4dd3-80c7-a2fd97eba2d8 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:01.479741 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbcf0e-ffbb-4742-aca6-4544e6204502 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:01.480515 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e0605-23e1-4dd3-80c7-a2fd97eba2d8 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:01.504754 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:01.516115 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600a24c-2d7f-4431-98af-1b1b143eb644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:01.516721 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600a24c-2d7f-4431-98af-1b1b143eb644 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:01.516819 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b964a08-5ac2-4e2b-8d76-976c34cf0d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:01.516992 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600a24c-2d7f-4431-98af-1b1b143eb644 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:01.517263 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c600a24c-2d7f-4431-98af-1b1b143eb644 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:01.517583 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b964a08-5ac2-4e2b-8d76-976c34cf0d92 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:01.517933 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b964a08-5ac2-4e2b-8d76-976c34cf0d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:01.518062 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600a24c-2d7f-4431-98af-1b1b143eb644 None admin] RBAC: Adding query filter params (role.id=6a54ab92d32843d6bc4c2dcedae4bd13, scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5, user.id=d3e01aa0ef1340cbba7170bac4a82783) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:01.518344 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b964a08-5ac2-4e2b-8d76-976c34cf0d92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:01.518434 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600a24c-2d7f-4431-98af-1b1b143eb644 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:01.519741 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c600a24c-2d7f-4431-98af-1b1b143eb644 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:01.525792 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 261/523] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:12:01 2022] GET /identity/v3/role_assignments?user.id=d3e01aa0ef1340cbba7170bac4a82783&scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5&role.id=6a54ab92d32843d6bc4c2dcedae4bd13 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:01.526394 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600a24c-2d7f-4431-98af-1b1b143eb644 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:01.549159 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b964a08-5ac2-4e2b-8d76-976c34cf0d92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:01.550643 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b964a08-5ac2-4e2b-8d76-976c34cf0d92 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:01.573481 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-2b964a08-5ac2-4e2b-8d76-976c34cf0d92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:01.573481 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:01.573481 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:01.573481 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:01.573481 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:01.573481 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:01.573481 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:01.573481 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:01.573481 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:01.573481 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:01.573481 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:01.573481 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:01.573481 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:01.573481 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:01.573481 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:01.574523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:01.574523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:01.574523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:01.574523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:01.574523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:01.574523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:01.574523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:01.574523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:01.574523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:01.574523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:01.574523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:01.574523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:01.574523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:01.574523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:01.574523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:01.574523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:01.574523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:01.575357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:01.575357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:01.575357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:01.575357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:01.578057 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 263/524] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:01.579124 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b964a08-5ac2-4e2b-8d76-976c34cf0d92 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:01.599970 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:01.650467 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c600a24c-2d7f-4431-98af-1b1b143eb644 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:01.688128 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019adf50-6d13-4bbe-951d-48c7dc94891f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:01.689597 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019adf50-6d13-4bbe-951d-48c7dc94891f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:01.689937 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019adf50-6d13-4bbe-951d-48c7dc94891f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:01.690275 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019adf50-6d13-4bbe-951d-48c7dc94891f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:01.730425 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b964a08-5ac2-4e2b-8d76-976c34cf0d92 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:01.767930 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0d599-d596-498a-af46-bcd7f9209548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:01.769414 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0d599-d596-498a-af46-bcd7f9209548 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:01.769929 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0d599-d596-498a-af46-bcd7f9209548 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:01.770386 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0d599-d596-498a-af46-bcd7f9209548 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:01.771373 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b0d599-d596-498a-af46-bcd7f9209548 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:01.771910 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b0d599-d596-498a-af46-bcd7f9209548 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:01.774272 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b0d599-d596-498a-af46-bcd7f9209548 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:01.777105 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019adf50-6d13-4bbe-951d-48c7dc94891f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:01.779376 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019adf50-6d13-4bbe-951d-48c7dc94891f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:01.800122 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 264/525] 10.222.0.40 () {56 vars in 1139 bytes} [Wed Jul 27 15:12:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:01.801346 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0d599-d596-498a-af46-bcd7f9209548 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:01.838926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:01.855032 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:01.909297 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 262/526] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:12:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 15:12:01.911176 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019adf50-6d13-4bbe-951d-48c7dc94891f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:01.922560 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0d599-d596-498a-af46-bcd7f9209548 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:01.967207 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341583d-49b8-4160-8ed2-17502bd4d6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:01.968175 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341583d-49b8-4160-8ed2-17502bd4d6d0 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:01.968686 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341583d-49b8-4160-8ed2-17502bd4d6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:01.969234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d341583d-49b8-4160-8ed2-17502bd4d6d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:01.970100 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341583d-49b8-4160-8ed2-17502bd4d6d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:01.970671 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341583d-49b8-4160-8ed2-17502bd4d6d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:01.972336 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d341583d-49b8-4160-8ed2-17502bd4d6d0 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:01.985053 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 265/527] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:01.986161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341583d-49b8-4160-8ed2-17502bd4d6d0 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:02.024262 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019adf50-6d13-4bbe-951d-48c7dc94891f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:02.060530 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf5e31-8239-4116-99e6-174b618cd8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:02.061032 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf5e31-8239-4116-99e6-174b618cd8ce None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:02.061313 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf5e31-8239-4116-99e6-174b618cd8ce None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:02.061588 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bf5e31-8239-4116-99e6-174b618cd8ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:02.089133 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:02.092219 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:02.101177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d341583d-49b8-4160-8ed2-17502bd4d6d0 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:02.132092 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf5e31-8239-4116-99e6-174b618cd8ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:02.133799 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bf5e31-8239-4116-99e6-174b618cd8ce None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:02.139303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ac957-8dbb-4364-9f5f-4a8f956a2832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:02.140299 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ac957-8dbb-4364-9f5f-4a8f956a2832 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:02.140787 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ac957-8dbb-4364-9f5f-4a8f956a2832 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:02.141239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113ac957-8dbb-4364-9f5f-4a8f956a2832 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:02.154217 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ac957-8dbb-4364-9f5f-4a8f956a2832 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:02.155984 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113ac957-8dbb-4364-9f5f-4a8f956a2832 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:02.172839 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-113ac957-8dbb-4364-9f5f-4a8f956a2832 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:02.172839 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:02.172839 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:02.172839 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:02.172839 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:02.172839 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:02.172839 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:02.172839 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:02.172839 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:02.172839 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:02.172839 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:02.172839 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:02.172839 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:02.172839 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:02.172839 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:02.173737 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:02.173737 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:02.173737 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:02.173737 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:02.173737 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:02.173737 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:02.173737 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:02.173737 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:02.173737 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:02.173737 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:02.173737 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:02.173737 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:02.173737 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:02.173737 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:02.173737 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:02.173737 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:02.173737 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:02.174580 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:02.174580 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:02.174580 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:02.174580 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:02.176863 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 266/528] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:02.177963 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ac957-8dbb-4364-9f5f-4a8f956a2832 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:02.244402 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 263/529] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:12:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 15:12:02.245376 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf5e31-8239-4116-99e6-174b618cd8ce None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:02.294303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113ac957-8dbb-4364-9f5f-4a8f956a2832 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:02.306360 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:02.333837 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e411e-9d6e-4243-8266-01eb75189268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:02.335405 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e411e-9d6e-4243-8266-01eb75189268 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:02.335885 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e411e-9d6e-4243-8266-01eb75189268 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:02.336386 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4e411e-9d6e-4243-8266-01eb75189268 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:02.344254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e411e-9d6e-4243-8266-01eb75189268 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:02.346027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4e411e-9d6e-4243-8266-01eb75189268 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:02.350061 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bf5e31-8239-4116-99e6-174b618cd8ce None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:02.359088 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-de4e411e-9d6e-4243-8266-01eb75189268 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:02.359088 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:02.359088 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:02.359088 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:02.359088 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:02.359088 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:02.359088 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:02.359088 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:02.359088 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:02.359088 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:02.359088 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:02.359088 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:02.359088 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:12:02.359088 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:12:02.359088 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:12:02.359938 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:12:02.359938 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:02.359938 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:02.359938 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:02.359938 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:02.359938 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:02.359938 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:02.359938 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:02.359938 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:02.359938 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:02.359938 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:02.359938 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:02.359938 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:02.359938 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:02.359938 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:02.359938 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:02.359938 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:02.360815 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:12:02.360815 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:12:02.360815 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:12:02.360815 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:12:02.360815 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:12:02.360815 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:12:02.360815 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:02.360815 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:02.363250 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 267/530] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:12:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:02.364402 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e411e-9d6e-4243-8266-01eb75189268 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:02.374599 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:02.387719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97160075-f1a1-4777-b99c-03040d177ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:02.388299 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97160075-f1a1-4777-b99c-03040d177ddb None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:02.388581 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97160075-f1a1-4777-b99c-03040d177ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:02.388858 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97160075-f1a1-4777-b99c-03040d177ddb None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:02.389551 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97160075-f1a1-4777-b99c-03040d177ddb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:02.389857 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97160075-f1a1-4777-b99c-03040d177ddb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:02.391270 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97160075-f1a1-4777-b99c-03040d177ddb None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:02.408381 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 264/531] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:02.409252 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97160075-f1a1-4777-b99c-03040d177ddb None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:02.477566 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4e411e-9d6e-4243-8266-01eb75189268 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:02.515419 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824dbbc-970b-4967-9335-55fb7c181fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:02.516454 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824dbbc-970b-4967-9335-55fb7c181fcd None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:02.516935 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824dbbc-970b-4967-9335-55fb7c181fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:02.517403 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824dbbc-970b-4967-9335-55fb7c181fcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:02.517840 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97160075-f1a1-4777-b99c-03040d177ddb None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:02.530109 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824dbbc-970b-4967-9335-55fb7c181fcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:02.531859 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824dbbc-970b-4967-9335-55fb7c181fcd None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:02.537084 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:02.550544 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-1824dbbc-970b-4967-9335-55fb7c181fcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:02.550544 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:02.550544 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:02.550544 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:02.550544 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:02.550544 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:02.550544 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:02.550544 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:02.550544 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:02.550544 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:02.550544 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:02.550544 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:02.550544 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:02.550544 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:02.550544 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:02.551417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:02.551417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:02.551417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:02.551417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:02.551417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:02.551417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:02.551417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:02.551417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:02.551417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:02.551417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:02.551417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:02.551417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:02.551417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:02.551417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:02.551417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:02.551417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:02.551417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:02.552285 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:02.552285 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:02.552285 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:02.552285 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:02.554168 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 268/532] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:02.555137 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824dbbc-970b-4967-9335-55fb7c181fcd None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:02.555431 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85caa073-c3be-4c40-849a-e407ecfc1ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:02.556174 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caa073-c3be-4c40-849a-e407ecfc1ffe None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:02.556461 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caa073-c3be-4c40-849a-e407ecfc1ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:02.556751 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85caa073-c3be-4c40-849a-e407ecfc1ffe None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:02.557498 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85caa073-c3be-4c40-849a-e407ecfc1ffe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:02.557806 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85caa073-c3be-4c40-849a-e407ecfc1ffe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:02.559635 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85caa073-c3be-4c40-849a-e407ecfc1ffe None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:02.575973 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 265/533] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jul 27 15:12:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:02.576452 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85caa073-c3be-4c40-849a-e407ecfc1ffe None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:02.629613 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:02.679229 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824dbbc-970b-4967-9335-55fb7c181fcd None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:02.687175 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85caa073-c3be-4c40-849a-e407ecfc1ffe None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:02.721722 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694aec67-e80a-4a7e-a036-9fdd463e84e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:02.722727 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694aec67-e80a-4a7e-a036-9fdd463e84e3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:02.723210 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694aec67-e80a-4a7e-a036-9fdd463e84e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:02.723481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4070b-b04c-4270-ac18-84c29f6545e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:02.724121 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4070b-b04c-4270-ac18-84c29f6545e8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:02.724405 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4070b-b04c-4270-ac18-84c29f6545e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:02.724677 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4070b-b04c-4270-ac18-84c29f6545e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:02.724881 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694aec67-e80a-4a7e-a036-9fdd463e84e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:02.725403 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4070b-b04c-4270-ac18-84c29f6545e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:02.725710 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4070b-b04c-4270-ac18-84c29f6545e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:02.727514 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4070b-b04c-4270-ac18-84c29f6545e8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:02.733067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694aec67-e80a-4a7e-a036-9fdd463e84e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:02.734834 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694aec67-e80a-4a7e-a036-9fdd463e84e3 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:02.739589 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 266/534] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:02.740500 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4070b-b04c-4270-ac18-84c29f6545e8 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:02.748870 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-694aec67-e80a-4a7e-a036-9fdd463e84e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:02.748870 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:02.748870 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:02.748870 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:02.748870 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:02.748870 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:02.748870 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:02.748870 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:02.748870 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:02.748870 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:02.748870 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:02.748870 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:02.748870 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:12:02.748870 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:12:02.748870 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:12:02.749716 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:12:02.749716 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:02.749716 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:02.749716 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:02.749716 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:02.749716 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:02.749716 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:02.749716 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:02.749716 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:02.749716 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:02.749716 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:02.749716 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:02.749716 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:02.749716 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:02.749716 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:02.749716 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:02.749716 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:02.750555 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:12:02.750555 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:12:02.750555 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:12:02.750555 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:12:02.750555 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:12:02.750555 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:12:02.750555 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:02.750555 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:02.753098 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 269/535] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:12:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:02.754150 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694aec67-e80a-4a7e-a036-9fdd463e84e3 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:02.791941 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:02.869501 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4070b-b04c-4270-ac18-84c29f6545e8 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:02.871908 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694aec67-e80a-4a7e-a036-9fdd463e84e3 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:02.890121 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:02.905307 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6c618-cf8e-4e2f-8b13-8b8ebac1ca14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:02.905893 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6c618-cf8e-4e2f-8b13-8b8ebac1ca14 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:02.906177 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6c618-cf8e-4e2f-8b13-8b8ebac1ca14 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:02.906448 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b6c618-cf8e-4e2f-8b13-8b8ebac1ca14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:02.907229 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b6c618-cf8e-4e2f-8b13-8b8ebac1ca14 None admin] RBAC: Adding query filter params (role.id=6a54ab92d32843d6bc4c2dcedae4bd13, scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5, user.id=2f71721ca75a461d92044091564de424) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:02.907538 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b6c618-cf8e-4e2f-8b13-8b8ebac1ca14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:02.908363 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9860d-23da-4c6b-baa9-77ddddf3a3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:02.908991 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9860d-23da-4c6b-baa9-77ddddf3a3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:02.909086 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b6c618-cf8e-4e2f-8b13-8b8ebac1ca14 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:02.909273 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9860d-23da-4c6b-baa9-77ddddf3a3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:02.909546 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9860d-23da-4c6b-baa9-77ddddf3a3a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:02.924039 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 267/536] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:12:02 2022] GET /identity/v3/role_assignments?user.id=2f71721ca75a461d92044091564de424&scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5&role.id=6a54ab92d32843d6bc4c2dcedae4bd13 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:02.924039 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6c618-cf8e-4e2f-8b13-8b8ebac1ca14 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:02.926152 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9860d-23da-4c6b-baa9-77ddddf3a3a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:02.927710 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9860d-23da-4c6b-baa9-77ddddf3a3a2 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:02.941502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-d0a9860d-23da-4c6b-baa9-77ddddf3a3a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:02.941502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:02.941502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:02.941502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:02.941502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:02.941502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:02.941502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:02.941502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:02.941502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:02.941502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:02.941502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:02.941502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:02.941502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:12:02.941502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:12:02.941502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:12:02.942582 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:12:02.942582 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:02.942582 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:02.942582 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:02.942582 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:02.942582 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:02.942582 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:02.942582 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:02.942582 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:02.942582 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:02.942582 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:02.942582 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:02.942582 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:02.942582 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:02.942582 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:02.942582 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:02.942582 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:02.943660 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:12:02.943660 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:12:02.943660 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:12:02.943660 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:12:02.943660 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:12:02.943660 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:12:02.943660 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:02.943660 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:02.945914 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 270/537] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:12:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:02.948605 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0addfd-a036-46f8-8bab-b4c4068004d7 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:02.948605 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0addfd-a036-46f8-8bab-b4c4068004d7 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:02.948605 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0addfd-a036-46f8-8bab-b4c4068004d7 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:02.949179 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 271/538] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:02.950496 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0addfd-a036-46f8-8bab-b4c4068004d7 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:03.048602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b6c618-cf8e-4e2f-8b13-8b8ebac1ca14 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:03.050597 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:03.089834 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94e10d4-8e0e-4148-af05-d7d97ddf9c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:03.090603 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e10d4-8e0e-4148-af05-d7d97ddf9c1f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:03.091353 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e10d4-8e0e-4148-af05-d7d97ddf9c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:03.091755 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94e10d4-8e0e-4148-af05-d7d97ddf9c1f None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:03.092666 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e10d4-8e0e-4148-af05-d7d97ddf9c1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:03.093064 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e10d4-8e0e-4148-af05-d7d97ddf9c1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:03.093688 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0addfd-a036-46f8-8bab-b4c4068004d7 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:03.094715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94e10d4-8e0e-4148-af05-d7d97ddf9c1f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:03.113957 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 268/539] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jul 27 15:12:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:03.115615 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7e783-9339-4a29-88d2-c681b2e15e04 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:03.116164 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7e783-9339-4a29-88d2-c681b2e15e04 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:03.116646 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7e783-9339-4a29-88d2-c681b2e15e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:03.137661 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-aed7e783-9339-4a29-88d2-c681b2e15e04 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:03.139129 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-aed7e783-9339-4a29-88d2-c681b2e15e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:03.142726 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4cfaa-7690-417e-825e-1e414d4c4c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:03.143583 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4cfaa-7690-417e-825e-1e414d4c4c70 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:03.144100 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4cfaa-7690-417e-825e-1e414d4c4c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:03.144624 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d4cfaa-7690-417e-825e-1e414d4c4c70 None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:03.145578 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4cfaa-7690-417e-825e-1e414d4c4c70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:03.146091 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4cfaa-7690-417e-825e-1e414d4c4c70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:03.148394 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d4cfaa-7690-417e-825e-1e414d4c4c70 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:03.171434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 272/540] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jul 27 15:12:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:03.172738 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4cfaa-7690-417e-825e-1e414d4c4c70 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:03.220734 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:03.228133 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 269/541] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:12:03.230665 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7e783-9339-4a29-88d2-c681b2e15e04 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:03.302742 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d4cfaa-7690-417e-825e-1e414d4c4c70 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:03.357044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:03.357973 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6d464-828d-4cca-97cc-2865e7891fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:03.358674 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6d464-828d-4cca-97cc-2865e7891fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:03.359707 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6d464-828d-4cca-97cc-2865e7891fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:03.360065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6d464-828d-4cca-97cc-2865e7891fe8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:03.360858 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6d464-828d-4cca-97cc-2865e7891fe8 None admin] RBAC: Adding query filter params (role.id=6a54ab92d32843d6bc4c2dcedae4bd13, scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5, user.id=20aa56e1154649cb8b440dae788c922c) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:03.361173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6d464-828d-4cca-97cc-2865e7891fe8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:03.362618 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6d464-828d-4cca-97cc-2865e7891fe8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:03.368565 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 273/542] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:12:03 2022] GET /identity/v3/role_assignments?user.id=20aa56e1154649cb8b440dae788c922c&scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5&role.id=6a54ab92d32843d6bc4c2dcedae4bd13 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:03.369278 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6d464-828d-4cca-97cc-2865e7891fe8 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:03.374218 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7e783-9339-4a29-88d2-c681b2e15e04 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:03.419576 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6239da-2cfe-4cc4-958b-2de5be9d4162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:03.420610 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6239da-2cfe-4cc4-958b-2de5be9d4162 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:03.421666 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6239da-2cfe-4cc4-958b-2de5be9d4162 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:03.422154 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6239da-2cfe-4cc4-958b-2de5be9d4162 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:03.423185 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6239da-2cfe-4cc4-958b-2de5be9d4162 None admin] RBAC: Adding query filter params (role.id=6a54ab92d32843d6bc4c2dcedae4bd13, scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5, user.id=227dac1eaefc4d0a8d3cc8a6dee2ecba) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:03.423719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6239da-2cfe-4cc4-958b-2de5be9d4162 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:03.426029 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6239da-2cfe-4cc4-958b-2de5be9d4162 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:03.433290 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 270/543] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:12:03 2022] GET /identity/v3/role_assignments?user.id=227dac1eaefc4d0a8d3cc8a6dee2ecba&scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5&role.id=6a54ab92d32843d6bc4c2dcedae4bd13 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:03.539437 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52e180-7217-4ea6-852c-528b0105dd4c None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:03.539731 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52e180-7217-4ea6-852c-528b0105dd4c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:03.539924 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f52e180-7217-4ea6-852c-528b0105dd4c None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:03.541569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 271/544] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:12:03.547098 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdd677-b230-4cb6-b8a7-12e08bc15042 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:03.547432 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdd677-b230-4cb6-b8a7-12e08bc15042 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:03.547663 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cdd677-b230-4cb6-b8a7-12e08bc15042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:03.571970 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-03cdd677-b230-4cb6-b8a7-12e08bc15042 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:03.573159 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6d464-828d-4cca-97cc-2865e7891fe8 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:03.573866 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-03cdd677-b230-4cb6-b8a7-12e08bc15042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:03.580064 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:03.627453 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51e18a-a315-4bb4-bb0e-c6628690c00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:03.628821 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51e18a-a315-4bb4-bb0e-c6628690c00f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:03.628821 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51e18a-a315-4bb4-bb0e-c6628690c00f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:03.628821 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51e18a-a315-4bb4-bb0e-c6628690c00f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:03.648368 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e51e18a-a315-4bb4-bb0e-c6628690c00f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:12:03.653863 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-5e51e18a-a315-4bb4-bb0e-c6628690c00f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:12:03.653863 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:03.653863 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:03.653863 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:03.653863 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:03.653863 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:03.653863 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:03.653863 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:03.653863 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:03.653863 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:03.653863 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:03.653863 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:03.653863 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:12:03.653863 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:12:03.653863 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:12:03.653863 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:12:03.654777 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:12:03.654777 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:12:03.654777 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:12:03.654777 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:12:03.654777 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:03.654777 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:03.654777 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:03.654777 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:03.654777 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:03.654777 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:03.654777 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:03.654777 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:03.654777 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:03.654777 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:03.654777 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:03.654777 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:03.655584 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:03.655584 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:03.655584 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:03.655584 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:03.655584 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:12:03.655584 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:12:03.655584 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:12:03.655584 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:12:03.655584 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:12:03.655584 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:12:03.655584 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:12:03.655584 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:03.655584 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 274/545] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jul 27 15:12:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:03.661008 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51e18a-a315-4bb4-bb0e-c6628690c00f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:03.706216 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 272/546] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:12:03.743246 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cdd677-b230-4cb6-b8a7-12e08bc15042 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:03.789946 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51e18a-a315-4bb4-bb0e-c6628690c00f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:03.827728 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fb695-6d33-48c9-9606-b189d966a8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:03.828728 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fb695-6d33-48c9-9606-b189d966a8f3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:03.829215 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fb695-6d33-48c9-9606-b189d966a8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:03.829716 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fb695-6d33-48c9-9606-b189d966a8f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:03.830667 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fb695-6d33-48c9-9606-b189d966a8f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:03.831172 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fb695-6d33-48c9-9606-b189d966a8f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:03.832925 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fb695-6d33-48c9-9606-b189d966a8f3 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:03.842600 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 275/547] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jul 27 15:12:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:03.847858 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fb695-6d33-48c9-9606-b189d966a8f3 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:03.875681 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:03.960014 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fb695-6d33-48c9-9606-b189d966a8f3 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:03.965183 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:03.997843 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7e09d-6c55-4d20-a1d3-4aeab364f7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:03.998864 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7e09d-6c55-4d20-a1d3-4aeab364f7df None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:03.999347 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7e09d-6c55-4d20-a1d3-4aeab364f7df None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:03.999663 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cdd677-b230-4cb6-b8a7-12e08bc15042 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:04.000164 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b7e09d-6c55-4d20-a1d3-4aeab364f7df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:04.011488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b7e09d-6c55-4d20-a1d3-4aeab364f7df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:04.013262 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b7e09d-6c55-4d20-a1d3-4aeab364f7df None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:04.028309 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-52b7e09d-6c55-4d20-a1d3-4aeab364f7df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:04.028309 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:04.028309 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:04.028309 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:04.028309 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:04.028309 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:04.028309 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:04.028309 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:04.028309 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:04.028309 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:04.028309 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:04.028309 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:04.028309 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:04.028309 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:04.028309 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:04.029202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:04.029202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:04.029202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:04.029202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:04.029202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:04.029202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:04.029202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:04.029202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:04.029202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:04.029202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:04.029202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:04.029202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:04.029202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:04.029202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:04.029202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:04.029202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:04.029202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:04.030071 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:04.030071 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:04.030071 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:04.030071 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:04.032237 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 276/548] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:04.038353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7e09d-6c55-4d20-a1d3-4aeab364f7df None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:04.075284 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdea066-e93d-4f08-a309-8427c22ef61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:04.076358 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdea066-e93d-4f08-a309-8427c22ef61a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:04.077136 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdea066-e93d-4f08-a309-8427c22ef61a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:04.077624 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdea066-e93d-4f08-a309-8427c22ef61a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:04.089960 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdea066-e93d-4f08-a309-8427c22ef61a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:12:04.095912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-7fdea066-e93d-4f08-a309-8427c22ef61a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:12:04.095912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:04.095912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:04.095912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:04.095912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:04.095912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:04.095912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:04.095912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:04.095912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:04.095912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:04.095912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:04.095912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:04.095912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:12:04.095912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:12:04.095912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:12:04.095912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:12:04.096813 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:12:04.096813 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:12:04.096813 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:12:04.096813 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:12:04.096813 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:04.096813 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:04.096813 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:04.096813 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:04.096813 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:04.096813 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:04.096813 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:04.096813 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:04.096813 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:04.096813 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:04.096813 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:04.096813 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:04.098187 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:04.098187 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:04.098187 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:04.098187 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:04.098187 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:12:04.098187 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:12:04.098187 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:12:04.098187 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:12:04.098187 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:12:04.098187 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:12:04.098187 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:12:04.098187 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:04.101667 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 273/549] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jul 27 15:12:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:04.107269 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdea066-e93d-4f08-a309-8427c22ef61a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:04.210487 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:04.259311 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b7e09d-6c55-4d20-a1d3-4aeab364f7df None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:04.267536 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdea066-e93d-4f08-a309-8427c22ef61a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:04.331923 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2b4f7-cafe-4a0e-8819-6f51c6974004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:04.332493 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2b4f7-cafe-4a0e-8819-6f51c6974004 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:04.332776 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2b4f7-cafe-4a0e-8819-6f51c6974004 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:04.333051 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2b4f7-cafe-4a0e-8819-6f51c6974004 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:04.333754 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2b4f7-cafe-4a0e-8819-6f51c6974004 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:04.334063 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2b4f7-cafe-4a0e-8819-6f51c6974004 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:04.335509 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2b4f7-cafe-4a0e-8819-6f51c6974004 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:04.340513 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd29ef-52ae-4777-a40b-a18a0dd0d755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:04.341124 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd29ef-52ae-4777-a40b-a18a0dd0d755 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:04.341407 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd29ef-52ae-4777-a40b-a18a0dd0d755 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:04.341686 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbd29ef-52ae-4777-a40b-a18a0dd0d755 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:04.342403 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd29ef-52ae-4777-a40b-a18a0dd0d755 None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:04.342710 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd29ef-52ae-4777-a40b-a18a0dd0d755 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:04.344085 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbd29ef-52ae-4777-a40b-a18a0dd0d755 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:04.360043 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 274/550] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jul 27 15:12:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:04.369012 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd29ef-52ae-4777-a40b-a18a0dd0d755 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:04.369424 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 277/551] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:04.374247 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2b4f7-cafe-4a0e-8819-6f51c6974004 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:04.392053 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:04.554558 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbd29ef-52ae-4777-a40b-a18a0dd0d755 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:04.564837 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2b4f7-cafe-4a0e-8819-6f51c6974004 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:04.614737 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055904bc-8530-4d2a-a5cf-f45d8f3e0051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:04.616681 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055904bc-8530-4d2a-a5cf-f45d8f3e0051 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:04.617186 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055904bc-8530-4d2a-a5cf-f45d8f3e0051 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:04.617657 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055904bc-8530-4d2a-a5cf-f45d8f3e0051 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:04.633753 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055904bc-8530-4d2a-a5cf-f45d8f3e0051 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:04.635795 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055904bc-8530-4d2a-a5cf-f45d8f3e0051 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:04.637177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f20b5c-88a9-486d-89c1-22f653eb0709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:04.638060 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f20b5c-88a9-486d-89c1-22f653eb0709 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:04.638540 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f20b5c-88a9-486d-89c1-22f653eb0709 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:04.639014 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f20b5c-88a9-486d-89c1-22f653eb0709 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:04.643912 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:04.653077 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f20b5c-88a9-486d-89c1-22f653eb0709 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:04.654551 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f20b5c-88a9-486d-89c1-22f653eb0709 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:04.673690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-055904bc-8530-4d2a-a5cf-f45d8f3e0051 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:04.673690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:04.673690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:04.673690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:04.673690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:04.673690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:04.673690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:04.673690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:04.673690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:04.673690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:04.673690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:04.673690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:04.673690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:04.673690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:04.673690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:04.674602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:04.674602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:04.674602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:04.674602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:04.674602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:04.674602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:04.674602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:04.674602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:04.674602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:04.674602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:04.674602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:04.674602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:04.674602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:04.674602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:04.674602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:04.674602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:04.674602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:04.675601 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:04.675601 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:04.675601 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:04.675601 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:04.675601 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 275/552] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:04.677468 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-14f20b5c-88a9-486d-89c1-22f653eb0709 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 15:12:04.677468 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:04.677468 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:04.677468 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:04.677468 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:04.677468 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:04.677468 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:04.677468 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:04.677468 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:04.677468 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:04.677468 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:04.677468 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:04.677468 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:12:04.677468 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:12:04.677468 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:12:04.677468 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:12:04.678450 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:04.678450 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:04.678450 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:12:04.678450 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:04.678450 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:12:04.678450 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:04.678450 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:04.678450 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:04.678450 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:04.678450 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:04.678450 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:04.678450 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:04.678450 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:04.678450 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:04.678450 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:04.678450 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:04.678450 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:04.678450 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:04.680586 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:04.680586 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:04.680586 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:12:04.680586 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:12:04.680586 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:12:04.680586 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:12:04.680586 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:12:04.680586 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:12:04.680586 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 15:12:04.680586 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:04.680586 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 278/553] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jul 27 15:12:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:12:04.681978 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055904bc-8530-4d2a-a5cf-f45d8f3e0051 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:04.685609 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f20b5c-88a9-486d-89c1-22f653eb0709 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:04.789021 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:04.847573 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f20b5c-88a9-486d-89c1-22f653eb0709 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:04.864363 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055904bc-8530-4d2a-a5cf-f45d8f3e0051 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:04.908026 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4702a-da5b-43c7-8f93-4d1c3919ac9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:04.908663 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4702a-da5b-43c7-8f93-4d1c3919ac9d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:04.908912 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4702a-da5b-43c7-8f93-4d1c3919ac9d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:04.909184 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4702a-da5b-43c7-8f93-4d1c3919ac9d None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:04.909975 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4702a-da5b-43c7-8f93-4d1c3919ac9d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:04.910283 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4702a-da5b-43c7-8f93-4d1c3919ac9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:04.911701 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd4702a-da5b-43c7-8f93-4d1c3919ac9d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:04.925882 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6abbb2-71ec-4423-8ba7-227caa41a2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:04.926497 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6abbb2-71ec-4423-8ba7-227caa41a2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:04.926778 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6abbb2-71ec-4423-8ba7-227caa41a2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:04.927046 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6abbb2-71ec-4423-8ba7-227caa41a2b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:04.927733 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6abbb2-71ec-4423-8ba7-227caa41a2b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:04.928063 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6abbb2-71ec-4423-8ba7-227caa41a2b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:04.930036 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6abbb2-71ec-4423-8ba7-227caa41a2b9 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:04.948429 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 279/554] 10.222.0.40 () {56 vars in 1135 bytes} [Wed Jul 27 15:12:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:04.950276 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 276/555] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:04.953799 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4702a-da5b-43c7-8f93-4d1c3919ac9d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:04.955516 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6abbb2-71ec-4423-8ba7-227caa41a2b9 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:05.045934 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:05.121493 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4702a-da5b-43c7-8f93-4d1c3919ac9d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:05.155848 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6abbb2-71ec-4423-8ba7-227caa41a2b9 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:05.198237 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:05.199294 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c05cf-3c94-46a1-8a37-72f2e03e17ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:05.200264 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c05cf-3c94-46a1-8a37-72f2e03e17ef None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:05.200750 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c05cf-3c94-46a1-8a37-72f2e03e17ef None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:05.201196 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c05cf-3c94-46a1-8a37-72f2e03e17ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:05.216742 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25201be-7560-4043-86ab-39d6479eb043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:05.217483 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25201be-7560-4043-86ab-39d6479eb043 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:05.217837 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25201be-7560-4043-86ab-39d6479eb043 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:05.218181 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25201be-7560-4043-86ab-39d6479eb043 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:05.228613 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25201be-7560-4043-86ab-39d6479eb043 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:05.230838 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25201be-7560-4043-86ab-39d6479eb043 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:05.246702 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-a25201be-7560-4043-86ab-39d6479eb043 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 15:12:05.246702 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:05.246702 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:05.246702 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:05.246702 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:05.246702 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:05.246702 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:05.246702 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:05.246702 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:05.246702 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:05.246702 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:05.246702 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:05.246702 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:12:05.246702 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:12:05.246702 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:12:05.246702 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:12:05.252288 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:05.252288 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:05.252288 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:12:05.252288 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:05.252288 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:12:05.252288 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:05.252288 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:05.252288 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:05.252288 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:05.252288 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:05.252288 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:05.252288 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:05.252288 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:05.252288 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:05.252288 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:05.252288 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:05.252288 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:05.252288 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:05.253287 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:05.253287 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:05.253287 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:12:05.253287 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:12:05.253287 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:12:05.253287 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:12:05.253287 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:12:05.253287 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:12:05.253287 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 15:12:05.253287 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:05.253287 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 277/556] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Jul 27 15:12:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:05.253287 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d518d-8983-4497-8095-efcdd7b49959 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:05.253287 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d518d-8983-4497-8095-efcdd7b49959 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:05.253988 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d518d-8983-4497-8095-efcdd7b49959 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:05.253988 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 278/557] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:05.257516 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d518d-8983-4497-8095-efcdd7b49959 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:05.290924 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c05cf-3c94-46a1-8a37-72f2e03e17ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:05.292876 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c05cf-3c94-46a1-8a37-72f2e03e17ef None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:05.363731 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:05.396419 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d518d-8983-4497-8095-efcdd7b49959 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:05.422332 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 280/558] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:12:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 15:12:05.424166 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71acca-5b53-4a5c-bf78-306bf4fb6b9b None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:05.424461 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71acca-5b53-4a5c-bf78-306bf4fb6b9b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:05.424735 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb71acca-5b53-4a5c-bf78-306bf4fb6b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:05.439707 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590a1da-6509-4a32-bb50-7dc36f7fbea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:05.441204 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590a1da-6509-4a32-bb50-7dc36f7fbea6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:05.441964 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590a1da-6509-4a32-bb50-7dc36f7fbea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:05.442436 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a590a1da-6509-4a32-bb50-7dc36f7fbea6 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:05.443425 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590a1da-6509-4a32-bb50-7dc36f7fbea6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:05.444467 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590a1da-6509-4a32-bb50-7dc36f7fbea6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:05.446043 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-bb71acca-5b53-4a5c-bf78-306bf4fb6b9b None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:05.446426 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a590a1da-6509-4a32-bb50-7dc36f7fbea6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:05.447299 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-bb71acca-5b53-4a5c-bf78-306bf4fb6b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:05.473977 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 279/559] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Jul 27 15:12:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:05.473977 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590a1da-6509-4a32-bb50-7dc36f7fbea6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:05.527622 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:05.544009 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 281/560] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:12:05.544009 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71acca-5b53-4a5c-bf78-306bf4fb6b9b None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:05.632599 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a590a1da-6509-4a32-bb50-7dc36f7fbea6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:05.652452 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:05.669898 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7843a-b3d7-4154-94e2-d54a1ddac270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:05.670528 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7843a-b3d7-4154-94e2-d54a1ddac270 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:05.670809 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7843a-b3d7-4154-94e2-d54a1ddac270 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:05.671082 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7843a-b3d7-4154-94e2-d54a1ddac270 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:05.676161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb71acca-5b53-4a5c-bf78-306bf4fb6b9b None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:05.682733 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7843a-b3d7-4154-94e2-d54a1ddac270 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:05.684263 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7843a-b3d7-4154-94e2-d54a1ddac270 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:05.702051 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-4ab7843a-b3d7-4154-94e2-d54a1ddac270 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:05.702051 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:05.702051 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:05.702051 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:05.702051 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:05.702051 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:05.702051 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:05.702051 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:05.702051 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:05.702051 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:05.702051 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:05.702051 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:05.702051 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:05.702051 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:05.702051 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:05.702959 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:05.702959 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:05.702959 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:05.702959 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:05.702959 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:05.702959 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:05.702959 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:05.702959 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:05.702959 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:05.702959 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:05.702959 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:05.702959 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:05.702959 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:05.702959 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:05.702959 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:05.702959 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:05.702959 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:05.703840 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:05.703840 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:05.703840 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:05.703840 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:05.703840 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 280/561] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:05.704149 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7843a-b3d7-4154-94e2-d54a1ddac270 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:05.720015 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ac8ed-383d-44e7-9de8-051baec45783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:05.720678 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ac8ed-383d-44e7-9de8-051baec45783 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:05.720964 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ac8ed-383d-44e7-9de8-051baec45783 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:05.721244 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ac8ed-383d-44e7-9de8-051baec45783 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:05.732466 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ac8ed-383d-44e7-9de8-051baec45783 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:05.733924 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ac8ed-383d-44e7-9de8-051baec45783 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:05.750027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-1f0ac8ed-383d-44e7-9de8-051baec45783 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:05.750027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:05.750027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:05.750027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:05.750027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:05.750027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:05.750027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:05.750027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:05.750027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:05.750027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:05.750027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:05.750027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:05.750027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:05.750027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:05.750027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:05.751040 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:05.751040 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:05.751040 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:05.751040 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:05.751040 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:05.751040 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:05.751040 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:05.751040 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:05.751040 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:05.751040 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:05.751040 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:05.751040 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:05.751040 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:05.751040 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:05.751040 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:05.751040 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:05.751040 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:05.751921 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:05.751921 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:05.751921 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:05.751921 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:05.751921 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 282/562] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:05.752680 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ac8ed-383d-44e7-9de8-051baec45783 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:05.805445 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:05.815227 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7843a-b3d7-4154-94e2-d54a1ddac270 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:05.848300 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc578758-ca1e-4109-992f-600df4f5c539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:05.848924 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc578758-ca1e-4109-992f-600df4f5c539 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:05.849200 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc578758-ca1e-4109-992f-600df4f5c539 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:05.849468 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc578758-ca1e-4109-992f-600df4f5c539 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:05.855665 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ac8ed-383d-44e7-9de8-051baec45783 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:05.859870 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc578758-ca1e-4109-992f-600df4f5c539 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:12:05.865132 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-dc578758-ca1e-4109-992f-600df4f5c539 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:12:05.865132 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:05.865132 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:05.865132 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:05.865132 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:05.865132 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:05.865132 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:05.865132 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:05.865132 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:05.865132 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:05.865132 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:05.865132 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:05.865132 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:12:05.865132 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:12:05.865132 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:12:05.865132 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:12:05.866670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:12:05.866670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:12:05.866670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:12:05.866670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:12:05.866670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:05.866670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:05.866670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:05.866670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:05.866670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:05.866670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:05.866670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:05.866670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:05.866670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:05.866670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:05.866670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:05.866670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:05.867536 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:05.867536 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:05.867536 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:05.867536 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:05.867536 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:12:05.867536 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:12:05.867536 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:12:05.867536 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:12:05.867536 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:12:05.867536 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:12:05.867536 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:12:05.867536 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:05.871807 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 281/563] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jul 27 15:12:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:05.873084 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36aee0a-c2f7-4e2b-bf4a-154d99f777a2 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:05.873366 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36aee0a-c2f7-4e2b-bf4a-154d99f777a2 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:05.873654 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36aee0a-c2f7-4e2b-bf4a-154d99f777a2 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:05.875052 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 282/564] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:05.875865 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29772916-d5db-4c23-8ec4-7f5c0dd20a5f None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:05.876166 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29772916-d5db-4c23-8ec4-7f5c0dd20a5f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:05.876438 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29772916-d5db-4c23-8ec4-7f5c0dd20a5f None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:05.877592 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 283/565] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:05.878266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29772916-d5db-4c23-8ec4-7f5c0dd20a5f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:05.895534 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060063a0-8375-44e9-a9c7-6beef9a93fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:05.896179 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060063a0-8375-44e9-a9c7-6beef9a93fca None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:05.896468 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060063a0-8375-44e9-a9c7-6beef9a93fca None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:05.896744 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060063a0-8375-44e9-a9c7-6beef9a93fca None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:05.897470 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060063a0-8375-44e9-a9c7-6beef9a93fca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:05.897777 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060063a0-8375-44e9-a9c7-6beef9a93fca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:05.899134 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060063a0-8375-44e9-a9c7-6beef9a93fca None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:05.901422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:05.911387 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 283/566] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:05.912154 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060063a0-8375-44e9-a9c7-6beef9a93fca None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:05.983610 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29772916-d5db-4c23-8ec4-7f5c0dd20a5f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:06.014694 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060063a0-8375-44e9-a9c7-6beef9a93fca None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:06.017081 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550f4e49-3ad3-4cee-af7c-45daf030911c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:06.017691 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f4e49-3ad3-4cee-af7c-45daf030911c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:06.017977 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f4e49-3ad3-4cee-af7c-45daf030911c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:06.018250 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550f4e49-3ad3-4cee-af7c-45daf030911c None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:06.018974 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f4e49-3ad3-4cee-af7c-45daf030911c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:06.019317 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f4e49-3ad3-4cee-af7c-45daf030911c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:06.020787 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550f4e49-3ad3-4cee-af7c-45daf030911c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:06.038545 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 284/567] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:06.040128 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8a56d-834c-4f33-80a9-857623d79da1 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:06.040421 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8a56d-834c-4f33-80a9-857623d79da1 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:06.040704 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8a56d-834c-4f33-80a9-857623d79da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:06.049145 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad6c3e-fbc8-4907-a2e3-ee99a18ce4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:06.049760 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad6c3e-fbc8-4907-a2e3-ee99a18ce4b3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:06.050044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad6c3e-fbc8-4907-a2e3-ee99a18ce4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:06.050321 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad6c3e-fbc8-4907-a2e3-ee99a18ce4b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:06.051038 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad6c3e-fbc8-4907-a2e3-ee99a18ce4b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:06.051347 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad6c3e-fbc8-4907-a2e3-ee99a18ce4b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:06.052739 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad6c3e-fbc8-4907-a2e3-ee99a18ce4b3 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:06.058243 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-8ad8a56d-834c-4f33-80a9-857623d79da1 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:06.059414 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8ad8a56d-834c-4f33-80a9-857623d79da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:06.061480 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 284/568] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jul 27 15:12:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:06.062671 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed831e-d74f-4c7c-86e1-5c7a7d156c14 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:06.062955 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed831e-d74f-4c7c-86e1-5c7a7d156c14 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:06.063224 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed831e-d74f-4c7c-86e1-5c7a7d156c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:06.063483 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:06.081050 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-6fed831e-d74f-4c7c-86e1-5c7a7d156c14 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:06.082325 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6fed831e-d74f-4c7c-86e1-5c7a7d156c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:06.127350 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 285/569] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:12:06.128208 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8a56d-834c-4f33-80a9-857623d79da1 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:06.135214 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:06.156739 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 285/570] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:12:06.156739 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed831e-d74f-4c7c-86e1-5c7a7d156c14 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:06.239300 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8a56d-834c-4f33-80a9-857623d79da1 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:06.251974 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed831e-d74f-4c7c-86e1-5c7a7d156c14 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:06.272769 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcc435-9b88-4678-be58-0b75ccae8fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:06.273411 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcc435-9b88-4678-be58-0b75ccae8fda None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:06.273687 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcc435-9b88-4678-be58-0b75ccae8fda None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:06.273961 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dcc435-9b88-4678-be58-0b75ccae8fda None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:06.280886 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcc435-9b88-4678-be58-0b75ccae8fda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:06.282330 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dcc435-9b88-4678-be58-0b75ccae8fda None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:06.284865 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:06.285271 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e25613-a84e-4135-855a-b36a77c4cad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:06.285984 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e25613-a84e-4135-855a-b36a77c4cad9 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:06.286251 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e25613-a84e-4135-855a-b36a77c4cad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:06.286612 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e25613-a84e-4135-855a-b36a77c4cad9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:06.294035 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e25613-a84e-4135-855a-b36a77c4cad9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:06.295448 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e25613-a84e-4135-855a-b36a77c4cad9 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:06.295645 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-d1dcc435-9b88-4678-be58-0b75ccae8fda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:06.295645 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:06.295645 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:06.295645 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:06.295645 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:06.295645 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:06.295645 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:06.295645 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:06.295645 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:06.295645 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:06.295645 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:06.295645 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:06.295645 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:12:06.295645 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:12:06.295645 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:12:06.296662 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:12:06.296662 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:06.296662 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:06.296662 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:06.296662 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:06.296662 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:06.296662 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:06.296662 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:06.296662 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:06.296662 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:06.296662 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:06.296662 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:06.296662 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:06.296662 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:06.296662 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:06.296662 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:06.296662 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:06.297573 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:12:06.297573 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:12:06.297573 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:12:06.297573 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:12:06.297573 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:12:06.297573 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:12:06.297573 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:06.297573 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:06.297573 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 286/571] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:12:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:06.297573 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcc435-9b88-4678-be58-0b75ccae8fda None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:06.309977 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-c5e25613-a84e-4135-855a-b36a77c4cad9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:06.309977 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:06.309977 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:06.309977 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:06.309977 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:06.309977 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:06.309977 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:06.309977 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:06.309977 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:06.309977 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:06.309977 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:06.309977 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:06.309977 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:12:06.309977 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:12:06.309977 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:12:06.310941 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:12:06.310941 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:06.310941 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:06.310941 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:06.310941 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:06.310941 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:06.310941 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:06.310941 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:06.310941 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:06.310941 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:06.310941 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:06.310941 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:06.310941 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:06.310941 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:06.310941 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:06.310941 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:06.310941 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:06.311822 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:12:06.311822 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:12:06.311822 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:12:06.311822 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:12:06.311822 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:12:06.311822 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:12:06.311822 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:06.311822 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:06.311822 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 286/572] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:12:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:06.313150 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e25613-a84e-4135-855a-b36a77c4cad9 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:06.358935 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:06.402499 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dcc435-9b88-4678-be58-0b75ccae8fda None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:06.409001 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e25613-a84e-4135-855a-b36a77c4cad9 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:06.435975 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab742b-dce3-4788-b9c7-ccecf39df94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:06.436671 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab742b-dce3-4788-b9c7-ccecf39df94e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:06.436947 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab742b-dce3-4788-b9c7-ccecf39df94e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:06.437212 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab742b-dce3-4788-b9c7-ccecf39df94e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:06.442704 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01fb03-a0d2-4904-81c2-14288d3865a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:06.443325 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01fb03-a0d2-4904-81c2-14288d3865a3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:06.443606 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01fb03-a0d2-4904-81c2-14288d3865a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:06.443913 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb01fb03-a0d2-4904-81c2-14288d3865a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:06.447570 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab742b-dce3-4788-b9c7-ccecf39df94e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:06.449020 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab742b-dce3-4788-b9c7-ccecf39df94e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:06.453711 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb01fb03-a0d2-4904-81c2-14288d3865a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:12:06.458947 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-fb01fb03-a0d2-4904-81c2-14288d3865a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:12:06.458947 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:06.458947 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:06.458947 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:06.458947 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:06.458947 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:06.458947 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:06.458947 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:06.458947 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:06.458947 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:06.458947 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:06.458947 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:06.458947 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:12:06.458947 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:12:06.458947 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:12:06.458947 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:12:06.460087 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:12:06.460087 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:12:06.460087 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:12:06.460087 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:12:06.460087 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:06.460087 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:06.460087 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:06.460087 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:06.460087 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:06.460087 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:06.460087 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:06.460087 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:06.460087 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:06.460087 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:06.460087 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:06.460087 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:06.460913 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:06.460913 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:06.460913 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:06.460913 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:06.460913 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:12:06.460913 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:12:06.460913 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:12:06.460913 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:12:06.460913 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:12:06.460913 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:12:06.460913 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:12:06.460913 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:06.460913 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 287/573] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jul 27 15:12:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:06.460913 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01fb03-a0d2-4904-81c2-14288d3865a3 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:06.462997 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-73ab742b-dce3-4788-b9c7-ccecf39df94e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:06.462997 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:06.462997 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:06.462997 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:06.462997 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:06.462997 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:06.462997 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:06.462997 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:06.462997 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:06.462997 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:06.462997 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:06.462997 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:06.462997 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:06.462997 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:06.462997 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:06.464033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:06.464033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:06.464033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:06.464033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:06.464033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:06.464033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:06.464033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:06.464033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:06.464033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:06.464033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:06.464033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:06.464033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:06.464033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:06.464033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:06.464033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:06.464033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:06.464033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:06.464965 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:06.464965 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:06.464965 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:06.464965 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:06.464965 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 287/574] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:06.465651 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab742b-dce3-4788-b9c7-ccecf39df94e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:06.519632 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:06.569513 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb01fb03-a0d2-4904-81c2-14288d3865a3 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:06.569928 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab742b-dce3-4788-b9c7-ccecf39df94e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:06.578195 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:06.605935 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd890a56-335c-4fef-80a7-72b8e3e6f441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:06.606575 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd890a56-335c-4fef-80a7-72b8e3e6f441 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:06.606856 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd890a56-335c-4fef-80a7-72b8e3e6f441 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:06.607129 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd890a56-335c-4fef-80a7-72b8e3e6f441 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:06.608340 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261fa2ba-8944-4f0e-8a7c-5bf3732854e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:06.608946 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261fa2ba-8944-4f0e-8a7c-5bf3732854e5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:06.609224 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261fa2ba-8944-4f0e-8a7c-5bf3732854e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:06.609494 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261fa2ba-8944-4f0e-8a7c-5bf3732854e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:06.610236 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261fa2ba-8944-4f0e-8a7c-5bf3732854e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:06.610539 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261fa2ba-8944-4f0e-8a7c-5bf3732854e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:06.611955 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261fa2ba-8944-4f0e-8a7c-5bf3732854e5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:06.617208 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd890a56-335c-4fef-80a7-72b8e3e6f441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:12:06.622550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-fd890a56-335c-4fef-80a7-72b8e3e6f441 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:12:06.622550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:06.622550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:06.622550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:06.622550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:06.622550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:06.622550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:06.622550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:06.622550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:06.622550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:06.622550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:06.622550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:06.622550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:12:06.622550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:12:06.622550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:12:06.622550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:12:06.623703 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:12:06.623703 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:12:06.623703 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:12:06.623703 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:12:06.623703 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:06.623703 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:06.623703 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:06.623703 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:06.623703 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:06.623703 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:06.623703 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:06.623703 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:06.623703 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:06.623703 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:06.623703 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:06.623703 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:06.624871 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:06.624871 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:06.624871 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:06.624871 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:06.624871 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:12:06.624871 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:12:06.624871 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:12:06.624871 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:12:06.624871 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:12:06.624871 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:12:06.624871 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:12:06.624871 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:06.626137 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 288/575] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jul 27 15:12:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:06.626137 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261fa2ba-8944-4f0e-8a7c-5bf3732854e5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:06.631102 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 288/576] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jul 27 15:12:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:06.631102 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd890a56-335c-4fef-80a7-72b8e3e6f441 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:06.721211 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261fa2ba-8944-4f0e-8a7c-5bf3732854e5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:06.726834 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd890a56-335c-4fef-80a7-72b8e3e6f441 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:06.734564 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:06.755938 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e0c81-65a2-4c85-a204-22da036fd071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:06.756655 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e0c81-65a2-4c85-a204-22da036fd071 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:06.756930 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e0c81-65a2-4c85-a204-22da036fd071 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:06.757198 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2e0c81-65a2-4c85-a204-22da036fd071 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:06.757932 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e0c81-65a2-4c85-a204-22da036fd071 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:06.758235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e0c81-65a2-4c85-a204-22da036fd071 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:06.759643 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2e0c81-65a2-4c85-a204-22da036fd071 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:06.760229 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee4ebf-3d10-4409-b28d-f83c3c28db09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:06.760836 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee4ebf-3d10-4409-b28d-f83c3c28db09 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:06.761129 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee4ebf-3d10-4409-b28d-f83c3c28db09 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:06.761388 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ee4ebf-3d10-4409-b28d-f83c3c28db09 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:06.762105 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee4ebf-3d10-4409-b28d-f83c3c28db09 None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:06.762459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee4ebf-3d10-4409-b28d-f83c3c28db09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:06.763806 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ee4ebf-3d10-4409-b28d-f83c3c28db09 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:06.771090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 289/577] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jul 27 15:12:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:06.771807 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e0c81-65a2-4c85-a204-22da036fd071 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:06.776302 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 289/578] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jul 27 15:12:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:06.777634 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee4ebf-3d10-4409-b28d-f83c3c28db09 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:06.809798 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:06.876750 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2e0c81-65a2-4c85-a204-22da036fd071 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:06.877977 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ee4ebf-3d10-4409-b28d-f83c3c28db09 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:06.910030 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e08c13-8d67-4ed6-8716-4c4ed4085ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:06.910603 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e08c13-8d67-4ed6-8716-4c4ed4085ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:06.910884 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e08c13-8d67-4ed6-8716-4c4ed4085ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:06.911155 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e08c13-8d67-4ed6-8716-4c4ed4085ce5 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:06.911841 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e08c13-8d67-4ed6-8716-4c4ed4085ce5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:06.912183 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e08c13-8d67-4ed6-8716-4c4ed4085ce5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:06.912941 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba30ba4-8d79-4cbb-8e78-0c93452f4bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:06.913544 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba30ba4-8d79-4cbb-8e78-0c93452f4bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:06.913644 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e08c13-8d67-4ed6-8716-4c4ed4085ce5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:06.914080 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba30ba4-8d79-4cbb-8e78-0c93452f4bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:06.914356 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba30ba4-8d79-4cbb-8e78-0c93452f4bc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:06.915135 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba30ba4-8d79-4cbb-8e78-0c93452f4bc6 None admin] RBAC: Adding query filter params (role.id=6a54ab92d32843d6bc4c2dcedae4bd13, scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5, user.id=68bbf8bb59a84829afacd9677c9639a6) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:06.915438 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba30ba4-8d79-4cbb-8e78-0c93452f4bc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:06.916872 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba30ba4-8d79-4cbb-8e78-0c93452f4bc6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:06.922101 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 290/579] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:12:06 2022] GET /identity/v3/role_assignments?user.id=68bbf8bb59a84829afacd9677c9639a6&scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5&role.id=6a54ab92d32843d6bc4c2dcedae4bd13 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:06.922862 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba30ba4-8d79-4cbb-8e78-0c93452f4bc6 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:06.930391 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 290/580] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:06.930391 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e08c13-8d67-4ed6-8716-4c4ed4085ce5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:06.969493 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:07.033881 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:07.042430 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba30ba4-8d79-4cbb-8e78-0c93452f4bc6 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:07.050761 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e08c13-8d67-4ed6-8716-4c4ed4085ce5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:07.088336 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7e5e0-56c1-49ee-8f9a-38324d4bce98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:07.088953 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7e5e0-56c1-49ee-8f9a-38324d4bce98 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:07.089262 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7e5e0-56c1-49ee-8f9a-38324d4bce98 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:07.089492 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7e5e0-56c1-49ee-8f9a-38324d4bce98 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:07.089905 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078b364-af84-44f7-b576-3e158b445e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:07.090208 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7e5e0-56c1-49ee-8f9a-38324d4bce98 None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:07.090510 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7e5e0-56c1-49ee-8f9a-38324d4bce98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:07.090992 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078b364-af84-44f7-b576-3e158b445e78 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:07.090992 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078b364-af84-44f7-b576-3e158b445e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:07.091360 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e078b364-af84-44f7-b576-3e158b445e78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:07.091876 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7e5e0-56c1-49ee-8f9a-38324d4bce98 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:07.100561 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 291/581] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jul 27 15:12:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:07.101217 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7e5e0-56c1-49ee-8f9a-38324d4bce98 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:07.106358 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e078b364-af84-44f7-b576-3e158b445e78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:07.107813 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e078b364-af84-44f7-b576-3e158b445e78 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:07.123535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-e078b364-af84-44f7-b576-3e158b445e78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:07.123535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:07.123535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:07.123535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:07.123535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:07.123535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:07.123535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:07.123535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:07.123535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:07.123535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:07.123535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:07.123535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:07.123535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:07.123535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:07.123535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:07.124566 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:07.124566 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:07.124566 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:07.124566 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:07.124566 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:07.124566 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:07.124566 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:07.124566 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:07.124566 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:07.124566 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:07.124566 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:07.124566 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:07.124566 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:07.124566 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:07.124566 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:07.124566 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:07.124566 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:07.125444 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:07.125444 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:07.125444 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:07.125444 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:07.125444 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 291/582] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:07.125444 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078b364-af84-44f7-b576-3e158b445e78 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:07.212981 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7e5e0-56c1-49ee-8f9a-38324d4bce98 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:07.218823 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:07.235718 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e078b364-af84-44f7-b576-3e158b445e78 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:07.249654 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f99310-47ce-4d82-8a24-a3412219befe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:07.250437 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f99310-47ce-4d82-8a24-a3412219befe None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:07.250822 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f99310-47ce-4d82-8a24-a3412219befe None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:07.251206 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f99310-47ce-4d82-8a24-a3412219befe None admin] PATH_INFO: `/v3/projects/0b616213eaea4a22afee15d4cbe5a3c5/users/d3e01aa0ef1340cbba7170bac4a82783/roles/6a54ab92d32843d6bc4c2dcedae4bd13` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:07.266559 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f99310-47ce-4d82-8a24-a3412219befe None admin] RBAC: Authorizing `identity:create_grant(project_id=0b616213eaea4a22afee15d4cbe5a3c5, user_id=d3e01aa0ef1340cbba7170bac4a82783, role_id=6a54ab92d32843d6bc4c2dcedae4bd13)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:07.268220 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f99310-47ce-4d82-8a24-a3412219befe None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:07.272671 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40a7a0-7130-411d-91ef-5a2518de7254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:07.273517 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40a7a0-7130-411d-91ef-5a2518de7254 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:07.273800 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40a7a0-7130-411d-91ef-5a2518de7254 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:07.274199 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc40a7a0-7130-411d-91ef-5a2518de7254 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:07.292109 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 292/583] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jul 27 15:12:07 2022] PUT /identity/v3/projects/0b616213eaea4a22afee15d4cbe5a3c5/users/d3e01aa0ef1340cbba7170bac4a82783/roles/6a54ab92d32843d6bc4c2dcedae4bd13 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:12:07.292109 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f99310-47ce-4d82-8a24-a3412219befe None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:07.294389 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc40a7a0-7130-411d-91ef-5a2518de7254 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:07.296128 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc40a7a0-7130-411d-91ef-5a2518de7254 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:07.299871 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:07.315033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-bc40a7a0-7130-411d-91ef-5a2518de7254 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 15:12:07.315033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:07.315033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:07.315033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:07.315033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:07.315033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:07.315033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:07.315033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:07.315033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:07.315033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:07.315033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:07.315033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:07.315033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:12:07.315033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:12:07.315033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:12:07.315033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:12:07.316285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:07.316285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:07.316285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:12:07.316285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:07.316285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:12:07.316285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:07.316285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:07.316285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:07.316285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:07.316285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:07.316285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:07.316285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:07.316285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:07.316285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:07.316285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:07.316285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:07.316285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:07.316285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:07.317481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:07.317481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:07.317481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:12:07.317481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:12:07.317481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:12:07.317481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:12:07.317481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:12:07.317481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:12:07.317481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 15:12:07.317481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:07.320357 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 292/584] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:12:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:07.321383 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40a7a0-7130-411d-91ef-5a2518de7254 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:07.437464 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f99310-47ce-4d82-8a24-a3412219befe None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:07.443712 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc40a7a0-7130-411d-91ef-5a2518de7254 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:07.484610 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0616d6-807f-424e-a255-c7e50e59ee07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:07.485238 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0616d6-807f-424e-a255-c7e50e59ee07 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:07.485354 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fbc20b-1da4-454c-ab87-4b85fc4d9c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:07.485515 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0616d6-807f-424e-a255-c7e50e59ee07 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:07.485791 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0616d6-807f-424e-a255-c7e50e59ee07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:07.486203 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbc20b-1da4-454c-ab87-4b85fc4d9c5f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:07.486570 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbc20b-1da4-454c-ab87-4b85fc4d9c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:07.486944 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fbc20b-1da4-454c-ab87-4b85fc4d9c5f None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:07.487850 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fbc20b-1da4-454c-ab87-4b85fc4d9c5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:07.488268 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fbc20b-1da4-454c-ab87-4b85fc4d9c5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:07.489789 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fbc20b-1da4-454c-ab87-4b85fc4d9c5f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:07.499235 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0616d6-807f-424e-a255-c7e50e59ee07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:07.501223 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0616d6-807f-424e-a255-c7e50e59ee07 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:07.504208 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 293/585] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:07.505284 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fbc20b-1da4-454c-ab87-4b85fc4d9c5f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:07.516034 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:07.521026 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-5c0616d6-807f-424e-a255-c7e50e59ee07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:07.521026 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:07.521026 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:07.521026 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:07.521026 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:07.521026 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:07.521026 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:07.521026 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:07.521026 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:07.521026 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:07.521026 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:07.521026 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:07.521026 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:07.521026 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:07.521026 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:07.522143 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:07.522143 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:07.522143 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:07.522143 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:07.522143 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:07.522143 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:07.522143 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:07.522143 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:07.522143 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:07.522143 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:07.522143 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:07.522143 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:07.522143 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:07.522143 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:07.522143 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:07.522143 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:07.522143 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:07.523234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:07.523234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:07.523234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:07.523234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:07.524337 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 293/586] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:07.525171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0616d6-807f-424e-a255-c7e50e59ee07 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:07.608710 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:07.629911 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fbc20b-1da4-454c-ab87-4b85fc4d9c5f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:07.653054 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0616d6-807f-424e-a255-c7e50e59ee07 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:07.668831 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72cc16e-e107-4731-919c-ba46c6a7fa38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:07.669767 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72cc16e-e107-4731-919c-ba46c6a7fa38 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:07.670364 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72cc16e-e107-4731-919c-ba46c6a7fa38 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:07.670907 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72cc16e-e107-4731-919c-ba46c6a7fa38 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:07.672033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72cc16e-e107-4731-919c-ba46c6a7fa38 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:07.672551 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72cc16e-e107-4731-919c-ba46c6a7fa38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:07.674256 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72cc16e-e107-4731-919c-ba46c6a7fa38 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:07.688671 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677999d7-38d6-4c79-b9aa-de54459ec822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:07.689301 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677999d7-38d6-4c79-b9aa-de54459ec822 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:07.689584 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677999d7-38d6-4c79-b9aa-de54459ec822 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:07.689845 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677999d7-38d6-4c79-b9aa-de54459ec822 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:07.699072 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677999d7-38d6-4c79-b9aa-de54459ec822 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:07.699346 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 294/587] 10.222.0.40 () {56 vars in 1137 bytes} [Wed Jul 27 15:12:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:07.700057 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677999d7-38d6-4c79-b9aa-de54459ec822 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:07.700670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72cc16e-e107-4731-919c-ba46c6a7fa38 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:07.712353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-677999d7-38d6-4c79-b9aa-de54459ec822 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 15:12:07.712353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:07.712353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:07.712353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:07.712353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:07.712353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:07.712353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:07.712353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:07.712353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:07.712353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:07.712353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:07.712353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:07.712353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:12:07.712353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:12:07.712353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:12:07.712353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:12:07.713286 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:07.713286 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:07.713286 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:12:07.713286 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:07.713286 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:12:07.713286 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:07.713286 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:07.713286 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:07.713286 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:07.713286 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:07.713286 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:07.713286 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:07.713286 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:07.713286 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:07.713286 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:07.713286 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:07.713286 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:07.713286 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:07.714204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:07.714204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:07.714204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:12:07.714204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:12:07.714204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:12:07.714204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:12:07.714204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:12:07.714204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:12:07.714204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 15:12:07.714204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:07.718182 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 294/588] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:12:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:07.718990 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677999d7-38d6-4c79-b9aa-de54459ec822 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:07.769775 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:07.812505 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72cc16e-e107-4731-919c-ba46c6a7fa38 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:07.822097 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677999d7-38d6-4c79-b9aa-de54459ec822 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:07.845714 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:07.848586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47efd412-cb79-42eb-b328-7d974d914ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:07.849433 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efd412-cb79-42eb-b328-7d974d914ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:07.849933 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efd412-cb79-42eb-b328-7d974d914ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:07.850418 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47efd412-cb79-42eb-b328-7d974d914ea3 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:07.851349 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47efd412-cb79-42eb-b328-7d974d914ea3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:07.851847 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47efd412-cb79-42eb-b328-7d974d914ea3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:07.853412 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47efd412-cb79-42eb-b328-7d974d914ea3 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:07.856924 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42352558-7f8f-4a56-990b-5558c15487aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:07.857632 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42352558-7f8f-4a56-990b-5558c15487aa None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:07.857946 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42352558-7f8f-4a56-990b-5558c15487aa None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:07.858249 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42352558-7f8f-4a56-990b-5558c15487aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:07.870899 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42352558-7f8f-4a56-990b-5558c15487aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:07.871548 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 295/589] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:07.871913 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42352558-7f8f-4a56-990b-5558c15487aa None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:07.872849 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47efd412-cb79-42eb-b328-7d974d914ea3 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:07.890916 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-42352558-7f8f-4a56-990b-5558c15487aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:07.890916 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:07.890916 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:07.890916 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:07.890916 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:07.890916 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:07.890916 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:07.890916 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:07.890916 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:07.890916 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:07.890916 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:07.890916 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:07.890916 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:07.890916 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:07.890916 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:07.891909 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:07.891909 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:07.891909 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:07.891909 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:07.891909 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:07.891909 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:07.891909 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:07.891909 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:07.891909 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:07.891909 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:07.891909 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:07.891909 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:07.891909 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:07.891909 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:07.891909 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:07.891909 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:07.891909 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:07.893097 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:07.893097 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:07.893097 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:07.893097 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:07.896061 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 295/590] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:07.897758 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42352558-7f8f-4a56-990b-5558c15487aa None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:07.985912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47efd412-cb79-42eb-b328-7d974d914ea3 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:08.012236 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:08.026554 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af14c90-5f6e-4040-ad46-d6f6c845c7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:08.027171 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af14c90-5f6e-4040-ad46-d6f6c845c7ea None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:08.027451 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af14c90-5f6e-4040-ad46-d6f6c845c7ea None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:08.027718 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af14c90-5f6e-4040-ad46-d6f6c845c7ea None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:08.028539 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af14c90-5f6e-4040-ad46-d6f6c845c7ea None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:08.028850 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af14c90-5f6e-4040-ad46-d6f6c845c7ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:08.030256 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af14c90-5f6e-4040-ad46-d6f6c845c7ea None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:08.034026 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42352558-7f8f-4a56-990b-5558c15487aa None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:08.054337 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 296/591] 10.222.0.40 () {56 vars in 1137 bytes} [Wed Jul 27 15:12:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:08.054337 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af14c90-5f6e-4040-ad46-d6f6c845c7ea None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:08.076062 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f28b9-ef18-4e57-991b-83a64b08fbe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:08.076723 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f28b9-ef18-4e57-991b-83a64b08fbe8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:08.077003 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f28b9-ef18-4e57-991b-83a64b08fbe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:08.077331 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f28b9-ef18-4e57-991b-83a64b08fbe8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:08.085758 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f28b9-ef18-4e57-991b-83a64b08fbe8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:08.087196 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f28b9-ef18-4e57-991b-83a64b08fbe8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:08.099957 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-305f28b9-ef18-4e57-991b-83a64b08fbe8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 15:12:08.099957 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:08.099957 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:08.099957 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:08.099957 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:08.099957 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:08.099957 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:08.099957 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:08.099957 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:08.099957 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:08.099957 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:08.099957 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:08.099957 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:12:08.099957 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:12:08.099957 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:12:08.099957 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:12:08.101552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:08.101552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:08.101552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:12:08.101552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:08.101552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:12:08.101552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:08.101552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:08.101552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:08.101552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:08.101552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:08.101552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:08.101552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:08.101552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:08.101552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:08.101552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:08.101552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:08.101552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:08.101552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:08.102505 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:08.102505 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:08.102505 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:12:08.102505 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:12:08.102505 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:12:08.102505 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:12:08.102505 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:12:08.102505 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:12:08.102505 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 15:12:08.102505 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:08.106452 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 296/592] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jul 27 15:12:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:08.107298 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f28b9-ef18-4e57-991b-83a64b08fbe8 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:08.137245 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:08.175163 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af14c90-5f6e-4040-ad46-d6f6c845c7ea None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:08.215887 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912fbaf2-a61f-41a7-87e0-a5c00f728314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:08.216941 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912fbaf2-a61f-41a7-87e0-a5c00f728314 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:08.217416 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912fbaf2-a61f-41a7-87e0-a5c00f728314 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:08.217883 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912fbaf2-a61f-41a7-87e0-a5c00f728314 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:08.218871 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912fbaf2-a61f-41a7-87e0-a5c00f728314 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:08.219366 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912fbaf2-a61f-41a7-87e0-a5c00f728314 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:08.220974 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912fbaf2-a61f-41a7-87e0-a5c00f728314 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:08.222531 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f28b9-ef18-4e57-991b-83a64b08fbe8 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:08.239114 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 297/593] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:08.240397 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912fbaf2-a61f-41a7-87e0-a5c00f728314 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:08.257070 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb8050-3044-4b8e-948a-1ba062786b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:08.257858 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb8050-3044-4b8e-948a-1ba062786b52 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:08.257990 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb8050-3044-4b8e-948a-1ba062786b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:08.258236 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccb8050-3044-4b8e-948a-1ba062786b52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:08.268810 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb8050-3044-4b8e-948a-1ba062786b52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:08.270249 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccb8050-3044-4b8e-948a-1ba062786b52 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:08.285581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-dccb8050-3044-4b8e-948a-1ba062786b52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:08.285581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:08.285581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:08.285581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:08.285581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:08.285581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:08.285581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:08.285581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:08.285581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:08.285581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:08.285581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:08.285581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:08.285581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:08.285581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:08.285581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:08.286497 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:08.286497 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:08.286497 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:08.286497 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:08.286497 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:08.286497 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:08.286497 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:08.286497 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:08.286497 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:08.286497 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:08.286497 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:08.286497 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:08.286497 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:08.286497 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:08.286497 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:08.286497 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:08.286497 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:08.287406 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:08.287406 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:08.287406 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:08.287406 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:08.292041 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 297/594] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:08.292379 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:08.293174 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb8050-3044-4b8e-948a-1ba062786b52 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:08.359623 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912fbaf2-a61f-41a7-87e0-a5c00f728314 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:08.375059 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:08.394611 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccb8050-3044-4b8e-948a-1ba062786b52 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:08.400366 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee13b02-e221-4a2e-a362-67f685ff7a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:08.401228 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee13b02-e221-4a2e-a362-67f685ff7a76 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:08.401704 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee13b02-e221-4a2e-a362-67f685ff7a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:08.402271 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee13b02-e221-4a2e-a362-67f685ff7a76 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:08.403253 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee13b02-e221-4a2e-a362-67f685ff7a76 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:08.403774 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee13b02-e221-4a2e-a362-67f685ff7a76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:08.405568 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee13b02-e221-4a2e-a362-67f685ff7a76 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:08.426488 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 298/595] 10.222.0.40 () {56 vars in 1139 bytes} [Wed Jul 27 15:12:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:08.427738 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee13b02-e221-4a2e-a362-67f685ff7a76 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:08.429946 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707acf9-1c37-449b-b83c-4ebb4ff4ff9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:08.430950 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707acf9-1c37-449b-b83c-4ebb4ff4ff9f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:08.431371 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707acf9-1c37-449b-b83c-4ebb4ff4ff9f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:08.431633 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f707acf9-1c37-449b-b83c-4ebb4ff4ff9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:08.438824 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707acf9-1c37-449b-b83c-4ebb4ff4ff9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:08.440665 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f707acf9-1c37-449b-b83c-4ebb4ff4ff9f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:08.452823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-f707acf9-1c37-449b-b83c-4ebb4ff4ff9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:08.452823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:08.452823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:08.452823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:08.452823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:08.452823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:08.452823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:08.452823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:08.452823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:08.452823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:08.452823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:08.452823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:08.452823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:12:08.452823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:12:08.452823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:12:08.453793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:12:08.453793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:08.453793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:08.453793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:08.453793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:08.453793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:08.453793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:08.453793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:08.453793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:08.453793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:08.453793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:08.453793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:08.453793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:08.453793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:08.453793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:08.453793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:08.453793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:08.454709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:12:08.454709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:12:08.454709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:12:08.454709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:12:08.454709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:12:08.454709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:12:08.454709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:08.454709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:08.454709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 298/596] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:12:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:08.455215 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707acf9-1c37-449b-b83c-4ebb4ff4ff9f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:08.541884 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:08.547580 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee13b02-e221-4a2e-a362-67f685ff7a76 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:08.559522 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f707acf9-1c37-449b-b83c-4ebb4ff4ff9f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:08.587006 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa9451-4af2-4287-8006-81a759e475e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:08.587907 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa9451-4af2-4287-8006-81a759e475e5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:08.588347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa9451-4af2-4287-8006-81a759e475e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:08.588801 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa9451-4af2-4287-8006-81a759e475e5 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:08.589761 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa9451-4af2-4287-8006-81a759e475e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:08.590266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa9451-4af2-4287-8006-81a759e475e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:08.591831 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aa9451-4af2-4287-8006-81a759e475e5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:08.595499 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f75659-ff57-4f5c-8b68-76371a5b6804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:08.596274 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f75659-ff57-4f5c-8b68-76371a5b6804 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:08.596652 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f75659-ff57-4f5c-8b68-76371a5b6804 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:08.597023 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f75659-ff57-4f5c-8b68-76371a5b6804 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:08.610238 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 299/597] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:08.610238 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa9451-4af2-4287-8006-81a759e475e5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:08.613590 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f75659-ff57-4f5c-8b68-76371a5b6804 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:08.615341 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f75659-ff57-4f5c-8b68-76371a5b6804 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:08.617828 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:08.632747 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-61f75659-ff57-4f5c-8b68-76371a5b6804 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:08.632747 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:08.632747 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:08.632747 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:08.632747 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:08.632747 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:08.632747 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:08.632747 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:08.632747 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:08.632747 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:08.632747 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:08.632747 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:08.632747 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:08.632747 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:08.632747 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:08.633717 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:08.633717 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:08.633717 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:08.633717 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:08.633717 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:08.633717 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:08.633717 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:08.633717 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:08.633717 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:08.633717 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:08.633717 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:08.633717 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:08.633717 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:08.633717 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:08.633717 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:08.633717 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:08.633717 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:08.634619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:08.634619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:08.634619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:08.634619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:08.636856 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 299/598] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:08.637998 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f75659-ff57-4f5c-8b68-76371a5b6804 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:08.718078 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa9451-4af2-4287-8006-81a759e475e5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:08.742823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f75659-ff57-4f5c-8b68-76371a5b6804 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:08.753693 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29cb21-8cb0-4b69-b926-2f34ec69fca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:08.754358 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29cb21-8cb0-4b69-b926-2f34ec69fca7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:08.754643 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29cb21-8cb0-4b69-b926-2f34ec69fca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:08.754923 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e29cb21-8cb0-4b69-b926-2f34ec69fca7 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:08.755660 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e29cb21-8cb0-4b69-b926-2f34ec69fca7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:08.756032 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e29cb21-8cb0-4b69-b926-2f34ec69fca7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:08.758103 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e29cb21-8cb0-4b69-b926-2f34ec69fca7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:08.771675 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 300/599] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jul 27 15:12:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:08.773156 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29cb21-8cb0-4b69-b926-2f34ec69fca7 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:08.781008 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57723f-8039-41b9-ab1a-688f771b4dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:08.781941 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57723f-8039-41b9-ab1a-688f771b4dca None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:08.782423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57723f-8039-41b9-ab1a-688f771b4dca None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:08.782920 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e57723f-8039-41b9-ab1a-688f771b4dca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:08.790837 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57723f-8039-41b9-ab1a-688f771b4dca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:08.792571 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e57723f-8039-41b9-ab1a-688f771b4dca None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:08.794380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:08.805802 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-5e57723f-8039-41b9-ab1a-688f771b4dca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:08.805802 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:08.805802 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:08.805802 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:08.805802 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:08.805802 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:08.805802 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:08.805802 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:08.805802 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:08.805802 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:08.805802 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:08.805802 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:08.805802 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:12:08.805802 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:12:08.805802 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:12:08.806720 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:12:08.806720 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:08.806720 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:08.806720 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:08.806720 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:08.806720 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:08.806720 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:08.806720 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:08.806720 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:08.806720 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:08.806720 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:08.806720 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:08.806720 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:08.806720 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:08.806720 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:08.806720 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:08.806720 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:08.807601 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:12:08.807601 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:12:08.807601 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:12:08.807601 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:12:08.807601 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:12:08.807601 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:12:08.807601 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:08.807601 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:08.814586 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 300/600] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:12:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:08.815653 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57723f-8039-41b9-ab1a-688f771b4dca None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:08.873293 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:08.885687 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e29cb21-8cb0-4b69-b926-2f34ec69fca7 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:08.921150 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e57723f-8039-41b9-ab1a-688f771b4dca None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:08.922608 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71566911-795e-4184-a946-93f5fd48d006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:08.923324 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71566911-795e-4184-a946-93f5fd48d006 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:08.923609 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71566911-795e-4184-a946-93f5fd48d006 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:08.923881 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71566911-795e-4184-a946-93f5fd48d006 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:08.925379 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71566911-795e-4184-a946-93f5fd48d006 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:08.925379 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71566911-795e-4184-a946-93f5fd48d006 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:08.926340 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71566911-795e-4184-a946-93f5fd48d006 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:08.939378 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 301/601] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:08.940288 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71566911-795e-4184-a946-93f5fd48d006 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:08.959935 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42067a4d-1ecc-4e38-bb23-8b4bc5cb0d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:08.960966 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42067a4d-1ecc-4e38-bb23-8b4bc5cb0d6c None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:08.961479 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42067a4d-1ecc-4e38-bb23-8b4bc5cb0d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:08.962007 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42067a4d-1ecc-4e38-bb23-8b4bc5cb0d6c None admin] PATH_INFO: `/v3/projects/0b616213eaea4a22afee15d4cbe5a3c5/users/2f71721ca75a461d92044091564de424/roles/6a54ab92d32843d6bc4c2dcedae4bd13` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:08.977791 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42067a4d-1ecc-4e38-bb23-8b4bc5cb0d6c None admin] RBAC: Authorizing `identity:create_grant(project_id=0b616213eaea4a22afee15d4cbe5a3c5, user_id=2f71721ca75a461d92044091564de424, role_id=6a54ab92d32843d6bc4c2dcedae4bd13)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:08.979576 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42067a4d-1ecc-4e38-bb23-8b4bc5cb0d6c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:08.996688 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 301/602] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jul 27 15:12:08 2022] PUT /identity/v3/projects/0b616213eaea4a22afee15d4cbe5a3c5/users/2f71721ca75a461d92044091564de424/roles/6a54ab92d32843d6bc4c2dcedae4bd13 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:12:08.998072 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42067a4d-1ecc-4e38-bb23-8b4bc5cb0d6c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:09.057742 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:09.097450 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71566911-795e-4184-a946-93f5fd48d006 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:09.135612 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42067a4d-1ecc-4e38-bb23-8b4bc5cb0d6c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:09.139043 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:09.141025 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c123741d-70a7-4080-b07d-4b7885666eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:09.142253 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123741d-70a7-4080-b07d-4b7885666eff None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:09.142701 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123741d-70a7-4080-b07d-4b7885666eff None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:09.143226 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c123741d-70a7-4080-b07d-4b7885666eff None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:09.144181 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c123741d-70a7-4080-b07d-4b7885666eff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:09.144723 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c123741d-70a7-4080-b07d-4b7885666eff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:09.147618 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c123741d-70a7-4080-b07d-4b7885666eff None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:09.165067 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 302/603] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jul 27 15:12:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:09.166630 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03103f6e-8df9-42e0-84a2-3e212ba4f5e7 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:09.167158 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03103f6e-8df9-42e0-84a2-3e212ba4f5e7 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:09.167590 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03103f6e-8df9-42e0-84a2-3e212ba4f5e7 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:09.169601 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 303/604] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:09.171363 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03103f6e-8df9-42e0-84a2-3e212ba4f5e7 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:09.189126 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf54918-aefd-4bb4-ab0d-00b8b2b11379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:09.190857 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf54918-aefd-4bb4-ab0d-00b8b2b11379 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:09.190857 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf54918-aefd-4bb4-ab0d-00b8b2b11379 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:09.190857 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf54918-aefd-4bb4-ab0d-00b8b2b11379 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:09.209255 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf54918-aefd-4bb4-ab0d-00b8b2b11379 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:09.210786 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf54918-aefd-4bb4-ab0d-00b8b2b11379 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:09.228075 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-eaf54918-aefd-4bb4-ab0d-00b8b2b11379 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:09.228075 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:09.228075 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:09.228075 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:09.228075 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:09.228075 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:09.228075 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:09.228075 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:09.228075 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:09.228075 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:09.228075 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:09.228075 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:09.228075 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:12:09.228075 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:12:09.228075 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:12:09.229031 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:12:09.229031 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:09.229031 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:09.229031 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:09.229031 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:09.229031 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:09.229031 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:09.229031 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:09.229031 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:09.229031 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:09.229031 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:09.229031 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:09.229031 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:09.229031 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:09.229031 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:09.229031 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:09.229031 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:09.229935 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:12:09.229935 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:12:09.229935 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:12:09.229935 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:12:09.229935 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:12:09.229935 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:12:09.229935 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:09.229935 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:09.230530 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 302/605] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:12:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:09.236947 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090dd57d-20fc-430e-81f6-783d4e45e7a3 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:09.237230 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090dd57d-20fc-430e-81f6-783d4e45e7a3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:09.237506 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090dd57d-20fc-430e-81f6-783d4e45e7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:09.257113 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-090dd57d-20fc-430e-81f6-783d4e45e7a3 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:09.258297 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-090dd57d-20fc-430e-81f6-783d4e45e7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:09.324469 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03103f6e-8df9-42e0-84a2-3e212ba4f5e7 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:09.361764 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b5999-0fee-485c-a879-5f64ae4459a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:09.362433 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b5999-0fee-485c-a879-5f64ae4459a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:09.362712 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b5999-0fee-485c-a879-5f64ae4459a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:09.362981 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b5999-0fee-485c-a879-5f64ae4459a1 None admin] PATH_INFO: `/v3/projects/0b616213eaea4a22afee15d4cbe5a3c5/users/20aa56e1154649cb8b440dae788c922c/roles/6a54ab92d32843d6bc4c2dcedae4bd13` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:09.372949 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:09.383186 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b5999-0fee-485c-a879-5f64ae4459a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0b616213eaea4a22afee15d4cbe5a3c5, user_id=20aa56e1154649cb8b440dae788c922c, role_id=6a54ab92d32843d6bc4c2dcedae4bd13)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:09.384916 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b5999-0fee-485c-a879-5f64ae4459a1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:09.394518 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 303/606] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:12:09.395586 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090dd57d-20fc-430e-81f6-783d4e45e7a3 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:09.422975 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 304/607] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jul 27 15:12:09 2022] PUT /identity/v3/projects/0b616213eaea4a22afee15d4cbe5a3c5/users/20aa56e1154649cb8b440dae788c922c/roles/6a54ab92d32843d6bc4c2dcedae4bd13 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:12:09.424244 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890c7fd-0959-4bcb-a8ba-40f728058ff5 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:09.424529 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890c7fd-0959-4bcb-a8ba-40f728058ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:09.424818 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890c7fd-0959-4bcb-a8ba-40f728058ff5 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:09.426151 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 305/608] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:09.431802 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890c7fd-0959-4bcb-a8ba-40f728058ff5 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:09.550087 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:09.560649 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090dd57d-20fc-430e-81f6-783d4e45e7a3 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:09.613520 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472a58a-8b76-4405-9be6-c87adc3ef41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:09.613520 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472a58a-8b76-4405-9be6-c87adc3ef41d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:09.613520 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472a58a-8b76-4405-9be6-c87adc3ef41d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:09.613882 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472a58a-8b76-4405-9be6-c87adc3ef41d None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:09.614431 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9472a58a-8b76-4405-9be6-c87adc3ef41d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:09.614741 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9472a58a-8b76-4405-9be6-c87adc3ef41d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:09.618686 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9472a58a-8b76-4405-9be6-c87adc3ef41d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:09.638493 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 304/609] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jul 27 15:12:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:09.640125 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd144f-8dc4-42ee-9cac-b5bae7910eaf None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:09.640413 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd144f-8dc4-42ee-9cac-b5bae7910eaf None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:09.640683 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd144f-8dc4-42ee-9cac-b5bae7910eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:09.643572 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4890c7fd-0959-4bcb-a8ba-40f728058ff5 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:09.664831 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-d6dd144f-8dc4-42ee-9cac-b5bae7910eaf None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:09.666027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d6dd144f-8dc4-42ee-9cac-b5bae7910eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:09.690621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7861f-b261-43ca-b008-62bd1d6ef853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:09.691335 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7861f-b261-43ca-b008-62bd1d6ef853 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:09.691611 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7861f-b261-43ca-b008-62bd1d6ef853 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:09.691880 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc7861f-b261-43ca-b008-62bd1d6ef853 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:09.703021 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc7861f-b261-43ca-b008-62bd1d6ef853 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:12:09.707866 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-edc7861f-b261-43ca-b008-62bd1d6ef853 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:12:09.707866 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:09.707866 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:09.707866 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:09.707866 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:09.707866 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:09.707866 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:09.707866 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:09.707866 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:09.707866 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:09.707866 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:09.707866 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:09.707866 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:12:09.707866 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:12:09.707866 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:12:09.707866 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:12:09.708819 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:12:09.708819 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:12:09.708819 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:12:09.708819 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:12:09.708819 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:09.708819 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:09.708819 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:09.708819 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:09.708819 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:09.708819 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:09.708819 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:09.708819 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:09.708819 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:09.708819 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:09.708819 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:09.708819 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:09.710574 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:09.710574 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:09.710574 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:09.710574 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:09.710574 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:12:09.710574 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:12:09.710574 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:12:09.710574 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:12:09.710574 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:12:09.710574 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:12:09.710574 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:12:09.710574 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:09.710574 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 306/610] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jul 27 15:12:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:09.711266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7861f-b261-43ca-b008-62bd1d6ef853 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:09.767470 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:09.770645 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 305/611] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:12:09.772403 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd144f-8dc4-42ee-9cac-b5bae7910eaf None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:09.825845 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc7861f-b261-43ca-b008-62bd1d6ef853 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:09.862408 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f70b8-83b6-49f4-bb33-b4d5d542aa90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:09.863069 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f70b8-83b6-49f4-bb33-b4d5d542aa90 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:09.863347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f70b8-83b6-49f4-bb33-b4d5d542aa90 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:09.863618 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f70b8-83b6-49f4-bb33-b4d5d542aa90 None admin] PATH_INFO: `/v3/projects/0b616213eaea4a22afee15d4cbe5a3c5/users/227dac1eaefc4d0a8d3cc8a6dee2ecba/roles/6a54ab92d32843d6bc4c2dcedae4bd13` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:09.882789 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f70b8-83b6-49f4-bb33-b4d5d542aa90 None admin] RBAC: Authorizing `identity:create_grant(project_id=0b616213eaea4a22afee15d4cbe5a3c5, user_id=227dac1eaefc4d0a8d3cc8a6dee2ecba, role_id=6a54ab92d32843d6bc4c2dcedae4bd13)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:09.885298 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f70b8-83b6-49f4-bb33-b4d5d542aa90 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:09.886234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:09.902108 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 307/612] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jul 27 15:12:09 2022] PUT /identity/v3/projects/0b616213eaea4a22afee15d4cbe5a3c5/users/227dac1eaefc4d0a8d3cc8a6dee2ecba/roles/6a54ab92d32843d6bc4c2dcedae4bd13 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:12:09.903904 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f70b8-83b6-49f4-bb33-b4d5d542aa90 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:09.906474 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd144f-8dc4-42ee-9cac-b5bae7910eaf None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:09.947060 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a25b7-1178-44f7-bf5c-489f6e141bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:09.947724 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a25b7-1178-44f7-bf5c-489f6e141bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:09.948155 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a25b7-1178-44f7-bf5c-489f6e141bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:09.948504 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a25b7-1178-44f7-bf5c-489f6e141bc3 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:09.949290 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a25b7-1178-44f7-bf5c-489f6e141bc3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:09.949700 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a25b7-1178-44f7-bf5c-489f6e141bc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:09.951234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a25b7-1178-44f7-bf5c-489f6e141bc3 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:09.961174 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 306/613] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jul 27 15:12:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:09.967008 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a25b7-1178-44f7-bf5c-489f6e141bc3 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:10.031340 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:10.036351 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f70b8-83b6-49f4-bb33-b4d5d542aa90 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:10.079892 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61996cc1-3568-469b-844b-cb0857dc9404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:10.081801 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61996cc1-3568-469b-844b-cb0857dc9404 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:10.082287 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61996cc1-3568-469b-844b-cb0857dc9404 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:10.083032 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61996cc1-3568-469b-844b-cb0857dc9404 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:10.096549 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61996cc1-3568-469b-844b-cb0857dc9404 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:12:10.102755 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-61996cc1-3568-469b-844b-cb0857dc9404 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:12:10.102755 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:10.102755 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:10.102755 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:10.102755 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:10.102755 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:10.102755 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:10.102755 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:10.102755 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:10.102755 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:10.102755 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:10.102755 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:10.102755 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:12:10.102755 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:12:10.102755 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:12:10.102755 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:12:10.103697 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:12:10.103697 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:12:10.103697 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:12:10.103697 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:12:10.103697 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:10.103697 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:10.103697 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:10.103697 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:10.103697 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:10.103697 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:10.103697 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:10.103697 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:10.103697 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:10.103697 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:10.103697 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:10.103697 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:10.104569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:10.104569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:10.104569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:10.104569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:10.104569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:12:10.104569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:12:10.104569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:12:10.104569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:12:10.104569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:12:10.104569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:12:10.104569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:12:10.104569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:10.107802 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 308/614] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jul 27 15:12:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:10.113303 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61996cc1-3568-469b-844b-cb0857dc9404 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:10.157880 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a25b7-1178-44f7-bf5c-489f6e141bc3 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:10.197398 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70c32d-1a71-4bff-b757-38a48dfaf7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:10.197990 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70c32d-1a71-4bff-b757-38a48dfaf7fc None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:10.198328 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70c32d-1a71-4bff-b757-38a48dfaf7fc None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:10.198515 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea70c32d-1a71-4bff-b757-38a48dfaf7fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:10.210896 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea70c32d-1a71-4bff-b757-38a48dfaf7fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:10.212422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea70c32d-1a71-4bff-b757-38a48dfaf7fc None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:10.221650 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:10.233405 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-ea70c32d-1a71-4bff-b757-38a48dfaf7fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:10.233405 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:10.233405 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:10.233405 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:10.233405 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:10.233405 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:10.233405 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:10.233405 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:10.233405 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:10.233405 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:10.233405 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:10.233405 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:10.233405 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:10.233405 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:10.233405 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:10.234330 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:10.234330 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:10.234330 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:10.234330 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:10.234330 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:10.234330 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:10.234330 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:10.234330 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:10.234330 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:10.234330 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:10.234330 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:10.234330 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:10.234330 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:10.234330 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:10.234330 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:10.234330 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:10.234330 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:10.235220 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:10.235220 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:10.235220 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:10.235220 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:10.235947 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 307/615] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:10.242026 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70c32d-1a71-4bff-b757-38a48dfaf7fc None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:10.254850 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61996cc1-3568-469b-844b-cb0857dc9404 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:10.300892 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a774dc-03f9-4abd-bcce-5034f533fafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:10.301630 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a774dc-03f9-4abd-bcce-5034f533fafb None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:10.301914 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a774dc-03f9-4abd-bcce-5034f533fafb None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:10.302474 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a774dc-03f9-4abd-bcce-5034f533fafb None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:10.303739 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a774dc-03f9-4abd-bcce-5034f533fafb None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:10.304068 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a774dc-03f9-4abd-bcce-5034f533fafb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:10.305482 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a774dc-03f9-4abd-bcce-5034f533fafb None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:10.315105 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 309/616] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jul 27 15:12:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:10.320981 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a774dc-03f9-4abd-bcce-5034f533fafb None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:10.345420 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:10.390922 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea70c32d-1a71-4bff-b757-38a48dfaf7fc None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:10.425509 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1caf33-2e33-49fa-a914-1fe56f0165c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:10.426127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1caf33-2e33-49fa-a914-1fe56f0165c8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:10.426404 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1caf33-2e33-49fa-a914-1fe56f0165c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:10.426675 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1caf33-2e33-49fa-a914-1fe56f0165c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:10.427361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1caf33-2e33-49fa-a914-1fe56f0165c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:10.427661 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1caf33-2e33-49fa-a914-1fe56f0165c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:10.429616 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1caf33-2e33-49fa-a914-1fe56f0165c8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:10.446339 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 308/617] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:10.451651 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1caf33-2e33-49fa-a914-1fe56f0165c8 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:10.524392 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:10.554141 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1caf33-2e33-49fa-a914-1fe56f0165c8 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:10.566087 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a774dc-03f9-4abd-bcce-5034f533fafb None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:10.589297 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ad143-22df-47df-a9f5-48cf495f56a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:10.589933 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ad143-22df-47df-a9f5-48cf495f56a3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:10.590209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ad143-22df-47df-a9f5-48cf495f56a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:10.590473 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58ad143-22df-47df-a9f5-48cf495f56a3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:10.600062 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ad143-22df-47df-a9f5-48cf495f56a3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:10.602543 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58ad143-22df-47df-a9f5-48cf495f56a3 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:10.615239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-c58ad143-22df-47df-a9f5-48cf495f56a3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 15:12:10.615239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:10.615239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:10.615239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:10.615239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:10.615239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:10.615239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:10.615239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:10.615239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:10.615239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:10.615239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:10.615239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:10.615239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:12:10.615239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:12:10.615239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:12:10.615239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:12:10.616781 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:10.616781 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:10.616781 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:12:10.616781 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:10.616781 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:12:10.616781 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:10.616781 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:10.616781 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:10.616781 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:10.616781 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:10.616781 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:10.616781 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:10.616781 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:10.616781 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:10.616781 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:10.616781 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:10.616781 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:10.616781 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:10.618361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:10.618361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:10.618361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:12:10.618361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:12:10.618361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:12:10.618361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:12:10.618361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:12:10.618361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:12:10.618361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 15:12:10.618361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:10.618361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 309/618] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jul 27 15:12:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:12:10.622528 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ad143-22df-47df-a9f5-48cf495f56a3 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:10.664712 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a17c0-ff8f-4dcb-8162-df8afb63ecea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:10.665359 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a17c0-ff8f-4dcb-8162-df8afb63ecea None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:10.665635 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a17c0-ff8f-4dcb-8162-df8afb63ecea None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:10.665901 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a17c0-ff8f-4dcb-8162-df8afb63ecea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:10.686013 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a17c0-ff8f-4dcb-8162-df8afb63ecea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:10.687447 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a17c0-ff8f-4dcb-8162-df8afb63ecea None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:10.715329 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-2d5a17c0-ff8f-4dcb-8162-df8afb63ecea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:10.715329 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:10.715329 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:10.715329 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:10.715329 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:10.715329 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:10.715329 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:10.715329 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:10.715329 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:10.715329 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:10.715329 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:10.715329 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:10.715329 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:10.715329 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:10.715329 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:10.716278 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:10.716278 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:10.716278 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:10.716278 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:10.716278 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:10.716278 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:10.716278 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:10.716278 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:10.716278 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:10.716278 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:10.716278 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:10.716278 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:10.716278 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:10.716278 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:10.716278 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:10.716278 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:10.716278 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:10.717330 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:10.717330 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:10.717330 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:10.717330 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:10.719735 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 310/619] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 399 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:10.727382 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a17c0-ff8f-4dcb-8162-df8afb63ecea None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:10.786677 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58ad143-22df-47df-a9f5-48cf495f56a3 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:10.807586 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:10.819013 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:10.828660 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97565a76-667f-45a4-81c2-dd0344f7ad8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:10.829362 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97565a76-667f-45a4-81c2-dd0344f7ad8e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:10.829649 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97565a76-667f-45a4-81c2-dd0344f7ad8e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:10.829971 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97565a76-667f-45a4-81c2-dd0344f7ad8e None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:10.830849 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97565a76-667f-45a4-81c2-dd0344f7ad8e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:10.831165 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97565a76-667f-45a4-81c2-dd0344f7ad8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:10.832825 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97565a76-667f-45a4-81c2-dd0344f7ad8e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:10.856039 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 310/620] 10.222.0.40 () {56 vars in 1135 bytes} [Wed Jul 27 15:12:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:10.857108 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a17c0-ff8f-4dcb-8162-df8afb63ecea None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:10.865036 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97565a76-667f-45a4-81c2-dd0344f7ad8e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:10.915311 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4904a0-bcba-4313-bb2c-880ca1f16d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:10.916325 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4904a0-bcba-4313-bb2c-880ca1f16d99 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:10.916838 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4904a0-bcba-4313-bb2c-880ca1f16d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:10.917423 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4904a0-bcba-4313-bb2c-880ca1f16d99 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:10.918453 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4904a0-bcba-4313-bb2c-880ca1f16d99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:10.919000 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4904a0-bcba-4313-bb2c-880ca1f16d99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:10.920603 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4904a0-bcba-4313-bb2c-880ca1f16d99 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:10.934438 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 311/621] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:10.942084 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4904a0-bcba-4313-bb2c-880ca1f16d99 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:11.008257 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97565a76-667f-45a4-81c2-dd0344f7ad8e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:11.090652 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac9fdb-2a17-4f35-a4c9-f965bfc21b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:11.091301 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac9fdb-2a17-4f35-a4c9-f965bfc21b6b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:11.091581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac9fdb-2a17-4f35-a4c9-f965bfc21b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:11.091862 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac9fdb-2a17-4f35-a4c9-f965bfc21b6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:11.097216 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4904a0-bcba-4313-bb2c-880ca1f16d99 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:11.115587 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac9fdb-2a17-4f35-a4c9-f965bfc21b6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:11.117331 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac9fdb-2a17-4f35-a4c9-f965bfc21b6b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:11.145044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-32ac9fdb-2a17-4f35-a4c9-f965bfc21b6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:11.145044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:11.145044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:11.145044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:11.145044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:11.145044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:11.145044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:11.145044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:11.145044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:11.145044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:11.145044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:11.145044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:11.145044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:11.145044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:11.145044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:11.145959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:11.145959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:11.145959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:11.145959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:11.145959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:11.145959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:11.145959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:11.145959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:11.145959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:11.145959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:11.145959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:11.145959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:11.145959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:11.145959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:11.145959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:11.145959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:11.145959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:11.147354 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:11.147354 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:11.147354 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:11.147354 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:11.148021 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 311/622] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:11.153518 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac9fdb-2a17-4f35-a4c9-f965bfc21b6b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:11.156923 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:11.176682 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352c0b7-bbdc-4efb-90c3-7fc604eef872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:11.177335 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352c0b7-bbdc-4efb-90c3-7fc604eef872 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:11.177620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352c0b7-bbdc-4efb-90c3-7fc604eef872 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:11.177901 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352c0b7-bbdc-4efb-90c3-7fc604eef872 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:11.187142 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:11.193092 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6352c0b7-bbdc-4efb-90c3-7fc604eef872 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:11.194575 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6352c0b7-bbdc-4efb-90c3-7fc604eef872 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:11.221341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-6352c0b7-bbdc-4efb-90c3-7fc604eef872 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 15:12:11.221341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:11.221341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:11.221341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:11.221341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:11.221341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:11.221341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:11.221341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:11.221341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:11.221341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:11.221341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:11.221341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:11.221341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:12:11.221341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:12:11.221341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:12:11.221341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:12:11.222347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:11.222347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:11.222347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:12:11.222347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:11.222347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:12:11.222347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:11.222347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:11.222347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:11.222347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:11.222347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:11.222347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:11.222347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:11.222347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:11.222347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:11.222347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:11.222347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:11.222347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:11.222347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:11.223298 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:11.223298 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:11.223298 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:12:11.223298 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:12:11.223298 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:12:11.223298 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:12:11.223298 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:12:11.223298 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:12:11.223298 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 15:12:11.223298 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:11.231463 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 312/623] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Jul 27 15:12:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:11.234609 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352c0b7-bbdc-4efb-90c3-7fc604eef872 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:11.302842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac9fdb-2a17-4f35-a4c9-f965bfc21b6b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:11.338745 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e4a7e-28af-4972-97a1-43440b0e27c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:11.339370 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e4a7e-28af-4972-97a1-43440b0e27c3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:11.339652 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e4a7e-28af-4972-97a1-43440b0e27c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:11.339926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e4a7e-28af-4972-97a1-43440b0e27c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:11.340655 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e4a7e-28af-4972-97a1-43440b0e27c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:11.340962 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e4a7e-28af-4972-97a1-43440b0e27c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:11.342496 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e4a7e-28af-4972-97a1-43440b0e27c3 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:11.355894 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 312/624] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:11.361180 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e4a7e-28af-4972-97a1-43440b0e27c3 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:11.383970 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352c0b7-bbdc-4efb-90c3-7fc604eef872 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:11.420912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da09d1d-0722-4af2-ab2d-cba8f92dcf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:11.421643 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da09d1d-0722-4af2-ab2d-cba8f92dcf80 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:11.421820 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da09d1d-0722-4af2-ab2d-cba8f92dcf80 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:11.422049 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da09d1d-0722-4af2-ab2d-cba8f92dcf80 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:11.422876 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da09d1d-0722-4af2-ab2d-cba8f92dcf80 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:11.423180 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da09d1d-0722-4af2-ab2d-cba8f92dcf80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:11.424703 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da09d1d-0722-4af2-ab2d-cba8f92dcf80 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:11.447173 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 313/625] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Jul 27 15:12:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:11.448467 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f25832-bfe5-4bcb-98f5-64a81ed7f9c5 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:11.448752 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f25832-bfe5-4bcb-98f5-64a81ed7f9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:11.449026 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f25832-bfe5-4bcb-98f5-64a81ed7f9c5 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:11.450485 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 314/626] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:11.457006 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f25832-bfe5-4bcb-98f5-64a81ed7f9c5 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:11.467408 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:11.480804 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e4a7e-28af-4972-97a1-43440b0e27c3 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:11.513894 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:11.518137 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb469c23-8b86-45a3-85d2-1a459c1d0df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:11.518789 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb469c23-8b86-45a3-85d2-1a459c1d0df1 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:11.519064 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb469c23-8b86-45a3-85d2-1a459c1d0df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:11.519332 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb469c23-8b86-45a3-85d2-1a459c1d0df1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:11.526820 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb469c23-8b86-45a3-85d2-1a459c1d0df1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:11.528305 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb469c23-8b86-45a3-85d2-1a459c1d0df1 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:11.540287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-bb469c23-8b86-45a3-85d2-1a459c1d0df1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:11.540287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:11.540287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:11.540287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:11.540287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:11.540287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:11.540287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:11.540287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:11.540287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:11.540287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:11.540287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:11.540287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:11.540287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:12:11.540287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:12:11.540287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:12:11.541177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:12:11.541177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:11.541177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:11.541177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:11.541177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:11.541177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:11.541177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:11.541177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:11.541177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:11.541177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:11.541177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:11.541177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:11.541177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:11.541177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:11.541177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:11.541177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:11.541177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:11.542044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:12:11.542044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:12:11.542044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:12:11.542044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:12:11.542044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:12:11.542044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:12:11.542044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:11.542044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:11.546290 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 313/627] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:12:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:11.547553 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c12cbb-0f0e-498e-a7e7-976add82ec5a None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:11.547839 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c12cbb-0f0e-498e-a7e7-976add82ec5a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:11.548161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c12cbb-0f0e-498e-a7e7-976add82ec5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:11.565706 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-10c12cbb-0f0e-498e-a7e7-976add82ec5a None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:11.566889 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-10c12cbb-0f0e-498e-a7e7-976add82ec5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:11.574212 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f25832-bfe5-4bcb-98f5-64a81ed7f9c5 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:11.621021 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392cbc9c-4ffb-446b-8fa8-8c11b1e1316a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:11.621986 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cbc9c-4ffb-446b-8fa8-8c11b1e1316a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:11.622460 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cbc9c-4ffb-446b-8fa8-8c11b1e1316a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:11.622923 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392cbc9c-4ffb-446b-8fa8-8c11b1e1316a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:11.644015 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 314/628] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:12:11.644015 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c12cbb-0f0e-498e-a7e7-976add82ec5a None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:11.717837 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392cbc9c-4ffb-446b-8fa8-8c11b1e1316a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:11.719747 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392cbc9c-4ffb-446b-8fa8-8c11b1e1316a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:11.720331 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:11.742673 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c12cbb-0f0e-498e-a7e7-976add82ec5a None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:11.774263 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:11.778532 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300d1ea-bee2-4094-a58e-1c25feaf9a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:11.779166 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300d1ea-bee2-4094-a58e-1c25feaf9a64 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:11.779449 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300d1ea-bee2-4094-a58e-1c25feaf9a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:11.779726 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300d1ea-bee2-4094-a58e-1c25feaf9a64 None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:11.780510 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300d1ea-bee2-4094-a58e-1c25feaf9a64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:11.780874 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300d1ea-bee2-4094-a58e-1c25feaf9a64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:11.782243 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3300d1ea-bee2-4094-a58e-1c25feaf9a64 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:11.799830 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 315/629] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jul 27 15:12:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:11.800597 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300d1ea-bee2-4094-a58e-1c25feaf9a64 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:11.833867 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 315/630] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:12:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 15:12:11.835145 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392cbc9c-4ffb-446b-8fa8-8c11b1e1316a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:11.917094 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300d1ea-bee2-4094-a58e-1c25feaf9a64 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:11.948362 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392cbc9c-4ffb-446b-8fa8-8c11b1e1316a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:11.954924 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb278b9-7c22-4e7c-a585-aaa22228a1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:11.955944 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb278b9-7c22-4e7c-a585-aaa22228a1f9 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:11.956255 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb278b9-7c22-4e7c-a585-aaa22228a1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:11.956522 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb278b9-7c22-4e7c-a585-aaa22228a1f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:11.963643 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:11.969842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb278b9-7c22-4e7c-a585-aaa22228a1f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:12:11.975210 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-afb278b9-7c22-4e7c-a585-aaa22228a1f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:12:11.975210 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:11.975210 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:11.975210 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:11.975210 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:11.975210 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:11.975210 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:11.975210 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:11.975210 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:11.975210 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:11.975210 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:11.975210 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:11.975210 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:12:11.975210 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:12:11.975210 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:12:11.975210 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:12:11.976173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:12:11.976173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:12:11.976173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:12:11.976173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:12:11.976173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:11.976173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:11.976173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:11.976173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:11.976173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:11.976173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:11.976173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:11.976173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:11.976173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:11.976173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:11.976173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:11.976173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:11.977003 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:11.977003 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:11.977003 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:11.977003 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:11.977003 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:12:11.977003 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:12:11.977003 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:12:11.977003 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:12:11.977003 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:12:11.977003 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:12:11.977003 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:12:11.977003 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:11.977003 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 316/631] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jul 27 15:12:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:11.977678 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb278b9-7c22-4e7c-a585-aaa22228a1f9 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:11.987767 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60abd28-8d58-4f08-b653-9e59f019fb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:11.988460 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60abd28-8d58-4f08-b653-9e59f019fb59 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:11.988747 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60abd28-8d58-4f08-b653-9e59f019fb59 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:11.989023 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60abd28-8d58-4f08-b653-9e59f019fb59 None admin] PATH_INFO: `/v3/projects/0b616213eaea4a22afee15d4cbe5a3c5/users/68bbf8bb59a84829afacd9677c9639a6/roles/6a54ab92d32843d6bc4c2dcedae4bd13` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:12.003798 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60abd28-8d58-4f08-b653-9e59f019fb59 None admin] RBAC: Authorizing `identity:create_grant(project_id=0b616213eaea4a22afee15d4cbe5a3c5, user_id=68bbf8bb59a84829afacd9677c9639a6, role_id=6a54ab92d32843d6bc4c2dcedae4bd13)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:12.005325 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60abd28-8d58-4f08-b653-9e59f019fb59 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:12.016451 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:12.024076 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 316/632] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jul 27 15:12:11 2022] PUT /identity/v3/projects/0b616213eaea4a22afee15d4cbe5a3c5/users/68bbf8bb59a84829afacd9677c9639a6/roles/6a54ab92d32843d6bc4c2dcedae4bd13 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:12:12.025751 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c627c-6609-4358-a7c2-50d41380b830 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:12.026224 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c627c-6609-4358-a7c2-50d41380b830 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:12.026672 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c627c-6609-4358-a7c2-50d41380b830 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:12.032304 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 317/633] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:12.032304 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c627c-6609-4358-a7c2-50d41380b830 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:12.111572 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb278b9-7c22-4e7c-a585-aaa22228a1f9 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:12.160526 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c627c-6609-4358-a7c2-50d41380b830 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:12.162350 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74359b0-6439-48c3-93ea-86f37928a84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:12.164257 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74359b0-6439-48c3-93ea-86f37928a84a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:12.164635 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74359b0-6439-48c3-93ea-86f37928a84a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:12.165005 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74359b0-6439-48c3-93ea-86f37928a84a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:12.181991 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74359b0-6439-48c3-93ea-86f37928a84a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:12.183499 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74359b0-6439-48c3-93ea-86f37928a84a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:12.204522 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-a74359b0-6439-48c3-93ea-86f37928a84a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:12.204522 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:12.204522 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:12.204522 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:12.204522 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:12.204522 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:12.204522 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:12.204522 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:12.204522 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:12.204522 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:12.204522 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:12.204522 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:12.204522 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:12.204522 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:12.204522 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:12.206012 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:12.206012 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:12.206012 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:12.206012 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:12.206012 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:12.206012 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:12.206012 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:12.206012 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:12.206012 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:12.206012 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:12.206012 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:12.206012 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:12.206012 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:12.206012 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:12.206012 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:12.206012 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:12.206012 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:12.206987 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:12.206987 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:12.206987 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:12.206987 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:12.207211 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef34767-6a40-43fb-9a91-23ba06f4cb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:12.207690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef34767-6a40-43fb-9a91-23ba06f4cb14 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:12.207968 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef34767-6a40-43fb-9a91-23ba06f4cb14 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:12.208267 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef34767-6a40-43fb-9a91-23ba06f4cb14 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:12.209063 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef34767-6a40-43fb-9a91-23ba06f4cb14 None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:12.209428 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef34767-6a40-43fb-9a91-23ba06f4cb14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:12.209577 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 317/634] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:12.210660 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef34767-6a40-43fb-9a91-23ba06f4cb14 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:12.211078 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7f439-4a46-4dd6-8699-56efa90e3a7a None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:12.211495 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7f439-4a46-4dd6-8699-56efa90e3a7a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:12.212020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e7f439-4a46-4dd6-8699-56efa90e3a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:12.219525 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 318/635] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jul 27 15:12:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:12.221515 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef34767-6a40-43fb-9a91-23ba06f4cb14 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:12.234538 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-e2e7f439-4a46-4dd6-8699-56efa90e3a7a None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:12.235713 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e2e7f439-4a46-4dd6-8699-56efa90e3a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:12.289411 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:12.305496 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:12.315476 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 318/636] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:12:12.316469 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7f439-4a46-4dd6-8699-56efa90e3a7a None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:12.362155 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef34767-6a40-43fb-9a91-23ba06f4cb14 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:12.398720 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b54130-960c-45e5-a2eb-c2ea51afe49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:12.399331 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b54130-960c-45e5-a2eb-c2ea51afe49f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:12.399611 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b54130-960c-45e5-a2eb-c2ea51afe49f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:12.399883 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b54130-960c-45e5-a2eb-c2ea51afe49f None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:12.400633 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b54130-960c-45e5-a2eb-c2ea51afe49f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:12.400935 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b54130-960c-45e5-a2eb-c2ea51afe49f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:12.402297 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b54130-960c-45e5-a2eb-c2ea51afe49f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:12.419781 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 319/637] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:12.421197 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc816fc-c80f-4215-b46f-3270d6bd0f94 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:12.421489 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc816fc-c80f-4215-b46f-3270d6bd0f94 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:12.421766 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc816fc-c80f-4215-b46f-3270d6bd0f94 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:12.424031 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 320/638] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:12.424031 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc816fc-c80f-4215-b46f-3270d6bd0f94 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:12.435957 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e7f439-4a46-4dd6-8699-56efa90e3a7a None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:12.486374 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827287a0-1cbe-4f38-9685-8c0dbebd71ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:12.487017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827287a0-1cbe-4f38-9685-8c0dbebd71ee None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:12.487295 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827287a0-1cbe-4f38-9685-8c0dbebd71ee None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:12.487567 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827287a0-1cbe-4f38-9685-8c0dbebd71ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:12.498828 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827287a0-1cbe-4f38-9685-8c0dbebd71ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:12.500296 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827287a0-1cbe-4f38-9685-8c0dbebd71ee None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:12.516293 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-827287a0-1cbe-4f38-9685-8c0dbebd71ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:12.516293 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:12.516293 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:12.516293 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:12.516293 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:12.516293 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:12.516293 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:12.516293 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:12.516293 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:12.516293 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:12.516293 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:12.516293 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:12.516293 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:12.516293 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:12.516293 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:12.517435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:12.517435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:12.517435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:12.517435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:12.517435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:12.517435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:12.517435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:12.517435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:12.517435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:12.517435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:12.517435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:12.517435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:12.517435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:12.517435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:12.517435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:12.517435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:12.517435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:12.518650 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:12.518650 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:12.518650 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:12.518650 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:12.522603 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 319/639] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:12.523425 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827287a0-1cbe-4f38-9685-8c0dbebd71ee None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:12.540171 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc816fc-c80f-4215-b46f-3270d6bd0f94 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:12.555893 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:12.567550 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:12.583060 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a31aaa-52cf-43c0-aae7-3051541c36e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:12.583695 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a31aaa-52cf-43c0-aae7-3051541c36e7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:12.583973 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a31aaa-52cf-43c0-aae7-3051541c36e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:12.584793 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a31aaa-52cf-43c0-aae7-3051541c36e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:12.597077 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a31aaa-52cf-43c0-aae7-3051541c36e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:12:12.602581 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-18a31aaa-52cf-43c0-aae7-3051541c36e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:12:12.602581 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:12.602581 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:12.602581 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:12.602581 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:12.602581 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:12.602581 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:12.602581 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:12.602581 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:12.602581 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:12.602581 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:12.602581 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:12.602581 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:12:12.602581 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:12:12.602581 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:12:12.602581 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:12:12.603533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:12:12.603533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:12:12.603533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:12:12.603533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:12:12.603533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:12.603533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:12.603533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:12.603533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:12.603533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:12.603533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:12.603533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:12.603533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:12.603533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:12.603533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:12.603533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:12.603533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:12.609523 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:12.609523 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:12.609523 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:12.609523 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:12.609523 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:12:12.609523 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:12:12.609523 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:12:12.609523 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:12:12.609523 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:12:12.609523 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:12:12.609523 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:12:12.609523 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:12.609523 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 321/640] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jul 27 15:12:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:12.609523 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88f907-3c52-492e-bb86-74650d0457ca None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:12.610297 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88f907-3c52-492e-bb86-74650d0457ca None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:12.610297 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88f907-3c52-492e-bb86-74650d0457ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:12.624551 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-5c88f907-3c52-492e-bb86-74650d0457ca None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:12.625640 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5c88f907-3c52-492e-bb86-74650d0457ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:12.648754 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827287a0-1cbe-4f38-9685-8c0dbebd71ee None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:12.685380 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027c993-30a4-4263-b2ad-2af38468dcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:12.686018 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027c993-30a4-4263-b2ad-2af38468dcad None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:12.686303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027c993-30a4-4263-b2ad-2af38468dcad None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:12.686580 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027c993-30a4-4263-b2ad-2af38468dcad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:12.693398 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027c993-30a4-4263-b2ad-2af38468dcad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:12.695078 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027c993-30a4-4263-b2ad-2af38468dcad None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:12.696301 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 322/641] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:12:12.697142 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88f907-3c52-492e-bb86-74650d0457ca None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:12.711423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-4027c993-30a4-4263-b2ad-2af38468dcad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:12.711423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:12.711423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:12.711423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:12.711423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:12.711423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:12.711423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:12.711423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:12.711423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:12.711423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:12.711423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:12.711423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:12.711423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:12:12.711423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:12:12.711423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:12:12.712435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:12:12.712435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:12.712435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:12.712435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:12.712435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:12.712435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:12.712435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:12.712435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:12.712435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:12.712435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:12.712435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:12.712435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:12.712435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:12.712435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:12.712435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:12.712435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:12.712435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:12.713337 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:12:12.713337 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:12:12.713337 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:12:12.713337 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:12:12.713337 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:12:12.713337 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:12:12.713337 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:12.713337 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:12.715846 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 320/642] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:12:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:12.717042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027c993-30a4-4263-b2ad-2af38468dcad None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:12.814668 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88f907-3c52-492e-bb86-74650d0457ca None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:12.828247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:12.838585 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:12.850968 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027c993-30a4-4263-b2ad-2af38468dcad None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:12.853149 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34627ea4-c92a-4fee-8b9d-6774375f3ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:12.853774 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34627ea4-c92a-4fee-8b9d-6774375f3ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:12.854048 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34627ea4-c92a-4fee-8b9d-6774375f3ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:12.854330 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34627ea4-c92a-4fee-8b9d-6774375f3ea3 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:12.855030 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34627ea4-c92a-4fee-8b9d-6774375f3ea3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:12.855340 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34627ea4-c92a-4fee-8b9d-6774375f3ea3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:12.856757 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34627ea4-c92a-4fee-8b9d-6774375f3ea3 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:12.868614 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 323/643] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:12.869418 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34627ea4-c92a-4fee-8b9d-6774375f3ea3 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:12.892967 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afa5e1-8f5e-4ba9-bc98-ce3255703e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:12.893628 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afa5e1-8f5e-4ba9-bc98-ce3255703e46 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:12.893905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afa5e1-8f5e-4ba9-bc98-ce3255703e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:12.894173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3afa5e1-8f5e-4ba9-bc98-ce3255703e46 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:12.894875 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afa5e1-8f5e-4ba9-bc98-ce3255703e46 None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:12.895176 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afa5e1-8f5e-4ba9-bc98-ce3255703e46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:12.896828 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3afa5e1-8f5e-4ba9-bc98-ce3255703e46 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:12.910419 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 321/644] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jul 27 15:12:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:12.910419 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afa5e1-8f5e-4ba9-bc98-ce3255703e46 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:12.979354 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34627ea4-c92a-4fee-8b9d-6774375f3ea3 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:13.013710 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d3edb-9e71-4d1d-95f7-d46714972792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:13.014318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d3edb-9e71-4d1d-95f7-d46714972792 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:13.014599 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d3edb-9e71-4d1d-95f7-d46714972792 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:13.014871 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387d3edb-9e71-4d1d-95f7-d46714972792 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:13.015506 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3afa5e1-8f5e-4ba9-bc98-ce3255703e46 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:13.015625 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d3edb-9e71-4d1d-95f7-d46714972792 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:13.015906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d3edb-9e71-4d1d-95f7-d46714972792 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:13.017342 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387d3edb-9e71-4d1d-95f7-d46714972792 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:13.030719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 324/645] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jul 27 15:12:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:13.031783 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d3edb-9e71-4d1d-95f7-d46714972792 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:13.054791 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfec2e-80eb-440e-8a1b-8dd76c792a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:13.055426 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfec2e-80eb-440e-8a1b-8dd76c792a28 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:13.055707 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfec2e-80eb-440e-8a1b-8dd76c792a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:13.055981 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfec2e-80eb-440e-8a1b-8dd76c792a28 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:13.065981 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfec2e-80eb-440e-8a1b-8dd76c792a28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:12:13.070620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:13.072505 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-0ddfec2e-80eb-440e-8a1b-8dd76c792a28 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:12:13.072505 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:13.072505 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:13.072505 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:13.072505 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:13.072505 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:13.072505 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:13.072505 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:13.072505 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:13.072505 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:13.072505 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:13.072505 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:13.072505 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:12:13.072505 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:12:13.072505 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:12:13.072505 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:12:13.073588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:12:13.073588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:12:13.073588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:12:13.073588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:12:13.073588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:13.073588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:13.073588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:13.073588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:13.073588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:13.073588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:13.073588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:13.073588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:13.073588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:13.073588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:13.073588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:13.073588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:13.075257 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:13.075257 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:13.075257 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:13.075257 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:13.075257 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:12:13.075257 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:12:13.075257 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:12:13.075257 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:12:13.075257 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:12:13.075257 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:12:13.075257 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:12:13.075257 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:13.075257 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 322/646] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jul 27 15:12:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:13.075257 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfec2e-80eb-440e-8a1b-8dd76c792a28 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:13.093654 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:13.154384 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387d3edb-9e71-4d1d-95f7-d46714972792 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:13.189880 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfec2e-80eb-440e-8a1b-8dd76c792a28 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:13.192799 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321ad02-9004-43a6-8b4f-95abaa37ab6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:13.193446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321ad02-9004-43a6-8b4f-95abaa37ab6f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:13.194239 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321ad02-9004-43a6-8b4f-95abaa37ab6f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:13.194508 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321ad02-9004-43a6-8b4f-95abaa37ab6f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:13.202391 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a321ad02-9004-43a6-8b4f-95abaa37ab6f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:13.203825 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a321ad02-9004-43a6-8b4f-95abaa37ab6f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:13.215689 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-a321ad02-9004-43a6-8b4f-95abaa37ab6f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 15:12:13.215689 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:13.215689 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:13.215689 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:13.215689 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:13.215689 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:13.215689 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:13.215689 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:13.215689 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:13.215689 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:13.215689 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:13.215689 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:13.215689 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:12:13.215689 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:12:13.215689 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:12:13.215689 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:12:13.216707 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:13.216707 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:13.216707 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:12:13.216707 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:13.216707 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:12:13.216707 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:13.216707 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:13.216707 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:13.216707 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:13.216707 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:13.216707 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:13.216707 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:13.216707 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:13.216707 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:13.216707 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:13.216707 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:13.216707 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:13.216707 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:13.217664 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:13.217664 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:13.217664 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:12:13.217664 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:12:13.217664 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:12:13.217664 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:12:13.217664 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:12:13.217664 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:12:13.217664 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 15:12:13.217664 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:13.217664 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 325/647] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:12:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:13.218284 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321ad02-9004-43a6-8b4f-95abaa37ab6f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:13.232281 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e1de8-4294-4436-93c6-a673c2f2f66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:13.233234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e1de8-4294-4436-93c6-a673c2f2f66c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:13.233517 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e1de8-4294-4436-93c6-a673c2f2f66c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:13.233787 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e1de8-4294-4436-93c6-a673c2f2f66c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:13.246413 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e1de8-4294-4436-93c6-a673c2f2f66c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:13.248161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e1de8-4294-4436-93c6-a673c2f2f66c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:13.263357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-1a3e1de8-4294-4436-93c6-a673c2f2f66c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:13.263357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:13.263357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:13.263357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:13.263357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:13.263357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:13.263357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:13.263357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:13.263357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:13.263357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:13.263357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:13.263357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:13.263357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:13.263357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:13.263357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:13.264338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:13.264338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:13.264338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:13.264338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:13.264338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:13.264338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:13.264338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:13.264338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:13.264338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:13.264338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:13.264338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:13.264338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:13.264338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:13.264338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:13.264338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:13.264338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:13.264338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:13.265226 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:13.265226 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:13.265226 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:13.265226 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:13.265226 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 323/648] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:13.265529 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e1de8-4294-4436-93c6-a673c2f2f66c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:13.319474 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:13.329533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a321ad02-9004-43a6-8b4f-95abaa37ab6f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:13.338620 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:13.363774 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efd684-71bd-421a-81ba-b4429c24d034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:13.364423 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efd684-71bd-421a-81ba-b4429c24d034 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:13.364705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efd684-71bd-421a-81ba-b4429c24d034 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:13.364982 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efd684-71bd-421a-81ba-b4429c24d034 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:13.365803 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1efd684-71bd-421a-81ba-b4429c24d034 None admin] RBAC: Adding query filter params (role.id=6a54ab92d32843d6bc4c2dcedae4bd13, scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5, user.id=d3e01aa0ef1340cbba7170bac4a82783) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:13.366112 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1efd684-71bd-421a-81ba-b4429c24d034 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:13.367516 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1efd684-71bd-421a-81ba-b4429c24d034 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:13.373273 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 326/649] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:12:13 2022] GET /identity/v3/role_assignments?user.id=d3e01aa0ef1340cbba7170bac4a82783&scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5&role.id=6a54ab92d32843d6bc4c2dcedae4bd13 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:13.374044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efd684-71bd-421a-81ba-b4429c24d034 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:13.388616 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e1de8-4294-4436-93c6-a673c2f2f66c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:13.440162 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7778f-45e4-4a5d-9722-6b91fdc8e53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:13.440714 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7778f-45e4-4a5d-9722-6b91fdc8e53b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:13.440997 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7778f-45e4-4a5d-9722-6b91fdc8e53b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:13.441271 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a7778f-45e4-4a5d-9722-6b91fdc8e53b None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:13.441995 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7778f-45e4-4a5d-9722-6b91fdc8e53b None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:13.442773 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7778f-45e4-4a5d-9722-6b91fdc8e53b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:13.444475 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a7778f-45e4-4a5d-9722-6b91fdc8e53b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:13.460945 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 324/650] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jul 27 15:12:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:13.460945 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7778f-45e4-4a5d-9722-6b91fdc8e53b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:13.517719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efd684-71bd-421a-81ba-b4429c24d034 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:13.563653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1f866-c1cb-4894-b47a-e4b928d7d4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:13.564358 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1f866-c1cb-4894-b47a-e4b928d7d4c1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:13.564666 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1f866-c1cb-4894-b47a-e4b928d7d4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:13.564920 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1f866-c1cb-4894-b47a-e4b928d7d4c1 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:13.565720 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1f866-c1cb-4894-b47a-e4b928d7d4c1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:13.566031 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1f866-c1cb-4894-b47a-e4b928d7d4c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:13.567445 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1f866-c1cb-4894-b47a-e4b928d7d4c1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:13.579595 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a7778f-45e4-4a5d-9722-6b91fdc8e53b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:13.587554 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 327/651] 10.222.0.40 () {56 vars in 1137 bytes} [Wed Jul 27 15:12:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:13.589089 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1f866-c1cb-4894-b47a-e4b928d7d4c1 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:13.608898 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:13.615227 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:13.628389 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb57255-185b-4254-ae89-df02e6c47934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:13.629014 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb57255-185b-4254-ae89-df02e6c47934 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:13.629302 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb57255-185b-4254-ae89-df02e6c47934 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:13.629578 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb57255-185b-4254-ae89-df02e6c47934 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:13.630272 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb57255-185b-4254-ae89-df02e6c47934 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:13.630584 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb57255-185b-4254-ae89-df02e6c47934 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:13.632502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb57255-185b-4254-ae89-df02e6c47934 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:13.650238 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 325/652] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:13.651102 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb57255-185b-4254-ae89-df02e6c47934 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:13.716022 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1f866-c1cb-4894-b47a-e4b928d7d4c1 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:13.760735 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f918323-6f72-45ea-8cb8-c1ae415be9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:13.761499 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f918323-6f72-45ea-8cb8-c1ae415be9ed None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:13.762032 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f918323-6f72-45ea-8cb8-c1ae415be9ed None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:13.762316 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f918323-6f72-45ea-8cb8-c1ae415be9ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:13.768971 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb57255-185b-4254-ae89-df02e6c47934 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:13.777955 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f918323-6f72-45ea-8cb8-c1ae415be9ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:13.780035 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f918323-6f72-45ea-8cb8-c1ae415be9ed None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:13.801844 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-1f918323-6f72-45ea-8cb8-c1ae415be9ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:13.801844 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:13.801844 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:13.801844 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:13.801844 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:13.801844 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:13.801844 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:13.801844 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:13.801844 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:13.801844 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:13.801844 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:13.801844 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:13.801844 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:13.801844 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:13.801844 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:13.802783 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:13.802783 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:13.802783 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:13.802783 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:13.802783 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:13.802783 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:13.802783 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:13.802783 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:13.802783 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:13.802783 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:13.802783 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:13.802783 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:13.802783 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:13.802783 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:13.802783 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:13.802783 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:13.802783 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:13.804269 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:13.804269 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:13.804269 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:13.804269 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:13.804917 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 328/653] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:13.808024 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f918323-6f72-45ea-8cb8-c1ae415be9ed None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:13.814676 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6733e-c7f3-40a6-8966-b025daf80c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:13.815391 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6733e-c7f3-40a6-8966-b025daf80c6c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:13.815677 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6733e-c7f3-40a6-8966-b025daf80c6c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:13.815954 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f6733e-c7f3-40a6-8966-b025daf80c6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:13.875762 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:13.879220 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:13.892827 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6733e-c7f3-40a6-8966-b025daf80c6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:13.894291 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f6733e-c7f3-40a6-8966-b025daf80c6c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:13.911872 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f918323-6f72-45ea-8cb8-c1ae415be9ed None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:13.948551 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54be50c-c1c1-407a-a705-0fbb1a403f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:13.949287 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54be50c-c1c1-407a-a705-0fbb1a403f0c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:13.949569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54be50c-c1c1-407a-a705-0fbb1a403f0c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:13.949844 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54be50c-c1c1-407a-a705-0fbb1a403f0c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:13.958991 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54be50c-c1c1-407a-a705-0fbb1a403f0c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:13.960517 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54be50c-c1c1-407a-a705-0fbb1a403f0c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:13.972145 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-c54be50c-c1c1-407a-a705-0fbb1a403f0c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 15:12:13.972145 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:13.972145 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:13.972145 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:13.972145 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:13.972145 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:13.972145 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:13.972145 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:13.972145 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:13.972145 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:13.972145 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:13.972145 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:13.972145 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:12:13.972145 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:12:13.972145 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:12:13.972145 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:12:13.973119 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:13.973119 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:13.973119 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:12:13.973119 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:13.973119 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:12:13.973119 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:13.973119 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:13.973119 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:13.973119 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:13.973119 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:13.973119 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:13.973119 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:13.973119 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:13.973119 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:13.973119 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:13.973119 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:13.973119 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:13.973119 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:13.974057 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:13.974057 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:13.974057 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:12:13.974057 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:12:13.974057 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:12:13.974057 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:12:13.974057 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:12:13.974057 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:12:13.974057 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 15:12:13.974057 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:13.978493 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 329/654] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:12:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:13.979316 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54be50c-c1c1-407a-a705-0fbb1a403f0c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:13.999559 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 326/655] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:12:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 15:12:14.000745 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6733e-c7f3-40a6-8966-b025daf80c6c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:14.090200 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54be50c-c1c1-407a-a705-0fbb1a403f0c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:14.090674 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:14.103721 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f6733e-c7f3-40a6-8966-b025daf80c6c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:14.124356 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:14.129228 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aee032-bcc2-4465-9c8c-374bbb287554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:14.130211 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aee032-bcc2-4465-9c8c-374bbb287554 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:14.130701 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aee032-bcc2-4465-9c8c-374bbb287554 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:14.131261 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aee032-bcc2-4465-9c8c-374bbb287554 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:14.132182 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aee032-bcc2-4465-9c8c-374bbb287554 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:14.132691 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aee032-bcc2-4465-9c8c-374bbb287554 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:14.134436 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aee032-bcc2-4465-9c8c-374bbb287554 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:14.138741 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54870da8-6678-4935-ae86-5e10c478995c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:14.139356 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54870da8-6678-4935-ae86-5e10c478995c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:14.139638 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54870da8-6678-4935-ae86-5e10c478995c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:14.139911 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54870da8-6678-4935-ae86-5e10c478995c None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:14.140736 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54870da8-6678-4935-ae86-5e10c478995c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:14.141052 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54870da8-6678-4935-ae86-5e10c478995c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:14.142476 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54870da8-6678-4935-ae86-5e10c478995c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:14.153827 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 330/656] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:14.155003 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aee032-bcc2-4465-9c8c-374bbb287554 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:14.168029 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 327/657] 10.222.0.40 () {56 vars in 1137 bytes} [Wed Jul 27 15:12:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:14.168029 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54870da8-6678-4935-ae86-5e10c478995c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:14.265389 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54870da8-6678-4935-ae86-5e10c478995c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:14.265992 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aee032-bcc2-4465-9c8c-374bbb287554 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:14.301227 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5bae81-a19b-4302-b5bf-fc2697991531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:14.301570 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba88a5f-28f7-43a6-9320-b3ab6956fefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:14.301866 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bae81-a19b-4302-b5bf-fc2697991531 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:14.302147 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bae81-a19b-4302-b5bf-fc2697991531 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:14.302248 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba88a5f-28f7-43a6-9320-b3ab6956fefa None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:14.302419 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5bae81-a19b-4302-b5bf-fc2697991531 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:14.302528 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba88a5f-28f7-43a6-9320-b3ab6956fefa None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:14.302730 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba88a5f-28f7-43a6-9320-b3ab6956fefa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:14.309649 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5bae81-a19b-4302-b5bf-fc2697991531 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:14.311071 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5bae81-a19b-4302-b5bf-fc2697991531 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:14.313373 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba88a5f-28f7-43a6-9320-b3ab6956fefa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:14.314796 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba88a5f-28f7-43a6-9320-b3ab6956fefa None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:14.324171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-df5bae81-a19b-4302-b5bf-fc2697991531 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 15:12:14.324171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:14.324171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:14.324171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:14.324171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:14.324171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:14.324171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:14.324171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:14.324171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:14.324171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:14.324171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:14.324171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:14.324171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:12:14.324171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:12:14.324171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:12:14.324171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:12:14.325099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:14.325099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:14.325099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:12:14.325099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:14.325099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:12:14.325099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:14.325099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:14.325099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:14.325099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:14.325099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:14.325099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:14.325099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:14.325099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:14.325099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:14.325099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:14.325099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:14.325099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:14.325099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:14.326090 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:14.326090 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:14.326090 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:12:14.326090 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:12:14.326090 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:12:14.326090 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:12:14.326090 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:12:14.326090 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:12:14.326090 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 15:12:14.326090 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:14.326090 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 328/658] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jul 27 15:12:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:14.327215 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aa77f-f29b-4ff6-b031-b8f0957d7f13 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:14.327215 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aa77f-f29b-4ff6-b031-b8f0957d7f13 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:14.327215 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00aa77f-f29b-4ff6-b031-b8f0957d7f13 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:14.332041 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 329/659] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:14.332041 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00aa77f-f29b-4ff6-b031-b8f0957d7f13 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:14.337690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-eba88a5f-28f7-43a6-9320-b3ab6956fefa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:14.337690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:14.337690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:14.337690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:14.337690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:14.337690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:14.337690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:14.337690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:14.337690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:14.337690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:14.337690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:14.337690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:14.337690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:14.337690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:14.337690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:14.338586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:14.338586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:14.338586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:14.338586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:14.338586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:14.338586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:14.338586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:14.338586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:14.338586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:14.338586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:14.338586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:14.338586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:14.338586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:14.338586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:14.338586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:14.338586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:14.338586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:14.339509 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:14.339509 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:14.339509 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:14.339509 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:14.341170 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:14.343414 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 331/660] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:14.344295 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba88a5f-28f7-43a6-9320-b3ab6956fefa None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:14.394570 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:14.443490 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00aa77f-f29b-4ff6-b031-b8f0957d7f13 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:14.465123 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba88a5f-28f7-43a6-9320-b3ab6956fefa None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:14.485753 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec122cf-7ee3-4c2f-92b0-a737fd8a02ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:14.486374 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec122cf-7ee3-4c2f-92b0-a737fd8a02ad None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:14.486656 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec122cf-7ee3-4c2f-92b0-a737fd8a02ad None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:14.486938 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec122cf-7ee3-4c2f-92b0-a737fd8a02ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:14.506558 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a64a19-114d-415f-a7b8-9a48860417d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:14.507172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a64a19-114d-415f-a7b8-9a48860417d9 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:14.507453 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a64a19-114d-415f-a7b8-9a48860417d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:14.507727 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a64a19-114d-415f-a7b8-9a48860417d9 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:14.508557 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a64a19-114d-415f-a7b8-9a48860417d9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:14.508872 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a64a19-114d-415f-a7b8-9a48860417d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:14.510280 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a64a19-114d-415f-a7b8-9a48860417d9 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:14.528015 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 332/661] 10.222.0.40 () {56 vars in 1139 bytes} [Wed Jul 27 15:12:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:14.529185 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ccc4f-fc18-46bc-a927-5e91315c7c28 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:14.529471 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ccc4f-fc18-46bc-a927-5e91315c7c28 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:14.529745 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ccc4f-fc18-46bc-a927-5e91315c7c28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:14.548402 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-dc0ccc4f-fc18-46bc-a927-5e91315c7c28 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:14.549582 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-dc0ccc4f-fc18-46bc-a927-5e91315c7c28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:14.562800 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec122cf-7ee3-4c2f-92b0-a737fd8a02ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:14.564270 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec122cf-7ee3-4c2f-92b0-a737fd8a02ad None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:14.572745 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:14.632140 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 333/662] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:12:14.632140 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ccc4f-fc18-46bc-a927-5e91315c7c28 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:14.669260 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:14.677805 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 330/663] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:12:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 15:12:14.679367 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec122cf-7ee3-4c2f-92b0-a737fd8a02ad None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:14.749478 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ccc4f-fc18-46bc-a927-5e91315c7c28 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:14.781603 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec122cf-7ee3-4c2f-92b0-a737fd8a02ad None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:14.784640 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6394f-ee56-494d-bacc-3647339b442e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:14.785248 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6394f-ee56-494d-bacc-3647339b442e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:14.785532 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6394f-ee56-494d-bacc-3647339b442e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:14.785802 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6394f-ee56-494d-bacc-3647339b442e None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:14.786489 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6394f-ee56-494d-bacc-3647339b442e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:14.786791 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6394f-ee56-494d-bacc-3647339b442e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:14.788978 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6394f-ee56-494d-bacc-3647339b442e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:14.789918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:14.810464 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 334/664] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:14.811222 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6394f-ee56-494d-bacc-3647339b442e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:14.817817 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358b9ab-3228-4d15-a419-a758b5a90701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:14.818444 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358b9ab-3228-4d15-a419-a758b5a90701 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:14.818758 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358b9ab-3228-4d15-a419-a758b5a90701 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:14.819033 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358b9ab-3228-4d15-a419-a758b5a90701 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:14.894172 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7358b9ab-3228-4d15-a419-a758b5a90701 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:14.896200 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7358b9ab-3228-4d15-a419-a758b5a90701 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:14.900588 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:14.916611 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6394f-ee56-494d-bacc-3647339b442e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:14.948617 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b5fb4-64cf-45aa-86a0-962701d1d71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:14.949243 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b5fb4-64cf-45aa-86a0-962701d1d71f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:14.949526 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b5fb4-64cf-45aa-86a0-962701d1d71f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:14.949798 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b5fb4-64cf-45aa-86a0-962701d1d71f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:14.960210 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9b5fb4-64cf-45aa-86a0-962701d1d71f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:12:14.965474 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-3c9b5fb4-64cf-45aa-86a0-962701d1d71f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:12:14.965474 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:14.965474 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:14.965474 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:14.965474 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:14.965474 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:14.965474 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:14.965474 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:14.965474 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:14.965474 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:14.965474 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:14.965474 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:14.965474 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:12:14.965474 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:12:14.965474 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:12:14.965474 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:12:14.966405 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:12:14.966405 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:12:14.966405 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:12:14.966405 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:12:14.966405 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:14.966405 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:14.966405 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:14.966405 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:14.966405 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:14.966405 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:14.966405 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:14.966405 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:14.966405 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:14.966405 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:14.966405 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:14.966405 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:14.967233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:14.967233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:14.967233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:14.967233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:14.967233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:12:14.967233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:12:14.967233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:12:14.967233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:12:14.967233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:12:14.967233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:12:14.967233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:12:14.967233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:14.967233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 335/665] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jul 27 15:12:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:14.967922 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b5fb4-64cf-45aa-86a0-962701d1d71f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:15.006311 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 331/666] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:12:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 15:12:15.007405 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358b9ab-3228-4d15-a419-a758b5a90701 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:15.016861 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:15.087179 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9b5fb4-64cf-45aa-86a0-962701d1d71f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:15.112712 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358b9ab-3228-4d15-a419-a758b5a90701 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:15.127430 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df69686-c087-46b5-bfff-720b847c637e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:15.128094 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df69686-c087-46b5-bfff-720b847c637e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:15.128375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df69686-c087-46b5-bfff-720b847c637e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:15.128647 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df69686-c087-46b5-bfff-720b847c637e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:15.139775 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df69686-c087-46b5-bfff-720b847c637e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:15.141461 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df69686-c087-46b5-bfff-720b847c637e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:15.148805 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69aec0-2fb9-4f36-a8c1-e15c80c08e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:15.149440 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69aec0-2fb9-4f36-a8c1-e15c80c08e1d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:15.149565 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:15.149722 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69aec0-2fb9-4f36-a8c1-e15c80c08e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:15.149986 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69aec0-2fb9-4f36-a8c1-e15c80c08e1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:15.157185 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69aec0-2fb9-4f36-a8c1-e15c80c08e1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:15.158726 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69aec0-2fb9-4f36-a8c1-e15c80c08e1d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:15.159341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-7df69686-c087-46b5-bfff-720b847c637e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:15.159341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:15.159341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:15.159341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:15.159341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:15.159341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:15.159341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:15.159341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:15.159341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:15.159341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:15.159341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:15.159341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:15.159341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:15.159341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:15.159341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:15.160422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:15.160422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:15.160422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:15.160422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:15.160422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:15.160422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:15.160422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:15.160422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:15.160422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:15.160422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:15.160422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:15.160422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:15.160422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:15.160422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:15.160422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:15.160422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:15.160422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:15.161330 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:15.161330 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:15.161330 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:15.161330 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:15.161330 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 336/667] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:15.162160 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df69686-c087-46b5-bfff-720b847c637e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:15.175343 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-3a69aec0-2fb9-4f36-a8c1-e15c80c08e1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:15.175343 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:15.175343 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:15.175343 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:15.175343 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:15.175343 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:15.175343 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:15.175343 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:15.175343 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:15.175343 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:15.175343 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:15.175343 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:15.175343 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:12:15.175343 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:12:15.175343 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:12:15.176317 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:12:15.176317 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:15.176317 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:15.176317 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:15.176317 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:15.176317 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:15.176317 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:15.176317 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:15.176317 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:15.176317 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:15.176317 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:15.176317 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:15.176317 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:15.176317 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:15.176317 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:15.176317 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:15.176317 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:15.177226 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:12:15.177226 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:12:15.177226 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:12:15.177226 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:12:15.177226 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:12:15.177226 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:12:15.177226 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:15.177226 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:15.177226 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 332/668] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:12:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:15.177226 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69aec0-2fb9-4f36-a8c1-e15c80c08e1d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:15.248208 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:15.269220 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df69686-c087-46b5-bfff-720b847c637e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:15.287511 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69aec0-2fb9-4f36-a8c1-e15c80c08e1d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:15.305762 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054412eb-7d13-4f15-afe2-2dfa06e61c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:15.306375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054412eb-7d13-4f15-afe2-2dfa06e61c3b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:15.306655 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054412eb-7d13-4f15-afe2-2dfa06e61c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:15.306931 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054412eb-7d13-4f15-afe2-2dfa06e61c3b None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:15.307645 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054412eb-7d13-4f15-afe2-2dfa06e61c3b None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:15.307949 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054412eb-7d13-4f15-afe2-2dfa06e61c3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:15.309322 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054412eb-7d13-4f15-afe2-2dfa06e61c3b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:15.317286 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 337/669] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jul 27 15:12:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:15.317286 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054412eb-7d13-4f15-afe2-2dfa06e61c3b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:15.326874 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bc2f2-bc06-44ec-ad7e-f1f4f1972c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:15.327521 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bc2f2-bc06-44ec-ad7e-f1f4f1972c43 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:15.327801 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bc2f2-bc06-44ec-ad7e-f1f4f1972c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:15.328107 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723bc2f2-bc06-44ec-ad7e-f1f4f1972c43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:15.340937 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723bc2f2-bc06-44ec-ad7e-f1f4f1972c43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:15.342324 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723bc2f2-bc06-44ec-ad7e-f1f4f1972c43 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:15.356785 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-723bc2f2-bc06-44ec-ad7e-f1f4f1972c43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:15.356785 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:15.356785 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:15.356785 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:15.356785 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:15.356785 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:15.356785 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:15.356785 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:15.356785 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:15.356785 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:15.356785 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:15.356785 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:15.356785 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:15.356785 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:15.356785 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:15.357688 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:15.357688 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:15.357688 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:15.357688 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:15.357688 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:15.357688 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:15.357688 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:15.357688 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:15.357688 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:15.357688 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:15.357688 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:15.357688 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:15.357688 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:15.357688 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:15.357688 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:15.357688 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:15.357688 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:15.358570 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:15.358570 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:15.358570 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:15.358570 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:15.358570 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 333/670] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:15.358847 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bc2f2-bc06-44ec-ad7e-f1f4f1972c43 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:15.386628 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:15.433917 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054412eb-7d13-4f15-afe2-2dfa06e61c3b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:15.472383 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10fd6c-7fc7-4478-a1d2-607c2f426fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:15.473302 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10fd6c-7fc7-4478-a1d2-607c2f426fe2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:15.473755 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10fd6c-7fc7-4478-a1d2-607c2f426fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:15.474198 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10fd6c-7fc7-4478-a1d2-607c2f426fe2 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:15.475125 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10fd6c-7fc7-4478-a1d2-607c2f426fe2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:15.475620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10fd6c-7fc7-4478-a1d2-607c2f426fe2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:15.477282 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10fd6c-7fc7-4478-a1d2-607c2f426fe2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:15.491470 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 338/671] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:15.492728 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10fd6c-7fc7-4478-a1d2-607c2f426fe2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:15.588259 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723bc2f2-bc06-44ec-ad7e-f1f4f1972c43 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:15.597320 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10fd6c-7fc7-4478-a1d2-607c2f426fe2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:15.605463 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:15.617642 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:15.623009 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b636e730-a529-4d01-bfbd-43695ed8c13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:15.623615 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636e730-a529-4d01-bfbd-43695ed8c13e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:15.623896 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636e730-a529-4d01-bfbd-43695ed8c13e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:15.624201 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b636e730-a529-4d01-bfbd-43695ed8c13e None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:15.624941 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b636e730-a529-4d01-bfbd-43695ed8c13e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:15.625248 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b636e730-a529-4d01-bfbd-43695ed8c13e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:15.626654 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b636e730-a529-4d01-bfbd-43695ed8c13e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:15.632593 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8d6d7-0e2e-4e13-928f-840647127ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:15.633221 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8d6d7-0e2e-4e13-928f-840647127ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:15.633504 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8d6d7-0e2e-4e13-928f-840647127ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:15.633778 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f8d6d7-0e2e-4e13-928f-840647127ab1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:15.638694 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 334/672] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jul 27 15:12:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:15.639477 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b636e730-a529-4d01-bfbd-43695ed8c13e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:15.647256 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8d6d7-0e2e-4e13-928f-840647127ab1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:15.648724 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f8d6d7-0e2e-4e13-928f-840647127ab1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:15.664103 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-77f8d6d7-0e2e-4e13-928f-840647127ab1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:15.664103 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:15.664103 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:15.664103 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:15.664103 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:15.664103 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:15.664103 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:15.664103 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:15.664103 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:15.664103 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:15.664103 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:15.664103 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:15.664103 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:15.664103 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:15.664103 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:15.665094 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:15.665094 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:15.665094 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:15.665094 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:15.665094 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:15.665094 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:15.665094 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:15.665094 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:15.665094 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:15.665094 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:15.665094 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:15.665094 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:15.665094 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:15.665094 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:15.665094 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:15.665094 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:15.665094 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:15.665980 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:15.665980 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:15.665980 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:15.665980 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:15.665980 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 339/673] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:15.665980 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8d6d7-0e2e-4e13-928f-840647127ab1 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:15.737632 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b636e730-a529-4d01-bfbd-43695ed8c13e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:15.764840 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f8d6d7-0e2e-4e13-928f-840647127ab1 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:15.769543 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8671364-d5ce-475b-b8a8-0f53a11d625e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:15.770144 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8671364-d5ce-475b-b8a8-0f53a11d625e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:15.770420 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8671364-d5ce-475b-b8a8-0f53a11d625e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:15.770779 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8671364-d5ce-475b-b8a8-0f53a11d625e None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:15.771482 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8671364-d5ce-475b-b8a8-0f53a11d625e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:15.772340 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8671364-d5ce-475b-b8a8-0f53a11d625e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:15.773680 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8671364-d5ce-475b-b8a8-0f53a11d625e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:15.784747 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 335/674] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:15.785932 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11784422-a812-4ffc-9d78-ec5fea74afc5 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:15.786203 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11784422-a812-4ffc-9d78-ec5fea74afc5 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:15.786481 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11784422-a812-4ffc-9d78-ec5fea74afc5 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:15.792027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 336/675] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:15.792027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11784422-a812-4ffc-9d78-ec5fea74afc5 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:15.801907 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c787c-103b-4a6b-8e60-b866b7e45181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:15.802540 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c787c-103b-4a6b-8e60-b866b7e45181 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:15.802822 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c787c-103b-4a6b-8e60-b866b7e45181 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:15.803099 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c787c-103b-4a6b-8e60-b866b7e45181 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:15.809842 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c787c-103b-4a6b-8e60-b866b7e45181 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:15.811274 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5c787c-103b-4a6b-8e60-b866b7e45181 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:15.822357 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-5a5c787c-103b-4a6b-8e60-b866b7e45181 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:15.822357 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:15.822357 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:15.822357 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:15.822357 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:15.822357 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:15.822357 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:15.822357 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:15.822357 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:15.822357 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:15.822357 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:15.822357 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:15.822357 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:12:15.822357 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:12:15.822357 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:12:15.823401 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:12:15.823401 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:15.823401 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:15.823401 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:15.823401 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:15.823401 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:15.823401 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:15.823401 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:15.823401 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:15.823401 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:15.823401 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:15.823401 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:15.823401 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:15.823401 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:15.823401 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:15.823401 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:15.823401 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:15.824352 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:12:15.824352 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:12:15.824352 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:12:15.824352 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:12:15.824352 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:12:15.824352 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:12:15.824352 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:15.824352 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:15.824352 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 340/676] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:12:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:15.824826 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c787c-103b-4a6b-8e60-b866b7e45181 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:15.831848 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:15.857667 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:15.893501 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11784422-a812-4ffc-9d78-ec5fea74afc5 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:15.926962 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c787c-103b-4a6b-8e60-b866b7e45181 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:15.927941 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82359c40-b806-471b-a842-7d8acf954b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:15.929116 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82359c40-b806-471b-a842-7d8acf954b7d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:15.929400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82359c40-b806-471b-a842-7d8acf954b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:15.929676 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82359c40-b806-471b-a842-7d8acf954b7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:15.930461 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82359c40-b806-471b-a842-7d8acf954b7d None admin] RBAC: Adding query filter params (role.id=6a54ab92d32843d6bc4c2dcedae4bd13, scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5, user.id=2f71721ca75a461d92044091564de424) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:15.930774 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82359c40-b806-471b-a842-7d8acf954b7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:15.932208 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82359c40-b806-471b-a842-7d8acf954b7d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:15.937941 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 337/677] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:12:15 2022] GET /identity/v3/role_assignments?user.id=2f71721ca75a461d92044091564de424&scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5&role.id=6a54ab92d32843d6bc4c2dcedae4bd13 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:15.938716 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82359c40-b806-471b-a842-7d8acf954b7d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:15.962895 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1425e-8d55-4d0f-845d-6c36fc2f5c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:15.963515 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1425e-8d55-4d0f-845d-6c36fc2f5c03 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:15.963796 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1425e-8d55-4d0f-845d-6c36fc2f5c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:15.964096 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1425e-8d55-4d0f-845d-6c36fc2f5c03 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:15.964804 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1425e-8d55-4d0f-845d-6c36fc2f5c03 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:15.965101 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1425e-8d55-4d0f-845d-6c36fc2f5c03 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:15.966498 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e1425e-8d55-4d0f-845d-6c36fc2f5c03 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:15.985699 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 341/678] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:15.985699 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6212e-2c7b-4f83-9505-704d5f728af6 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:15.985699 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6212e-2c7b-4f83-9505-704d5f728af6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:15.985699 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc6212e-2c7b-4f83-9505-704d5f728af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:16.007259 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-dfc6212e-2c7b-4f83-9505-704d5f728af6 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:16.009394 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-dfc6212e-2c7b-4f83-9505-704d5f728af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:16.060276 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82359c40-b806-471b-a842-7d8acf954b7d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:16.062082 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:16.090253 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 342/679] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:12:16.090914 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6212e-2c7b-4f83-9505-704d5f728af6 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:16.098309 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03f368-2be7-45b5-9ecc-6591b128c3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:16.098949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03f368-2be7-45b5-9ecc-6591b128c3f0 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:16.099227 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03f368-2be7-45b5-9ecc-6591b128c3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:16.099496 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03f368-2be7-45b5-9ecc-6591b128c3f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:16.107958 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03f368-2be7-45b5-9ecc-6591b128c3f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:16.109364 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03f368-2be7-45b5-9ecc-6591b128c3f0 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:16.120410 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:16.122290 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-ce03f368-2be7-45b5-9ecc-6591b128c3f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:16.122290 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:16.122290 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:16.122290 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:16.122290 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:16.122290 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:16.122290 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:16.122290 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:16.122290 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:16.122290 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:16.122290 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:16.122290 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:16.122290 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:12:16.122290 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:12:16.122290 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:12:16.123189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:12:16.123189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:16.123189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:16.123189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:16.123189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:16.123189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:16.123189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:16.123189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:16.123189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:16.123189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:16.123189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:16.123189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:16.123189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:16.123189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:16.123189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:16.123189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:16.123189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:16.124117 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:12:16.124117 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:12:16.124117 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:12:16.124117 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:12:16.124117 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:12:16.124117 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:12:16.124117 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:16.124117 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:16.124117 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 338/680] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:12:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:16.124628 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03f368-2be7-45b5-9ecc-6591b128c3f0 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:16.211658 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc6212e-2c7b-4f83-9505-704d5f728af6 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:16.237823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03f368-2be7-45b5-9ecc-6591b128c3f0 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:16.250204 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09694ea-7cda-4b84-bab8-2b484fbc9467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:16.250812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09694ea-7cda-4b84-bab8-2b484fbc9467 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:16.251098 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09694ea-7cda-4b84-bab8-2b484fbc9467 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:16.251371 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09694ea-7cda-4b84-bab8-2b484fbc9467 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:16.252160 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09694ea-7cda-4b84-bab8-2b484fbc9467 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:16.252517 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09694ea-7cda-4b84-bab8-2b484fbc9467 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:16.253950 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09694ea-7cda-4b84-bab8-2b484fbc9467 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:16.271623 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 343/681] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jul 27 15:12:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:16.271623 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09694ea-7cda-4b84-bab8-2b484fbc9467 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:16.278420 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23651d-9b49-4af6-be6f-0836d1738753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:16.279063 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23651d-9b49-4af6-be6f-0836d1738753 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:16.279617 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23651d-9b49-4af6-be6f-0836d1738753 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:16.279726 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23651d-9b49-4af6-be6f-0836d1738753 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:16.288179 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23651d-9b49-4af6-be6f-0836d1738753 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:16.290287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23651d-9b49-4af6-be6f-0836d1738753 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:16.302709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-9f23651d-9b49-4af6-be6f-0836d1738753 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 15:12:16.302709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:16.302709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:16.302709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:16.302709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:16.302709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:16.302709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:16.302709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:16.302709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:16.302709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:16.302709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:16.302709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:16.302709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:12:16.302709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:12:16.302709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:12:16.302709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:12:16.304430 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:16.304430 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:16.304430 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:12:16.304430 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:16.304430 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:12:16.304430 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:16.304430 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:16.304430 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:16.304430 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:16.304430 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:16.304430 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:16.304430 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:16.304430 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:16.304430 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:16.304430 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:16.304430 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:16.304430 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:16.304430 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:16.305480 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:16.305480 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:16.305480 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:12:16.305480 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:12:16.305480 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:12:16.305480 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:12:16.305480 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:12:16.305480 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:12:16.305480 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 15:12:16.305480 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:16.305480 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 339/682] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jul 27 15:12:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:16.305480 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23651d-9b49-4af6-be6f-0836d1738753 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:16.331243 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:16.360398 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:16.380863 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09694ea-7cda-4b84-bab8-2b484fbc9467 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:16.412553 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23651d-9b49-4af6-be6f-0836d1738753 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:16.415169 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556481d5-4019-4e13-8a30-201946543fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:16.415799 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556481d5-4019-4e13-8a30-201946543fbc None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:16.416109 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556481d5-4019-4e13-8a30-201946543fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:16.416386 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556481d5-4019-4e13-8a30-201946543fbc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:16.430536 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556481d5-4019-4e13-8a30-201946543fbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:12:16.436044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-556481d5-4019-4e13-8a30-201946543fbc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:12:16.436044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:16.436044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:16.436044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:16.436044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:16.436044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:16.436044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:16.436044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:16.436044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:16.436044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:16.436044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:16.436044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:16.436044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:12:16.436044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:12:16.436044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:12:16.436044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:12:16.436976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:12:16.436976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:12:16.436976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:12:16.436976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:12:16.436976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:16.436976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:16.436976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:16.436976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:16.436976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:16.436976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:16.436976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:16.436976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:16.436976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:16.436976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:16.436976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:16.436976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:16.437832 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:16.437832 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:16.437832 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:16.437832 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:16.437832 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:12:16.437832 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:12:16.437832 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:12:16.437832 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:12:16.437832 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:12:16.437832 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:12:16.437832 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:12:16.437832 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:16.437832 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 344/683] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jul 27 15:12:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:16.438970 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556481d5-4019-4e13-8a30-201946543fbc None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:16.454728 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575952d-8f4c-4a11-b399-933b6f04b8c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:16.455590 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575952d-8f4c-4a11-b399-933b6f04b8c6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:16.456037 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575952d-8f4c-4a11-b399-933b6f04b8c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:16.456475 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3575952d-8f4c-4a11-b399-933b6f04b8c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:16.457577 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575952d-8f4c-4a11-b399-933b6f04b8c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:16.457890 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575952d-8f4c-4a11-b399-933b6f04b8c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:16.459337 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3575952d-8f4c-4a11-b399-933b6f04b8c6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:16.472483 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 340/684] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jul 27 15:12:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:16.476031 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575952d-8f4c-4a11-b399-933b6f04b8c6 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:16.543205 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556481d5-4019-4e13-8a30-201946543fbc None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:16.561063 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:16.581820 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3575952d-8f4c-4a11-b399-933b6f04b8c6 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:16.583492 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758aba73-d3f5-4478-944c-5bd649be2203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:16.584939 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758aba73-d3f5-4478-944c-5bd649be2203 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:16.585235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758aba73-d3f5-4478-944c-5bd649be2203 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:16.585514 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758aba73-d3f5-4478-944c-5bd649be2203 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:16.586319 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758aba73-d3f5-4478-944c-5bd649be2203 None admin] RBAC: Adding query filter params (role.id=6a54ab92d32843d6bc4c2dcedae4bd13, scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5, user.id=20aa56e1154649cb8b440dae788c922c) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:16.586632 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758aba73-d3f5-4478-944c-5bd649be2203 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:16.588078 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758aba73-d3f5-4478-944c-5bd649be2203 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:16.595920 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 345/685] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:12:16 2022] GET /identity/v3/role_assignments?user.id=20aa56e1154649cb8b440dae788c922c&scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5&role.id=6a54ab92d32843d6bc4c2dcedae4bd13 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:16.596975 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758aba73-d3f5-4478-944c-5bd649be2203 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:16.611543 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:16.631794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c0e0c-dbad-4d94-b0f3-cc1f41036875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:16.632508 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c0e0c-dbad-4d94-b0f3-cc1f41036875 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:16.632921 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c0e0c-dbad-4d94-b0f3-cc1f41036875 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:16.633222 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c0e0c-dbad-4d94-b0f3-cc1f41036875 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:16.634227 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c0e0c-dbad-4d94-b0f3-cc1f41036875 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:16.634539 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c0e0c-dbad-4d94-b0f3-cc1f41036875 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:16.636023 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c0e0c-dbad-4d94-b0f3-cc1f41036875 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:16.660590 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 341/686] 10.222.0.40 () {56 vars in 1135 bytes} [Wed Jul 27 15:12:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:16.660590 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c0e0c-dbad-4d94-b0f3-cc1f41036875 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:16.739890 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758aba73-d3f5-4478-944c-5bd649be2203 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:16.780355 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d64674-02b9-416f-8982-ab2577aa1d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:16.781077 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d64674-02b9-416f-8982-ab2577aa1d00 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:16.781494 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d64674-02b9-416f-8982-ab2577aa1d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:16.781980 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d64674-02b9-416f-8982-ab2577aa1d00 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:16.782765 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d64674-02b9-416f-8982-ab2577aa1d00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:16.783087 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d64674-02b9-416f-8982-ab2577aa1d00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:16.785189 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d64674-02b9-416f-8982-ab2577aa1d00 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:16.795845 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 346/687] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:12:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:16.796835 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d64674-02b9-416f-8982-ab2577aa1d00 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:16.798941 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c0e0c-dbad-4d94-b0f3-cc1f41036875 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:16.842124 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef286879-a5cf-4e5e-91a6-cefe8cfd5877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:16.842514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef286879-a5cf-4e5e-91a6-cefe8cfd5877 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:16.842793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef286879-a5cf-4e5e-91a6-cefe8cfd5877 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:16.843061 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef286879-a5cf-4e5e-91a6-cefe8cfd5877 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:16.844305 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef286879-a5cf-4e5e-91a6-cefe8cfd5877 None admin] RBAC: Adding query filter params (role.id=6a54ab92d32843d6bc4c2dcedae4bd13, scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5, user.id=227dac1eaefc4d0a8d3cc8a6dee2ecba) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:16.844305 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef286879-a5cf-4e5e-91a6-cefe8cfd5877 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:16.845579 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef286879-a5cf-4e5e-91a6-cefe8cfd5877 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:16.852721 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 342/688] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:12:16 2022] GET /identity/v3/role_assignments?user.id=227dac1eaefc4d0a8d3cc8a6dee2ecba&scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5&role.id=6a54ab92d32843d6bc4c2dcedae4bd13 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:16.854384 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef286879-a5cf-4e5e-91a6-cefe8cfd5877 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:16.871279 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:16.889182 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:16.959828 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d64674-02b9-416f-8982-ab2577aa1d00 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:17.043121 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e83960-0589-42e8-88f7-51de1c1bf915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:17.043680 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e83960-0589-42e8-88f7-51de1c1bf915 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:17.043969 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e83960-0589-42e8-88f7-51de1c1bf915 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:17.044268 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e83960-0589-42e8-88f7-51de1c1bf915 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:17.052501 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef286879-a5cf-4e5e-91a6-cefe8cfd5877 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:17.092428 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aacde7-6177-4d54-bec3-7b3758166deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:17.094325 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aacde7-6177-4d54-bec3-7b3758166deb None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:17.094325 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aacde7-6177-4d54-bec3-7b3758166deb None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:17.094325 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aacde7-6177-4d54-bec3-7b3758166deb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:17.109980 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aacde7-6177-4d54-bec3-7b3758166deb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:17.111565 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5aacde7-6177-4d54-bec3-7b3758166deb None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:17.127502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-a5aacde7-6177-4d54-bec3-7b3758166deb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:17.127502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:17.127502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:17.127502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:17.127502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:17.127502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:17.127502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:17.127502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:17.127502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:17.127502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:17.127502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:17.127502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:17.127502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:17.127502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:17.127502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:17.128542 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:17.128542 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:17.128542 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:17.128542 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:17.128542 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:17.128542 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:17.128542 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:17.128542 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:17.128542 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:17.128542 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:17.128542 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:17.128542 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:17.128542 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:17.128542 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:17.128542 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:17.128542 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:17.128542 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:17.129427 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:17.129427 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:17.129427 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:17.129427 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:17.134171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 343/689] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:17.135583 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aacde7-6177-4d54-bec3-7b3758166deb None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:17.137603 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e83960-0589-42e8-88f7-51de1c1bf915 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:17.139463 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e83960-0589-42e8-88f7-51de1c1bf915 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:17.195825 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:17.217330 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:17.243138 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aacde7-6177-4d54-bec3-7b3758166deb None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:17.256423 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 347/690] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:12:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 15:12:17.262989 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e83960-0589-42e8-88f7-51de1c1bf915 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:17.295868 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f932e5e-8fe2-4acd-b8d4-b05474a5ef39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:17.296552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f932e5e-8fe2-4acd-b8d4-b05474a5ef39 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:17.296787 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f932e5e-8fe2-4acd-b8d4-b05474a5ef39 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:17.297052 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f932e5e-8fe2-4acd-b8d4-b05474a5ef39 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:17.297747 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f932e5e-8fe2-4acd-b8d4-b05474a5ef39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:17.298046 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f932e5e-8fe2-4acd-b8d4-b05474a5ef39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:17.299400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f932e5e-8fe2-4acd-b8d4-b05474a5ef39 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:17.314945 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 344/691] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:17.320790 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f932e5e-8fe2-4acd-b8d4-b05474a5ef39 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:17.379485 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e83960-0589-42e8-88f7-51de1c1bf915 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:17.416787 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a59883-d975-44d8-93e6-1010d8063f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:17.417830 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a59883-d975-44d8-93e6-1010d8063f58 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:17.418314 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a59883-d975-44d8-93e6-1010d8063f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:17.418788 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a59883-d975-44d8-93e6-1010d8063f58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:17.429649 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a59883-d975-44d8-93e6-1010d8063f58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:17.431426 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a59883-d975-44d8-93e6-1010d8063f58 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:17.448014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-d5a59883-d975-44d8-93e6-1010d8063f58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:17.448014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:17.448014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:17.448014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:17.448014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:17.448014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:17.448014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:17.448014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:17.448014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:17.448014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:17.448014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:17.448014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:17.448014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:17.448014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:17.448014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:17.448974 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:17.448974 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:17.448974 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:17.448974 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:17.448974 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:17.448974 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:17.448974 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:17.448974 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:17.448974 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:17.448974 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:17.448974 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:17.448974 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:17.448974 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:17.448974 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:17.448974 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:17.448974 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:17.448974 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:17.449938 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:17.449938 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:17.449938 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:17.449938 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:17.456240 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 348/692] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:17.458018 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a59883-d975-44d8-93e6-1010d8063f58 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:17.482937 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:17.515636 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f932e5e-8fe2-4acd-b8d4-b05474a5ef39 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:17.546152 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:17.567429 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a59883-d975-44d8-93e6-1010d8063f58 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:17.604054 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f7605-70ce-4ebb-aeb3-d7987fd19d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:17.605041 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f7605-70ce-4ebb-aeb3-d7987fd19d7c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:17.605551 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f7605-70ce-4ebb-aeb3-d7987fd19d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:17.606022 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582f7605-70ce-4ebb-aeb3-d7987fd19d7c None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:17.606991 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f7605-70ce-4ebb-aeb3-d7987fd19d7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:17.607494 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f7605-70ce-4ebb-aeb3-d7987fd19d7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:17.609078 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582f7605-70ce-4ebb-aeb3-d7987fd19d7c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:17.620705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80535207-a329-45fb-81f7-d6a3e0b33955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:17.621363 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80535207-a329-45fb-81f7-d6a3e0b33955 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:17.621660 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80535207-a329-45fb-81f7-d6a3e0b33955 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:17.621937 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80535207-a329-45fb-81f7-d6a3e0b33955 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:17.627307 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 349/693] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:17.628890 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f7605-70ce-4ebb-aeb3-d7987fd19d7c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:17.652915 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80535207-a329-45fb-81f7-d6a3e0b33955 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:17.654291 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80535207-a329-45fb-81f7-d6a3e0b33955 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:17.689230 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-80535207-a329-45fb-81f7-d6a3e0b33955 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 15:12:17.689230 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:17.689230 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:17.689230 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:17.689230 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:17.689230 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:17.689230 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:17.689230 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:17.689230 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:17.689230 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:17.689230 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:17.689230 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:17.689230 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:12:17.689230 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:12:17.689230 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:12:17.689230 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:12:17.690239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:17.690239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:17.690239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:12:17.690239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:17.690239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:12:17.690239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:17.690239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:17.690239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:17.690239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:17.690239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:17.690239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:17.690239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:17.690239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:17.690239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:17.690239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:17.690239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:17.690239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:17.690239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:17.691876 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:17.691876 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:17.691876 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:12:17.691876 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:12:17.691876 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:12:17.691876 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:12:17.691876 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:12:17.691876 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:12:17.691876 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 15:12:17.691876 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:17.691876 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 345/694] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Jul 27 15:12:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:17.696718 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80535207-a329-45fb-81f7-d6a3e0b33955 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:17.719049 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:17.740225 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582f7605-70ce-4ebb-aeb3-d7987fd19d7c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:17.776978 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99c7d1-525a-4893-8fcf-f538eceeb175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:17.778008 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99c7d1-525a-4893-8fcf-f538eceeb175 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:17.778488 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99c7d1-525a-4893-8fcf-f538eceeb175 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:17.778960 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99c7d1-525a-4893-8fcf-f538eceeb175 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:17.786308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99c7d1-525a-4893-8fcf-f538eceeb175 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:17.788125 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99c7d1-525a-4893-8fcf-f538eceeb175 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:17.800562 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-ef99c7d1-525a-4893-8fcf-f538eceeb175 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:17.800562 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:17.800562 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:17.800562 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:17.800562 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:17.800562 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:17.800562 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:17.800562 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:17.800562 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:17.800562 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:17.800562 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:17.800562 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:17.800562 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:12:17.800562 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:12:17.800562 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:12:17.801487 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:12:17.801487 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:17.801487 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:17.801487 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:17.801487 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:17.801487 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:17.801487 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:17.801487 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:17.801487 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:17.801487 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:17.801487 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:17.801487 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:17.801487 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:17.801487 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:17.801487 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:17.801487 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:17.801487 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:17.802363 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:12:17.802363 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:12:17.802363 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:12:17.802363 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:12:17.802363 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:12:17.802363 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:12:17.802363 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:17.802363 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:17.809788 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 350/695] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:12:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:12:17.811244 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99c7d1-525a-4893-8fcf-f538eceeb175 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:17.917831 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99c7d1-525a-4893-8fcf-f538eceeb175 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:17.956364 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371ccad-c771-4de2-a74d-3af3496a6c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:17.957402 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371ccad-c771-4de2-a74d-3af3496a6c22 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:17.957884 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371ccad-c771-4de2-a74d-3af3496a6c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:17.958359 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371ccad-c771-4de2-a74d-3af3496a6c22 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:17.959358 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371ccad-c771-4de2-a74d-3af3496a6c22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:17.959878 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371ccad-c771-4de2-a74d-3af3496a6c22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:17.961525 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5371ccad-c771-4de2-a74d-3af3496a6c22 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:17.971455 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:17.980375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 351/696] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jul 27 15:12:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:17.982685 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371ccad-c771-4de2-a74d-3af3496a6c22 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:18.002238 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80535207-a329-45fb-81f7-d6a3e0b33955 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:18.073667 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69d863-5c79-4501-a055-d93d6fdf2968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:18.074300 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69d863-5c79-4501-a055-d93d6fdf2968 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:18.074593 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69d863-5c79-4501-a055-d93d6fdf2968 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:18.074858 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae69d863-5c79-4501-a055-d93d6fdf2968 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:18.075671 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae69d863-5c79-4501-a055-d93d6fdf2968 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:18.075979 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae69d863-5c79-4501-a055-d93d6fdf2968 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:18.077420 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae69d863-5c79-4501-a055-d93d6fdf2968 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:18.090531 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371ccad-c771-4de2-a74d-3af3496a6c22 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:18.103897 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 346/697] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Jul 27 15:12:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:18.108902 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69d863-5c79-4501-a055-d93d6fdf2968 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:18.145239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:18.147305 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17b5c96-387d-4fc9-8ac2-c9b5aa6083f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:18.148116 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b5c96-387d-4fc9-8ac2-c9b5aa6083f2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:18.148540 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b5c96-387d-4fc9-8ac2-c9b5aa6083f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:18.148958 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17b5c96-387d-4fc9-8ac2-c9b5aa6083f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:18.150062 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b5c96-387d-4fc9-8ac2-c9b5aa6083f2 None admin] RBAC: Adding query filter params (role.id=6a54ab92d32843d6bc4c2dcedae4bd13, scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5, user.id=68bbf8bb59a84829afacd9677c9639a6) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:18.150526 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b5c96-387d-4fc9-8ac2-c9b5aa6083f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:18.152121 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17b5c96-387d-4fc9-8ac2-c9b5aa6083f2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:18.164141 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 352/698] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:12:17 2022] GET /identity/v3/role_assignments?user.id=68bbf8bb59a84829afacd9677c9639a6&scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5&role.id=6a54ab92d32843d6bc4c2dcedae4bd13 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:18.165629 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5808ea-361f-4a98-a342-3be8ddf73459 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:18.166062 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5808ea-361f-4a98-a342-3be8ddf73459 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:18.166479 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5808ea-361f-4a98-a342-3be8ddf73459 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:18.170268 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 353/699] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:18.175385 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5915920-7117-4cbb-a7d2-af68aaed824f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:18.175870 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5915920-7117-4cbb-a7d2-af68aaed824f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:18.176332 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5915920-7117-4cbb-a7d2-af68aaed824f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:18.209931 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-c5915920-7117-4cbb-a7d2-af68aaed824f None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:18.211495 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c5915920-7117-4cbb-a7d2-af68aaed824f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:18.218333 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae69d863-5c79-4501-a055-d93d6fdf2968 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:18.263221 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c80f5-acd9-4a44-8dfb-b09212c93665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:18.263858 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c80f5-acd9-4a44-8dfb-b09212c93665 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:18.264167 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c80f5-acd9-4a44-8dfb-b09212c93665 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:18.264443 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7c80f5-acd9-4a44-8dfb-b09212c93665 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:18.349060 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:18.364164 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 354/700] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 15:12:18.389761 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5915920-7117-4cbb-a7d2-af68aaed824f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:18.402909 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c80f5-acd9-4a44-8dfb-b09212c93665 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:18.404404 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7c80f5-acd9-4a44-8dfb-b09212c93665 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:18.449541 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:18.541844 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 347/701] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:12:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 15:12:18.546994 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c80f5-acd9-4a44-8dfb-b09212c93665 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:18.571384 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5915920-7117-4cbb-a7d2-af68aaed824f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:18.618698 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97750e23-ba29-4180-9900-a2e3319ab2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:18.619603 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97750e23-ba29-4180-9900-a2e3319ab2f2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:18.619883 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97750e23-ba29-4180-9900-a2e3319ab2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:18.620422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97750e23-ba29-4180-9900-a2e3319ab2f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:18.634622 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97750e23-ba29-4180-9900-a2e3319ab2f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:18.637185 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97750e23-ba29-4180-9900-a2e3319ab2f2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:18.654178 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-97750e23-ba29-4180-9900-a2e3319ab2f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:18.654178 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:18.654178 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:18.654178 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:18.654178 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:18.654178 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:18.654178 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:18.654178 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:18.654178 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:18.654178 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:18.654178 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:18.654178 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:18.654178 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:18.654178 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:18.654178 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:18.655181 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:18.655181 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:18.655181 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:18.655181 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:18.655181 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:18.655181 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:18.655181 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:18.655181 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:18.655181 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:18.655181 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:18.655181 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:18.655181 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:18.655181 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:18.655181 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:18.655181 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:18.655181 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:18.655181 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:18.656515 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:18.656515 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:18.656515 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:18.656515 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:18.656515 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 355/702] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:18.661415 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97750e23-ba29-4180-9900-a2e3319ab2f2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:18.667972 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7c80f5-acd9-4a44-8dfb-b09212c93665 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:18.705541 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628f6e7-69e1-4334-ab42-a10d88c5b9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:18.706093 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628f6e7-69e1-4334-ab42-a10d88c5b9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:18.706370 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628f6e7-69e1-4334-ab42-a10d88c5b9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:18.706639 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e628f6e7-69e1-4334-ab42-a10d88c5b9f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:18.708504 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:18.717618 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628f6e7-69e1-4334-ab42-a10d88c5b9f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:18.719067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e628f6e7-69e1-4334-ab42-a10d88c5b9f2 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:18.734177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-e628f6e7-69e1-4334-ab42-a10d88c5b9f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:18.734177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:18.734177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:18.734177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:18.734177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:18.734177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:18.734177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:18.734177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:18.734177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:18.734177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:18.734177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:18.734177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:18.734177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:18.734177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:18.734177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:18.735194 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:18.735194 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:18.735194 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:18.735194 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:18.735194 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:18.735194 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:18.735194 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:18.735194 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:18.735194 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:18.735194 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:18.735194 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:18.735194 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:18.735194 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:18.735194 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:18.735194 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:18.735194 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:18.735194 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:18.736985 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:18.736985 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:18.736985 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:18.736985 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:18.736985 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 348/703] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:12:18.741455 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628f6e7-69e1-4334-ab42-a10d88c5b9f2 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:18.780355 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:18.842191 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e628f6e7-69e1-4334-ab42-a10d88c5b9f2 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:18.890173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5552d1-2d6b-4034-886d-5791b0cab426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:18.890785 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5552d1-2d6b-4034-886d-5791b0cab426 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:18.891059 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5552d1-2d6b-4034-886d-5791b0cab426 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:18.891330 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5552d1-2d6b-4034-886d-5791b0cab426 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:18.892027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5552d1-2d6b-4034-886d-5791b0cab426 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:18.892333 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5552d1-2d6b-4034-886d-5791b0cab426 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:18.893688 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5552d1-2d6b-4034-886d-5791b0cab426 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:18.913155 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 349/704] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:18.919756 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5552d1-2d6b-4034-886d-5791b0cab426 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:18.951409 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97750e23-ba29-4180-9900-a2e3319ab2f2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:18.999311 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f59ff-4078-4fd7-8f07-9298467ea51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:18.999896 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f59ff-4078-4fd7-8f07-9298467ea51d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:19.000206 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f59ff-4078-4fd7-8f07-9298467ea51d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:19.000476 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f59ff-4078-4fd7-8f07-9298467ea51d None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:19.001647 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f59ff-4078-4fd7-8f07-9298467ea51d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:19.001951 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f59ff-4078-4fd7-8f07-9298467ea51d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:19.003316 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f59ff-4078-4fd7-8f07-9298467ea51d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:19.009204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:19.020110 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 356/705] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:19.021443 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775a4fc-c9e9-4715-bf0e-bf0cfde59924 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:19.021767 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775a4fc-c9e9-4715-bf0e-bf0cfde59924 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:19.022046 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1775a4fc-c9e9-4715-bf0e-bf0cfde59924 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:19.027339 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 357/706] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:19.028158 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775a4fc-c9e9-4715-bf0e-bf0cfde59924 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:19.081142 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5552d1-2d6b-4034-886d-5791b0cab426 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:19.121483 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd55928-7943-4da0-9f73-58b267b3b525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:19.122119 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd55928-7943-4da0-9f73-58b267b3b525 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:19.122399 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd55928-7943-4da0-9f73-58b267b3b525 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:19.122674 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd55928-7943-4da0-9f73-58b267b3b525 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:19.129679 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd55928-7943-4da0-9f73-58b267b3b525 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:19.131132 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd55928-7943-4da0-9f73-58b267b3b525 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:19.141823 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1775a4fc-c9e9-4715-bf0e-bf0cfde59924 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:19.142552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-abd55928-7943-4da0-9f73-58b267b3b525 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:19.142552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:19.142552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:19.142552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:19.142552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:19.142552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:19.142552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:19.142552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:19.142552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:19.142552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:19.142552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:19.142552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:19.142552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:12:19.142552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:12:19.142552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:12:19.143423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:12:19.143423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:19.143423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:19.143423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:19.143423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:19.143423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:19.143423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:19.143423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:19.143423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:19.143423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:19.143423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:19.143423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:19.143423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:19.143423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:19.143423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:19.143423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:19.143423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:19.144738 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:12:19.144738 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:12:19.144738 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:12:19.144738 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:12:19.144738 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:12:19.144738 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:12:19.144738 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:19.144738 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:19.144738 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 350/707] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:12:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:19.145437 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fbe90-4586-45cf-84f1-96ea418bb78f None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:19.145437 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fbe90-4586-45cf-84f1-96ea418bb78f None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:19.145712 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6fbe90-4586-45cf-84f1-96ea418bb78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:19.155593 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:19.166131 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-aa6fbe90-4586-45cf-84f1-96ea418bb78f None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:19.167343 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-aa6fbe90-4586-45cf-84f1-96ea418bb78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:19.194598 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991b826-ca6a-443e-a6e4-4a571e10bb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:19.195709 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991b826-ca6a-443e-a6e4-4a571e10bb56 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:19.196413 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991b826-ca6a-443e-a6e4-4a571e10bb56 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:19.196846 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9991b826-ca6a-443e-a6e4-4a571e10bb56 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:19.198281 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991b826-ca6a-443e-a6e4-4a571e10bb56 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:19.200510 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9991b826-ca6a-443e-a6e4-4a571e10bb56 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:19.229685 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 358/708] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Jul 27 15:12:19 2022] POST /identity/v3/users => generated 254 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:12:19.231011 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991b826-ca6a-443e-a6e4-4a571e10bb56 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:19.248154 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 351/709] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:12:19.264531 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fbe90-4586-45cf-84f1-96ea418bb78f None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:19.307397 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:19.363210 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9991b826-ca6a-443e-a6e4-4a571e10bb56 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:19.406758 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583d53d-e2ab-491c-8130-f74e0504f7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:19.408104 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583d53d-e2ab-491c-8130-f74e0504f7b7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:19.408550 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583d53d-e2ab-491c-8130-f74e0504f7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:19.408981 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9583d53d-e2ab-491c-8130-f74e0504f7b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:19.410516 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583d53d-e2ab-491c-8130-f74e0504f7b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:19.411379 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583d53d-e2ab-491c-8130-f74e0504f7b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:19.413091 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9583d53d-e2ab-491c-8130-f74e0504f7b7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:19.429051 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 359/710] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jul 27 15:12:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:19.435483 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583d53d-e2ab-491c-8130-f74e0504f7b7 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:19.465339 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:19.482185 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6fbe90-4586-45cf-84f1-96ea418bb78f None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:19.529210 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db7ed1d-45a6-4f78-8b33-02f4ffc93941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:19.530099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7ed1d-45a6-4f78-8b33-02f4ffc93941 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:19.530428 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7ed1d-45a6-4f78-8b33-02f4ffc93941 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:19.530709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db7ed1d-45a6-4f78-8b33-02f4ffc93941 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:19.531331 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db7ed1d-45a6-4f78-8b33-02f4ffc93941 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:19.532722 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db7ed1d-45a6-4f78-8b33-02f4ffc93941 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:19.545189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-7db7ed1d-45a6-4f78-8b33-02f4ffc93941 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 15:12:19.545189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:19.545189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 15:12:19.545189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 15:12:19.545189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 15:12:19.545189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 15:12:19.545189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 15:12:19.545189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:19.545189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 15:12:19.545189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:19.545189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 15:12:19.545189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:19.545189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:19.545189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:19.545189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:19.545189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:19.546421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:19.546421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:19.546421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:19.546421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:19.546421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:19.546421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:19.546421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:19.546421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 15:12:19.546421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 15:12:19.546421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 15:12:19.546421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 15:12:19.546421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:19.546421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:19.546421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:19.546421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:19.546421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:19.547530 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:19.547530 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:19.547530 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:19.547530 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:19.547530 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:19.547530 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:19.547530 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:19.547530 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:19.547530 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:19.547530 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:19.547530 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:19.547530 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 15:12:19.547530 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:19.547530 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 15:12:19.547530 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:19.547530 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 352/711] 10.222.0.40 () {56 vars in 1129 bytes} [Wed Jul 27 15:12:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:19.548535 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b7bdd-b2ed-4185-b99f-df7f32a344db None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:19.548744 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b7bdd-b2ed-4185-b99f-df7f32a344db None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:19.549069 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972b7bdd-b2ed-4185-b99f-df7f32a344db None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:19.553636 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 353/712] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:19.554713 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b7bdd-b2ed-4185-b99f-df7f32a344db None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:19.593196 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9583d53d-e2ab-491c-8130-f74e0504f7b7 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:19.635293 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca2708b-4e88-40c6-8354-f5ccda018d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:19.635906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2708b-4e88-40c6-8354-f5ccda018d6f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:19.636205 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2708b-4e88-40c6-8354-f5ccda018d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:19.636479 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2708b-4e88-40c6-8354-f5ccda018d6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:19.637276 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2708b-4e88-40c6-8354-f5ccda018d6f None admin] RBAC: Adding query filter params (role.id=6535f8b98008471dba33e89bd460880d, scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5, user.id=d3e01aa0ef1340cbba7170bac4a82783) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:19.637582 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2708b-4e88-40c6-8354-f5ccda018d6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:19.638993 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca2708b-4e88-40c6-8354-f5ccda018d6f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:19.645086 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 360/713] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:12:19 2022] GET /identity/v3/role_assignments?user.id=d3e01aa0ef1340cbba7170bac4a82783&scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5&role.id=6535f8b98008471dba33e89bd460880d => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:19.646293 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449b5cd-bc84-4ae6-aea2-7d1c5c1a6beb None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:19.646617 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449b5cd-bc84-4ae6-aea2-7d1c5c1a6beb None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:19.646894 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449b5cd-bc84-4ae6-aea2-7d1c5c1a6beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:19.679046 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:19.680394 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972b7bdd-b2ed-4185-b99f-df7f32a344db None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:19.689614 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-2449b5cd-bc84-4ae6-aea2-7d1c5c1a6beb None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:19.691632 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2449b5cd-bc84-4ae6-aea2-7d1c5c1a6beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:19.728123 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90b698-723a-49e9-95ca-545507141373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:19.731027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90b698-723a-49e9-95ca-545507141373 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:19.731814 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90b698-723a-49e9-95ca-545507141373 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:19.733918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90b698-723a-49e9-95ca-545507141373 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:19.735825 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90b698-723a-49e9-95ca-545507141373 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:19.737421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90b698-723a-49e9-95ca-545507141373 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:19.739738 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc90b698-723a-49e9-95ca-545507141373 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:19.750851 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 354/714] 10.222.0.40 () {56 vars in 1124 bytes} [Wed Jul 27 15:12:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:19.757546 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90b698-723a-49e9-95ca-545507141373 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:19.826421 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 361/715] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:12:19.860519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449b5cd-bc84-4ae6-aea2-7d1c5c1a6beb None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:19.901847 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:19.921249 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc90b698-723a-49e9-95ca-545507141373 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:19.957416 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c22625a-2796-431b-a3be-b23a04979bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:19.958284 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22625a-2796-431b-a3be-b23a04979bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:19.958841 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22625a-2796-431b-a3be-b23a04979bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:19.959289 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c22625a-2796-431b-a3be-b23a04979bb6 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:19.960164 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c22625a-2796-431b-a3be-b23a04979bb6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:19.960746 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c22625a-2796-431b-a3be-b23a04979bb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:19.962311 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c22625a-2796-431b-a3be-b23a04979bb6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:19.968464 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 355/716] 10.222.0.40 () {56 vars in 1124 bytes} [Wed Jul 27 15:12:19 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:20.071470 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449b5cd-bc84-4ae6-aea2-7d1c5c1a6beb None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:20.123594 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd4d32-aeb5-4a2f-8732-413d4b52cdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:20.124199 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd4d32-aeb5-4a2f-8732-413d4b52cdcd None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:20.124484 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd4d32-aeb5-4a2f-8732-413d4b52cdcd None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:20.124754 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbd4d32-aeb5-4a2f-8732-413d4b52cdcd None admin] PATH_INFO: `/v3/services/network` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:20.125391 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd4d32-aeb5-4a2f-8732-413d4b52cdcd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:20.126756 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbd4d32-aeb5-4a2f-8732-413d4b52cdcd None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:20.139215 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-9cbd4d32-aeb5-4a2f-8732-413d4b52cdcd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 15:12:20.139215 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:20.139215 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 15:12:20.139215 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 15:12:20.139215 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 15:12:20.139215 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 15:12:20.139215 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 15:12:20.139215 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:20.139215 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 15:12:20.139215 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:20.139215 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 15:12:20.139215 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:20.139215 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:20.139215 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:20.139215 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:20.139215 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:20.139215 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:20.140272 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:20.140272 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:20.140272 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:20.140272 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:20.140272 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:20.140272 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:20.140272 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 15:12:20.140272 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 15:12:20.140272 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 15:12:20.140272 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 15:12:20.140272 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:20.140272 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:20.140272 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:20.140272 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:20.140272 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:20.140272 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:20.141095 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:20.141095 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:20.141095 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:20.141095 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:20.141095 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:20.141095 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:20.141095 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:20.141095 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:20.141095 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:20.141095 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:20.141095 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 15:12:20.141095 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:20.141095 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 15:12:20.141095 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:20.141095 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 362/717] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:12:19 2022] GET /identity/v3/services/network => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:12:20.146315 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c22625a-2796-431b-a3be-b23a04979bb6 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:20.178988 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:20.256280 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c22625a-2796-431b-a3be-b23a04979bb6 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:20.306067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0765c-7e52-4e26-8f8e-42276ef3e822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:20.306699 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0765c-7e52-4e26-8f8e-42276ef3e822 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:20.306980 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0765c-7e52-4e26-8f8e-42276ef3e822 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:20.307255 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0765c-7e52-4e26-8f8e-42276ef3e822 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:20.307945 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0765c-7e52-4e26-8f8e-42276ef3e822 None admin] RBAC: Adding query filter params (name=network) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:20.308275 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0765c-7e52-4e26-8f8e-42276ef3e822 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:20.309646 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0765c-7e52-4e26-8f8e-42276ef3e822 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:20.316027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 356/718] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Jul 27 15:12:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:20.322769 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd4d32-aeb5-4a2f-8732-413d4b52cdcd None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:20.436282 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:20.461630 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbd4d32-aeb5-4a2f-8732-413d4b52cdcd None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:20.513589 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd335a5-7501-459f-8aad-ebe881c1de10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:20.514204 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd335a5-7501-459f-8aad-ebe881c1de10 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:20.514482 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd335a5-7501-459f-8aad-ebe881c1de10 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:20.514752 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd335a5-7501-459f-8aad-ebe881c1de10 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:20.515428 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd335a5-7501-459f-8aad-ebe881c1de10 None admin] RBAC: Adding query filter params (type=network) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:20.515728 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd335a5-7501-459f-8aad-ebe881c1de10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:20.517109 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd335a5-7501-459f-8aad-ebe881c1de10 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:20.528853 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 363/719] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Jul 27 15:12:20 2022] GET /identity/v3/services?type=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:20.957593 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76365f-e936-4fc6-a3b1-fc372a5c7413 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:20.958244 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76365f-e936-4fc6-a3b1-fc372a5c7413 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:20.958244 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f76365f-e936-4fc6-a3b1-fc372a5c7413 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:20.960420 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 357/720] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:20.965946 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8434a6-6617-44c4-a4d5-004f99de7c52 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:20.966236 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8434a6-6617-44c4-a4d5-004f99de7c52 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:20.966514 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8434a6-6617-44c4-a4d5-004f99de7c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:20.985661 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-3c8434a6-6617-44c4-a4d5-004f99de7c52 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:20.986908 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3c8434a6-6617-44c4-a4d5-004f99de7c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:21.073462 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 364/721] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:12:21.117443 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76365f-e936-4fc6-a3b1-fc372a5c7413 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:21.251471 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:21.264647 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f76365f-e936-4fc6-a3b1-fc372a5c7413 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:21.312827 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bd882-c5ef-42ba-87da-d1f641b07195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:21.313896 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bd882-c5ef-42ba-87da-d1f641b07195 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:21.314382 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bd882-c5ef-42ba-87da-d1f641b07195 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:21.314876 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bd882-c5ef-42ba-87da-d1f641b07195 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:21.332934 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4bd882-c5ef-42ba-87da-d1f641b07195 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:12:21.338918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-3d4bd882-c5ef-42ba-87da-d1f641b07195 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:12:21.338918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:21.338918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:21.338918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:21.338918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:21.338918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:21.338918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:21.338918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:21.338918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:21.338918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:21.338918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:21.338918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:21.338918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:12:21.338918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:12:21.338918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:12:21.338918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:12:21.339844 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:12:21.339844 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:12:21.339844 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:12:21.339844 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:12:21.339844 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:21.339844 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:21.339844 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:21.339844 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:21.339844 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:21.339844 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:21.339844 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:21.339844 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:21.339844 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:21.339844 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:21.339844 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:21.339844 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:21.340726 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:21.340726 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:21.340726 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:21.340726 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:21.340726 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:12:21.340726 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:12:21.340726 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:12:21.340726 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:12:21.340726 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:12:21.340726 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:12:21.340726 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:12:21.340726 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:21.343393 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 358/722] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jul 27 15:12:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:21.349104 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8434a6-6617-44c4-a4d5-004f99de7c52 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:21.465205 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:21.507050 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8434a6-6617-44c4-a4d5-004f99de7c52 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:21.543600 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56614ae-4461-46cc-bad9-de29cec34e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:21.544793 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56614ae-4461-46cc-bad9-de29cec34e59 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:21.545570 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56614ae-4461-46cc-bad9-de29cec34e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:21.546313 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56614ae-4461-46cc-bad9-de29cec34e59 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:21.547279 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56614ae-4461-46cc-bad9-de29cec34e59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:21.547794 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56614ae-4461-46cc-bad9-de29cec34e59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:21.549470 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56614ae-4461-46cc-bad9-de29cec34e59 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:21.559758 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 365/723] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:12:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:21.569737 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bd882-c5ef-42ba-87da-d1f641b07195 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:21.711935 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bd882-c5ef-42ba-87da-d1f641b07195 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:21.759201 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b856d08-eb07-4a0f-9288-2294ac4c488f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:21.760238 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b856d08-eb07-4a0f-9288-2294ac4c488f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:21.760731 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b856d08-eb07-4a0f-9288-2294ac4c488f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:21.761229 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b856d08-eb07-4a0f-9288-2294ac4c488f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:21.777395 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b856d08-eb07-4a0f-9288-2294ac4c488f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:21.779189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b856d08-eb07-4a0f-9288-2294ac4c488f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:21.783522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79360bd-467a-4b02-80e0-ba71881fe602 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:21.783853 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79360bd-467a-4b02-80e0-ba71881fe602 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:21.784182 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79360bd-467a-4b02-80e0-ba71881fe602 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:21.785804 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 366/724] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:21.800544 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c460c-57ad-45c7-9692-d43545046d13 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:21.801161 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c460c-57ad-45c7-9692-d43545046d13 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:21.801636 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c460c-57ad-45c7-9692-d43545046d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:21.808044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-8b856d08-eb07-4a0f-9288-2294ac4c488f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:21.808044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:21.808044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:21.808044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:21.808044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:21.808044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:21.808044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:21.808044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:21.808044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:21.808044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:21.808044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:21.808044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:21.808044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:21.808044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:21.808044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:21.808973 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:21.808973 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:21.808973 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:21.808973 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:21.808973 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:21.808973 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:21.808973 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:21.808973 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:21.808973 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:21.808973 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:21.808973 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:21.808973 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:21.808973 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:21.808973 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:21.808973 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:21.808973 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:21.808973 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:21.809846 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:21.809846 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:21.809846 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:21.809846 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:21.809846 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 359/725] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:21.813851 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b856d08-eb07-4a0f-9288-2294ac4c488f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:21.832279 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:21.835924 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f60c460c-57ad-45c7-9692-d43545046d13 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:21.837140 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f60c460c-57ad-45c7-9692-d43545046d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:21.950870 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b856d08-eb07-4a0f-9288-2294ac4c488f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:21.966608 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 367/726] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:12:21.989371 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5b128-afce-4b39-a467-4322cf15be25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:21.990140 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5b128-afce-4b39-a467-4322cf15be25 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:21.991081 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5b128-afce-4b39-a467-4322cf15be25 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:21.991424 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5b128-afce-4b39-a467-4322cf15be25 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:21.992163 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf5b128-afce-4b39-a467-4322cf15be25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:21.992471 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf5b128-afce-4b39-a467-4322cf15be25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:21.993873 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf5b128-afce-4b39-a467-4322cf15be25 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:22.006486 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c460c-57ad-45c7-9692-d43545046d13 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:22.007335 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 360/727] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:22.013402 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5b128-afce-4b39-a467-4322cf15be25 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:22.082587 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:22.121340 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5b128-afce-4b39-a467-4322cf15be25 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:22.125963 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:22.156509 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72c6035-4386-41f5-8a31-1c4a30b479fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:22.157032 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c6035-4386-41f5-8a31-1c4a30b479fe None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:22.157392 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c6035-4386-41f5-8a31-1c4a30b479fe None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:22.157739 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72c6035-4386-41f5-8a31-1c4a30b479fe None admin] PATH_INFO: `/v3/users/swift` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:22.166624 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c6035-4386-41f5-8a31-1c4a30b479fe None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:22.168267 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72c6035-4386-41f5-8a31-1c4a30b479fe None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:22.171617 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c460c-57ad-45c7-9692-d43545046d13 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:22.181082 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-b72c6035-4386-41f5-8a31-1c4a30b479fe None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 15:12:22.181082 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:22.181082 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:22.181082 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:22.181082 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:22.181082 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:22.181082 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:22.181082 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:22.181082 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:22.181082 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:22.181082 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:22.181082 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:22.181082 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:12:22.181082 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:12:22.181082 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:12:22.181082 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:12:22.182234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:22.182234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:22.182234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:12:22.182234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:22.182234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:12:22.182234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:22.182234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:22.182234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:22.182234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:22.182234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:22.182234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:22.182234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:22.182234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:22.182234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:22.182234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:22.182234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:22.182234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:22.182234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:22.183434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:22.183434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:22.183434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:12:22.183434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:12:22.183434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:12:22.183434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:12:22.183434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:12:22.183434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:12:22.183434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 15:12:22.183434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:22.184792 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 361/728] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jul 27 15:12:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:12:22.186071 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5876d7e-d66e-464d-99dc-5c1ae858c782 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:22.186430 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5876d7e-d66e-464d-99dc-5c1ae858c782 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:22.186775 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5876d7e-d66e-464d-99dc-5c1ae858c782 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:22.188331 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 362/729] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:22.193017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5876d7e-d66e-464d-99dc-5c1ae858c782 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:22.215588 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d761b41-ff97-4fa6-82a4-cb68114f36a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:22.217752 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d761b41-ff97-4fa6-82a4-cb68114f36a5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:22.218035 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d761b41-ff97-4fa6-82a4-cb68114f36a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:22.218308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d761b41-ff97-4fa6-82a4-cb68114f36a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:22.233778 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d761b41-ff97-4fa6-82a4-cb68114f36a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:12:22.239385 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-1d761b41-ff97-4fa6-82a4-cb68114f36a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:12:22.239385 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:22.239385 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:22.239385 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:22.239385 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:22.239385 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:22.239385 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:22.239385 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:22.239385 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:22.239385 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:22.239385 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:22.239385 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:22.239385 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:12:22.239385 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:12:22.239385 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:12:22.239385 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:12:22.241014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:12:22.241014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:12:22.241014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:12:22.241014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:12:22.241014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:22.241014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:22.241014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:22.241014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:22.241014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:22.241014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:22.241014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:22.241014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:22.241014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:22.241014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:22.241014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:22.241014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:22.241912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:22.241912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:22.241912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:22.241912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:22.241912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:12:22.241912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:12:22.241912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:12:22.241912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:12:22.241912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:12:22.241912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:12:22.241912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:12:22.241912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:22.244318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 368/730] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jul 27 15:12:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:22.249484 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bec6ab-8fac-44e2-bbb6-817684d84366 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:22.249484 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bec6ab-8fac-44e2-bbb6-817684d84366 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:22.249484 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bec6ab-8fac-44e2-bbb6-817684d84366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:22.269071 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-12bec6ab-8fac-44e2-bbb6-817684d84366 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:22.270321 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-12bec6ab-8fac-44e2-bbb6-817684d84366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:22.335461 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5876d7e-d66e-464d-99dc-5c1ae858c782 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:22.356286 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 369/731] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:12:22.357222 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bec6ab-8fac-44e2-bbb6-817684d84366 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:22.364756 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:22.378984 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ef47c-939c-43ab-be0e-70dae6d970a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:22.380324 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ef47c-939c-43ab-be0e-70dae6d970a5 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:22.380933 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ef47c-939c-43ab-be0e-70dae6d970a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:22.382332 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ef47c-939c-43ab-be0e-70dae6d970a5 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:22.383325 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ef47c-939c-43ab-be0e-70dae6d970a5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:22.383831 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ef47c-939c-43ab-be0e-70dae6d970a5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:22.385772 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ef47c-939c-43ab-be0e-70dae6d970a5 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:22.407888 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 363/732] 10.222.0.40 () {56 vars in 1135 bytes} [Wed Jul 27 15:12:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:22.409303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ef47c-939c-43ab-be0e-70dae6d970a5 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:22.439087 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:22.486957 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bec6ab-8fac-44e2-bbb6-817684d84366 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:22.523913 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f915aec-4ad4-40b7-bedc-f4c79304612e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:22.524477 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f915aec-4ad4-40b7-bedc-f4c79304612e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:22.524757 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f915aec-4ad4-40b7-bedc-f4c79304612e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:22.525026 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f915aec-4ad4-40b7-bedc-f4c79304612e None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:22.525248 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ef47c-939c-43ab-be0e-70dae6d970a5 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:22.525734 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f915aec-4ad4-40b7-bedc-f4c79304612e None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:22.526041 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f915aec-4ad4-40b7-bedc-f4c79304612e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:22.527396 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f915aec-4ad4-40b7-bedc-f4c79304612e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:22.540430 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 370/733] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jul 27 15:12:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:22.540430 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f915aec-4ad4-40b7-bedc-f4c79304612e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:22.566108 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f7cb41-6929-472c-b976-b674c65be736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:22.566745 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7cb41-6929-472c-b976-b674c65be736 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:22.567031 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7cb41-6929-472c-b976-b674c65be736 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:22.567343 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f7cb41-6929-472c-b976-b674c65be736 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:22.579137 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f7cb41-6929-472c-b976-b674c65be736 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:12:22.584287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-94f7cb41-6929-472c-b976-b674c65be736 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:12:22.584287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:22.584287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:22.584287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:22.584287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:22.584287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:22.584287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:22.584287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:22.584287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:22.584287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:22.584287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:22.584287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:22.584287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:12:22.584287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:12:22.584287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:12:22.584287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:12:22.585240 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:12:22.585240 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:12:22.585240 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:12:22.585240 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:12:22.585240 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:22.585240 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:22.585240 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:22.585240 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:22.585240 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:22.585240 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:22.585240 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:22.585240 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:22.585240 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:22.585240 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:22.585240 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:22.585240 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:22.586071 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:22.586071 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:22.586071 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:22.586071 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:22.586071 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:12:22.586071 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:12:22.586071 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:12:22.586071 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:12:22.586071 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:12:22.586071 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:12:22.586071 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:12:22.586071 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:22.590405 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 364/734] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jul 27 15:12:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:22.591631 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29939975-976e-4fd4-8280-3d5fb741fa57 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:22.591927 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29939975-976e-4fd4-8280-3d5fb741fa57 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:22.592239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29939975-976e-4fd4-8280-3d5fb741fa57 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:22.593545 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 365/735] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:22.594240 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29939975-976e-4fd4-8280-3d5fb741fa57 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:22.643499 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:22.658382 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f915aec-4ad4-40b7-bedc-f4c79304612e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:22.682199 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:22.705784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a392610-f89c-473c-91ec-b5ed670ad079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:22.706506 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a392610-f89c-473c-91ec-b5ed670ad079 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:22.706862 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a392610-f89c-473c-91ec-b5ed670ad079 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:22.707210 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a392610-f89c-473c-91ec-b5ed670ad079 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:22.708222 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29939975-976e-4fd4-8280-3d5fb741fa57 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:22.745061 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801c1dc-cf79-4c53-9a34-6d1e1c96ebbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:22.745690 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801c1dc-cf79-4c53-9a34-6d1e1c96ebbc None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:22.746005 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801c1dc-cf79-4c53-9a34-6d1e1c96ebbc None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:22.746288 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801c1dc-cf79-4c53-9a34-6d1e1c96ebbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:22.756938 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e801c1dc-cf79-4c53-9a34-6d1e1c96ebbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:22.758359 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e801c1dc-cf79-4c53-9a34-6d1e1c96ebbc None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:22.774360 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-e801c1dc-cf79-4c53-9a34-6d1e1c96ebbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:22.774360 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:22.774360 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:22.774360 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:22.774360 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:22.774360 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:22.774360 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:22.774360 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:22.774360 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:22.774360 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:22.774360 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:22.774360 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:22.774360 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:22.774360 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:22.774360 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:22.775253 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:22.775253 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:22.775253 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:22.775253 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:22.775253 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:22.775253 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:22.775253 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:22.775253 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:22.775253 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:22.775253 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:22.775253 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:22.775253 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:22.775253 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:22.775253 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:22.775253 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:22.775253 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:22.775253 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:22.776192 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:22.776192 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:22.776192 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:22.776192 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:22.776192 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 366/736] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:22.777079 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801c1dc-cf79-4c53-9a34-6d1e1c96ebbc None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:22.791527 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a392610-f89c-473c-91ec-b5ed670ad079 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:22.793030 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a392610-f89c-473c-91ec-b5ed670ad079 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:22.878847 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:22.887305 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801c1dc-cf79-4c53-9a34-6d1e1c96ebbc None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:22.897916 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 371/737] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:12:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 15:12:22.899159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f5e56-d188-4982-9773-71309ae2e1f5 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:22.899440 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f5e56-d188-4982-9773-71309ae2e1f5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:22.899708 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096f5e56-d188-4982-9773-71309ae2e1f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:22.917705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-096f5e56-d188-4982-9773-71309ae2e1f5 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:22.918866 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-096f5e56-d188-4982-9773-71309ae2e1f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:22.929570 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39811e0-6a25-4db0-99d7-8dad2779b56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:22.930437 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39811e0-6a25-4db0-99d7-8dad2779b56d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:22.930900 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39811e0-6a25-4db0-99d7-8dad2779b56d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:22.931324 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39811e0-6a25-4db0-99d7-8dad2779b56d None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:22.932215 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39811e0-6a25-4db0-99d7-8dad2779b56d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:22.932695 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39811e0-6a25-4db0-99d7-8dad2779b56d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:22.932846 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:22.934119 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39811e0-6a25-4db0-99d7-8dad2779b56d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:22.943718 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 367/738] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:12:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:22.944641 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39811e0-6a25-4db0-99d7-8dad2779b56d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:22.991176 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 372/739] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:12:22.992404 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f5e56-d188-4982-9773-71309ae2e1f5 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:23.059383 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39811e0-6a25-4db0-99d7-8dad2779b56d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:23.094302 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e640e92-88bb-4cb4-9fd8-e6af1938e7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:23.094918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e640e92-88bb-4cb4-9fd8-e6af1938e7c6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:23.095200 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e640e92-88bb-4cb4-9fd8-e6af1938e7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:23.095473 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e640e92-88bb-4cb4-9fd8-e6af1938e7c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:23.096210 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e640e92-88bb-4cb4-9fd8-e6af1938e7c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:23.096520 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e640e92-88bb-4cb4-9fd8-e6af1938e7c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:23.097929 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e640e92-88bb-4cb4-9fd8-e6af1938e7c6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:23.108855 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096f5e56-d188-4982-9773-71309ae2e1f5 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:23.110700 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 368/740] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:23.111334 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e640e92-88bb-4cb4-9fd8-e6af1938e7c6 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:23.130041 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:23.152117 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a981115b-c03b-47c0-82d2-7cead08d7ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:23.153086 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981115b-c03b-47c0-82d2-7cead08d7ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:23.153505 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981115b-c03b-47c0-82d2-7cead08d7ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:23.153953 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a981115b-c03b-47c0-82d2-7cead08d7ee3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:23.165663 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a981115b-c03b-47c0-82d2-7cead08d7ee3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:23.167370 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a981115b-c03b-47c0-82d2-7cead08d7ee3 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:23.176517 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:23.184126 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-a981115b-c03b-47c0-82d2-7cead08d7ee3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:23.184126 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:23.184126 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:23.184126 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:23.184126 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:23.184126 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:23.184126 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:23.184126 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:23.184126 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:23.184126 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:23.184126 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:23.184126 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:23.184126 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:23.184126 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:23.184126 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:23.185045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:23.185045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:23.185045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:23.185045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:23.185045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:23.185045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:23.185045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:23.185045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:23.185045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:23.185045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:23.185045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:23.185045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:23.185045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:23.185045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:23.185045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:23.185045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:23.185045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:23.185941 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:23.185941 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:23.185941 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:23.185941 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:23.188152 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 373/741] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:23.188917 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a981115b-c03b-47c0-82d2-7cead08d7ee3 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:23.212749 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e640e92-88bb-4cb4-9fd8-e6af1938e7c6 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:23.245497 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e396f1-e865-4281-a571-1619e48696c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:23.246119 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e396f1-e865-4281-a571-1619e48696c7 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:23.246396 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e396f1-e865-4281-a571-1619e48696c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:23.246666 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e396f1-e865-4281-a571-1619e48696c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:23.256685 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e396f1-e865-4281-a571-1619e48696c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:23.258119 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e396f1-e865-4281-a571-1619e48696c7 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:23.273698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-82e396f1-e865-4281-a571-1619e48696c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:23.273698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:23.273698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:23.273698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:23.273698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:23.273698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:23.273698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:23.273698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:23.273698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:23.273698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:23.273698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:23.273698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:23.273698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:23.273698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:23.273698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:23.274743 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:23.274743 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:23.274743 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:23.274743 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:23.274743 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:23.274743 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:23.274743 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:23.274743 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:23.274743 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:23.274743 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:23.274743 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:23.274743 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:23.274743 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:23.274743 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:23.274743 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:23.274743 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:23.274743 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:23.275781 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:23.275781 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:23.275781 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:23.275781 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:23.275781 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 369/742] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:23.276117 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e396f1-e865-4281-a571-1619e48696c7 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:23.294690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a981115b-c03b-47c0-82d2-7cead08d7ee3 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:23.327229 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8b88e3-8a1b-4d24-ad1b-e7bbcadf85d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:23.327764 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b88e3-8a1b-4d24-ad1b-e7bbcadf85d9 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:23.328074 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b88e3-8a1b-4d24-ad1b-e7bbcadf85d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:23.328354 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b88e3-8a1b-4d24-ad1b-e7bbcadf85d9 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:23.329051 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b88e3-8a1b-4d24-ad1b-e7bbcadf85d9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:23.330408 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8b88e3-8a1b-4d24-ad1b-e7bbcadf85d9 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:23.344046 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:23.358622 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 374/743] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Jul 27 15:12:23 2022] POST /identity/v3/services => generated 251 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:12:23.358622 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac1356-2b22-4f0c-bc57-db7fd3fe2041 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:23.358622 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac1356-2b22-4f0c-bc57-db7fd3fe2041 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:23.358622 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaac1356-2b22-4f0c-bc57-db7fd3fe2041 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:23.358622 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 375/744] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:23.358622 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac1356-2b22-4f0c-bc57-db7fd3fe2041 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:23.382395 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e396f1-e865-4281-a571-1619e48696c7 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:23.431083 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:23.435170 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c873b8c-a606-4e39-89b5-2e8863b006f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:23.435833 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c873b8c-a606-4e39-89b5-2e8863b006f8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:23.436150 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c873b8c-a606-4e39-89b5-2e8863b006f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:23.436513 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c873b8c-a606-4e39-89b5-2e8863b006f8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:23.445258 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c873b8c-a606-4e39-89b5-2e8863b006f8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:23.446724 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c873b8c-a606-4e39-89b5-2e8863b006f8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:23.459978 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-7c873b8c-a606-4e39-89b5-2e8863b006f8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 15:12:23.459978 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:23.459978 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:23.459978 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:23.459978 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:23.459978 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:23.459978 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:23.459978 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:23.459978 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:23.459978 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:23.459978 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:23.459978 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:23.459978 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:12:23.459978 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:12:23.459978 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:12:23.459978 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:12:23.461020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:23.461020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:23.461020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:12:23.461020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:23.461020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:12:23.461020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:23.461020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:23.461020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:23.461020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:23.461020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:23.461020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:23.461020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:23.461020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:23.461020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:23.461020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:23.461020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:23.461020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:23.461020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:23.461950 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:23.461950 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:23.461950 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:12:23.461950 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:12:23.461950 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:12:23.461950 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:12:23.461950 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:12:23.461950 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:12:23.461950 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 15:12:23.461950 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:23.461950 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 370/745] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Jul 27 15:12:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:23.462619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c873b8c-a606-4e39-89b5-2e8863b006f8 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:23.484382 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaac1356-2b22-4f0c-bc57-db7fd3fe2041 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:23.529619 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54d5059-4f56-42d1-baa2-5f1816d8ca80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:23.530263 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d5059-4f56-42d1-baa2-5f1816d8ca80 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:23.530517 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d5059-4f56-42d1-baa2-5f1816d8ca80 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:23.531112 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54d5059-4f56-42d1-baa2-5f1816d8ca80 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:23.531482 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d5059-4f56-42d1-baa2-5f1816d8ca80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:23.531784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d5059-4f56-42d1-baa2-5f1816d8ca80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:23.533169 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54d5059-4f56-42d1-baa2-5f1816d8ca80 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:23.545599 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 376/746] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:23.546840 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96da738-7ea0-456c-bee3-2c117e635090 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:23.547126 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96da738-7ea0-456c-bee3-2c117e635090 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:23.547400 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96da738-7ea0-456c-bee3-2c117e635090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:23.564950 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b96da738-7ea0-456c-bee3-2c117e635090 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:23.566140 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b96da738-7ea0-456c-bee3-2c117e635090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:23.583491 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c873b8c-a606-4e39-89b5-2e8863b006f8 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:23.612429 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:23.625181 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423be607-fb6a-4568-962c-00456c5ba336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:23.626212 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423be607-fb6a-4568-962c-00456c5ba336 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:23.626699 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423be607-fb6a-4568-962c-00456c5ba336 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:23.627210 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423be607-fb6a-4568-962c-00456c5ba336 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:23.628159 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423be607-fb6a-4568-962c-00456c5ba336 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:23.628810 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423be607-fb6a-4568-962c-00456c5ba336 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:23.630275 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423be607-fb6a-4568-962c-00456c5ba336 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:23.648762 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 377/747] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:23 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 15:12:23.648762 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96da738-7ea0-456c-bee3-2c117e635090 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:23.649017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 371/748] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:23.649017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423be607-fb6a-4568-962c-00456c5ba336 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:23.700743 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:23.754976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96da738-7ea0-456c-bee3-2c117e635090 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:23.756709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423be607-fb6a-4568-962c-00456c5ba336 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:23.790790 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba92ba-2d2f-4792-92f7-f05535250df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:23.791403 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba92ba-2d2f-4792-92f7-f05535250df7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:23.791685 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba92ba-2d2f-4792-92f7-f05535250df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:23.791958 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ba92ba-2d2f-4792-92f7-f05535250df7 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:23.792779 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba92ba-2d2f-4792-92f7-f05535250df7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:23.793088 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba92ba-2d2f-4792-92f7-f05535250df7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:23.793686 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f8213-2cd8-43fa-9056-ee35aa5bc324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:23.794316 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f8213-2cd8-43fa-9056-ee35aa5bc324 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:23.794507 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ba92ba-2d2f-4792-92f7-f05535250df7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:23.794619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f8213-2cd8-43fa-9056-ee35aa5bc324 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:23.794891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f8213-2cd8-43fa-9056-ee35aa5bc324 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:23.801930 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f8213-2cd8-43fa-9056-ee35aa5bc324 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:23.803832 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f8213-2cd8-43fa-9056-ee35aa5bc324 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:23.817706 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 378/749] 10.222.0.40 () {56 vars in 1149 bytes} [Wed Jul 27 15:12:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:23.817706 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba92ba-2d2f-4792-92f7-f05535250df7 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:23.818151 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-670f8213-2cd8-43fa-9056-ee35aa5bc324 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:23.818151 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:23.818151 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:23.818151 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:23.818151 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:23.818151 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:23.818151 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:23.818151 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:23.818151 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:23.818151 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:23.818151 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:23.818151 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:23.818151 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:12:23.818151 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:12:23.818151 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:12:23.819517 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:12:23.819517 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:23.819517 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:23.819517 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:23.819517 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:23.819517 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:23.819517 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:23.819517 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:23.819517 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:23.819517 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:23.819517 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:23.819517 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:23.819517 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:23.819517 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:23.819517 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:23.819517 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:23.819517 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:23.820446 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:12:23.820446 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:12:23.820446 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:12:23.820446 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:12:23.820446 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:12:23.820446 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:12:23.820446 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:23.820446 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:23.820446 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 372/750] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:12:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:23.820446 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f8213-2cd8-43fa-9056-ee35aa5bc324 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:23.867309 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:23.926446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ba92ba-2d2f-4792-92f7-f05535250df7 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:23.927127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f8213-2cd8-43fa-9056-ee35aa5bc324 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:23.936260 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:23.963029 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90da81-73cb-4d28-be53-87029601b216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:23.963658 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90da81-73cb-4d28-be53-87029601b216 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:23.963939 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90da81-73cb-4d28-be53-87029601b216 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:23.964245 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd90da81-73cb-4d28-be53-87029601b216 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:23.966014 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1b947-2fbb-4c0e-ba91-008d0dddc608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:23.966630 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1b947-2fbb-4c0e-ba91-008d0dddc608 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:23.967029 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1b947-2fbb-4c0e-ba91-008d0dddc608 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:23.967311 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1b947-2fbb-4c0e-ba91-008d0dddc608 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:23.968021 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1b947-2fbb-4c0e-ba91-008d0dddc608 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:23.969397 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1b947-2fbb-4c0e-ba91-008d0dddc608 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:23.971637 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90da81-73cb-4d28-be53-87029601b216 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:23.973089 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd90da81-73cb-4d28-be53-87029601b216 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:23.985602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-fd90da81-73cb-4d28-be53-87029601b216 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 15:12:23.985602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:23.985602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:23.985602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:23.985602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:23.985602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:23.985602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:23.985602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:23.985602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:23.985602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:23.985602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:23.985602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:23.985602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:12:23.985602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:12:23.985602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:12:23.985602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:12:23.986624 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:23.986624 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:23.986624 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:12:23.986624 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:23.986624 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:12:23.986624 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:23.986624 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:23.986624 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:23.986624 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:23.986624 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:23.986624 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:23.986624 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:23.986624 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:23.986624 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:23.986624 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:23.986624 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:23.986624 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:23.986624 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:23.988194 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:23.988194 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:23.988194 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:12:23.988194 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:12:23.988194 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:12:23.988194 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:12:23.988194 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:12:23.988194 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:12:23.988194 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 15:12:23.988194 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:23.988749 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 373/751] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Jul 27 15:12:23 2022] POST /identity/v3/services => generated 240 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:12:23.988749 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1b947-2fbb-4c0e-ba91-008d0dddc608 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:23.996332 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 379/752] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Jul 27 15:12:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:23.996332 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90da81-73cb-4d28-be53-87029601b216 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:24.112896 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:24.114467 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd90da81-73cb-4d28-be53-87029601b216 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:24.117705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1b947-2fbb-4c0e-ba91-008d0dddc608 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:24.156346 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9ac4b-9bc2-4348-bfec-3aeb41f26865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:24.156987 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9ac4b-9bc2-4348-bfec-3aeb41f26865 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:24.157375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9ac4b-9bc2-4348-bfec-3aeb41f26865 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:24.157761 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9ac4b-9bc2-4348-bfec-3aeb41f26865 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:24.158515 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9ac4b-9bc2-4348-bfec-3aeb41f26865 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:24.158771 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0e3e2-4240-4ab6-a833-9ac8949d0dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:24.158883 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9ac4b-9bc2-4348-bfec-3aeb41f26865 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:24.159389 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0e3e2-4240-4ab6-a833-9ac8949d0dcf None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:24.159670 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0e3e2-4240-4ab6-a833-9ac8949d0dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:24.159942 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d0e3e2-4240-4ab6-a833-9ac8949d0dcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:24.160251 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9ac4b-9bc2-4348-bfec-3aeb41f26865 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:24.173557 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 380/753] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jul 27 15:12:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:24.174366 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9ac4b-9bc2-4348-bfec-3aeb41f26865 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:24.213624 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:24.255365 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d0e3e2-4240-4ab6-a833-9ac8949d0dcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:24.257833 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d0e3e2-4240-4ab6-a833-9ac8949d0dcf None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:24.296121 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9ac4b-9bc2-4348-bfec-3aeb41f26865 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:24.335583 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc21c0-5651-48bc-97b0-04c3f948b539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:24.336318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc21c0-5651-48bc-97b0-04c3f948b539 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:24.336606 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc21c0-5651-48bc-97b0-04c3f948b539 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:24.336881 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dc21c0-5651-48bc-97b0-04c3f948b539 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:24.337773 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc21c0-5651-48bc-97b0-04c3f948b539 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:24.338084 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc21c0-5651-48bc-97b0-04c3f948b539 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:24.339496 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dc21c0-5651-48bc-97b0-04c3f948b539 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:24.363716 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 381/754] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Jul 27 15:12:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:24.364758 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc21c0-5651-48bc-97b0-04c3f948b539 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:24.379725 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:24.385448 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 374/755] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:12:23 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 15:12:24.386670 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0e3e2-4240-4ab6-a833-9ac8949d0dcf None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:24.460749 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:24.480571 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dc21c0-5651-48bc-97b0-04c3f948b539 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:24.509131 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d0e3e2-4240-4ab6-a833-9ac8949d0dcf None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:24.521955 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134d7c8-84d2-47e1-9346-f201977305be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:24.522652 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134d7c8-84d2-47e1-9346-f201977305be None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:24.523027 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134d7c8-84d2-47e1-9346-f201977305be None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:24.523380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134d7c8-84d2-47e1-9346-f201977305be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:24.524285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134d7c8-84d2-47e1-9346-f201977305be None admin] RBAC: Adding query filter params (role.id=6535f8b98008471dba33e89bd460880d, scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5, user.id=68bbf8bb59a84829afacd9677c9639a6) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:24.524663 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134d7c8-84d2-47e1-9346-f201977305be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:24.526162 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134d7c8-84d2-47e1-9346-f201977305be None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:24.532650 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 382/756] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:12:24 2022] GET /identity/v3/role_assignments?user.id=68bbf8bb59a84829afacd9677c9639a6&scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5&role.id=6535f8b98008471dba33e89bd460880d => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:24.533599 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134d7c8-84d2-47e1-9346-f201977305be None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:24.552975 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e2c13-7a09-42ab-83a6-20ae8b21ee06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:24.554231 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e2c13-7a09-42ab-83a6-20ae8b21ee06 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:24.554522 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e2c13-7a09-42ab-83a6-20ae8b21ee06 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:24.554800 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905e2c13-7a09-42ab-83a6-20ae8b21ee06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:24.567612 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e2c13-7a09-42ab-83a6-20ae8b21ee06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:24.569376 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905e2c13-7a09-42ab-83a6-20ae8b21ee06 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:24.587619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-905e2c13-7a09-42ab-83a6-20ae8b21ee06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:24.587619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:24.587619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:24.587619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:24.587619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:24.587619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:24.587619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:24.587619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:24.587619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:24.587619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:24.587619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:24.587619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:24.587619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:24.587619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:24.587619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:24.589806 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:24.589806 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:24.589806 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:24.589806 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:24.589806 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:24.589806 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:24.589806 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:24.589806 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:24.589806 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:24.589806 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:24.589806 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:24.589806 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:24.589806 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:24.589806 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:24.589806 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:24.589806 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:24.589806 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:24.592521 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:24.592521 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:24.592521 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:24.592521 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:24.592521 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 375/757] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:24.596103 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e2c13-7a09-42ab-83a6-20ae8b21ee06 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:24.719983 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:24.732669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134d7c8-84d2-47e1-9346-f201977305be None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:24.778152 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e7c98-6fa5-4176-8b76-bfb51e3c444c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:24.778971 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e7c98-6fa5-4176-8b76-bfb51e3c444c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:24.779262 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e7c98-6fa5-4176-8b76-bfb51e3c444c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:24.779544 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658e7c98-6fa5-4176-8b76-bfb51e3c444c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:24.793243 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e7c98-6fa5-4176-8b76-bfb51e3c444c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:24.794696 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658e7c98-6fa5-4176-8b76-bfb51e3c444c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:24.811095 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-658e7c98-6fa5-4176-8b76-bfb51e3c444c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:24.811095 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:24.811095 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:24.811095 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:24.811095 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:24.811095 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:24.811095 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:24.811095 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:24.811095 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:24.811095 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:24.811095 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:24.811095 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:24.811095 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:24.811095 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:24.811095 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:24.813153 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:24.813153 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:24.813153 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:24.813153 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:24.813153 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:24.813153 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:24.813153 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:24.813153 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:24.813153 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:24.813153 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:24.813153 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:24.813153 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:24.813153 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:24.813153 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:24.813153 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:24.813153 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:24.813153 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:24.815103 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:24.815103 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:24.815103 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:24.815103 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:24.815103 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 383/758] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:24.821220 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e7c98-6fa5-4176-8b76-bfb51e3c444c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:24.824827 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:24.833686 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905e2c13-7a09-42ab-83a6-20ae8b21ee06 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:24.906596 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d00e7-3d28-4f55-96f6-0581804b5930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:24.907223 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d00e7-3d28-4f55-96f6-0581804b5930 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:24.907505 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d00e7-3d28-4f55-96f6-0581804b5930 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:24.907778 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232d00e7-3d28-4f55-96f6-0581804b5930 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:24.908510 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d00e7-3d28-4f55-96f6-0581804b5930 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:24.908851 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d00e7-3d28-4f55-96f6-0581804b5930 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:24.910187 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232d00e7-3d28-4f55-96f6-0581804b5930 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:24.939522 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 376/759] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:24.942447 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d00e7-3d28-4f55-96f6-0581804b5930 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:25.012262 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658e7c98-6fa5-4176-8b76-bfb51e3c444c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:25.051875 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600f335-6053-4633-8990-81084140f3bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:25.056013 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600f335-6053-4633-8990-81084140f3bd None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:25.056013 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600f335-6053-4633-8990-81084140f3bd None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:25.056013 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4600f335-6053-4633-8990-81084140f3bd None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:25.056013 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600f335-6053-4633-8990-81084140f3bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:25.056013 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600f335-6053-4633-8990-81084140f3bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:25.057790 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4600f335-6053-4633-8990-81084140f3bd None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:25.072394 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 384/760] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:25.080967 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600f335-6053-4633-8990-81084140f3bd None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:25.150828 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232d00e7-3d28-4f55-96f6-0581804b5930 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:25.166725 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:25.191452 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2662b-2b4f-43a3-90e9-9381cc0a7ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:25.192136 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2662b-2b4f-43a3-90e9-9381cc0a7ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:25.192420 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2662b-2b4f-43a3-90e9-9381cc0a7ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:25.192698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2662b-2b4f-43a3-90e9-9381cc0a7ba0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:25.201494 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2662b-2b4f-43a3-90e9-9381cc0a7ba0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:25.203056 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2662b-2b4f-43a3-90e9-9381cc0a7ba0 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:25.214997 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:25.225454 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-e5c2662b-2b4f-43a3-90e9-9381cc0a7ba0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:25.225454 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:25.225454 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:25.225454 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:25.225454 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:25.225454 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:25.225454 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:25.225454 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:25.225454 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:25.225454 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:25.225454 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:25.225454 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:25.225454 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:12:25.225454 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:12:25.225454 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:12:25.226359 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:12:25.226359 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:25.226359 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:25.226359 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:25.226359 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:25.226359 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:25.226359 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:25.226359 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:25.226359 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:25.226359 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:25.226359 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:25.226359 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:25.226359 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:25.226359 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:25.226359 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:25.226359 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:25.226359 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:25.227233 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:12:25.227233 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:12:25.227233 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:12:25.227233 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:12:25.227233 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:12:25.227233 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:12:25.227233 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:25.227233 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:25.227233 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 377/761] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:12:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:25.232852 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2662b-2b4f-43a3-90e9-9381cc0a7ba0 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:25.307967 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4600f335-6053-4633-8990-81084140f3bd None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:25.353159 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2662b-2b4f-43a3-90e9-9381cc0a7ba0 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:25.389294 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95438297-891a-4d8e-90a7-475786c7f3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:25.389921 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95438297-891a-4d8e-90a7-475786c7f3e7 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:25.390206 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95438297-891a-4d8e-90a7-475786c7f3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:25.390478 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95438297-891a-4d8e-90a7-475786c7f3e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:25.391233 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95438297-891a-4d8e-90a7-475786c7f3e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:25.391544 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95438297-891a-4d8e-90a7-475786c7f3e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:25.393135 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95438297-891a-4d8e-90a7-475786c7f3e7 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:25.407308 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 378/762] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jul 27 15:12:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:25.414436 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95438297-891a-4d8e-90a7-475786c7f3e7 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:25.457782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:25.460692 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49914691-d382-4131-96f1-197fe08f5846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:25.461355 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49914691-d382-4131-96f1-197fe08f5846 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:25.461642 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49914691-d382-4131-96f1-197fe08f5846 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:25.461919 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49914691-d382-4131-96f1-197fe08f5846 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:25.491623 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49914691-d382-4131-96f1-197fe08f5846 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:25.493114 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49914691-d382-4131-96f1-197fe08f5846 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:25.529926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95438297-891a-4d8e-90a7-475786c7f3e7 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:25.530512 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-49914691-d382-4131-96f1-197fe08f5846 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:25.530512 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:25.530512 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:25.530512 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:25.530512 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:25.530512 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:25.530512 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:25.530512 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:25.530512 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:25.530512 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:25.530512 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:25.530512 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:25.530512 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:12:25.530512 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:12:25.530512 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:12:25.531354 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:12:25.531354 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:25.531354 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:25.531354 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:25.531354 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:25.531354 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:25.531354 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:25.531354 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:25.531354 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:25.531354 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:25.531354 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:25.531354 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:25.531354 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:25.531354 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:25.531354 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:25.531354 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:25.531354 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:25.532266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:12:25.532266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:12:25.532266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:12:25.532266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:12:25.532266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:12:25.532266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:12:25.532266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:25.532266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:25.534345 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 385/763] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:12:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 454 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:25.541149 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49914691-d382-4131-96f1-197fe08f5846 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:25.572922 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efc5e1-d641-4451-a15b-0eb69ea5a13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:25.573524 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efc5e1-d641-4451-a15b-0eb69ea5a13c None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:25.573871 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efc5e1-d641-4451-a15b-0eb69ea5a13c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:25.574153 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efc5e1-d641-4451-a15b-0eb69ea5a13c None admin] PATH_INFO: `/v3/projects/0b616213eaea4a22afee15d4cbe5a3c5/users/d3e01aa0ef1340cbba7170bac4a82783/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:25.576752 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25efc5e1-d641-4451-a15b-0eb69ea5a13c None admin] RBAC: Authorizing `identity:create_grant(project_id=0b616213eaea4a22afee15d4cbe5a3c5, user_id=d3e01aa0ef1340cbba7170bac4a82783, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:25.578932 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25efc5e1-d641-4451-a15b-0eb69ea5a13c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:25.607188 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 379/764] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jul 27 15:12:25 2022] PUT /identity/v3/projects/0b616213eaea4a22afee15d4cbe5a3c5/users/d3e01aa0ef1340cbba7170bac4a82783/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:12:25.610183 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc27d49-319d-413c-8585-284adc07693d None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:25.610803 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc27d49-319d-413c-8585-284adc07693d None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:25.611700 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc27d49-319d-413c-8585-284adc07693d None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:25.613669 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 380/765] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:25.620363 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45374c-e806-4a35-92d7-3840432f491f None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:25.620985 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45374c-e806-4a35-92d7-3840432f491f None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:25.621564 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf45374c-e806-4a35-92d7-3840432f491f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:25.643527 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-cf45374c-e806-4a35-92d7-3840432f491f None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:25.644997 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-cf45374c-e806-4a35-92d7-3840432f491f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:25.666293 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49914691-d382-4131-96f1-197fe08f5846 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:25.691900 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:25.705763 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c969b38-141f-4e0c-b4e0-c262fcec05a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:25.706691 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c969b38-141f-4e0c-b4e0-c262fcec05a2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:25.707146 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c969b38-141f-4e0c-b4e0-c262fcec05a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:25.707589 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c969b38-141f-4e0c-b4e0-c262fcec05a2 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:25.708651 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c969b38-141f-4e0c-b4e0-c262fcec05a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:25.709739 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c969b38-141f-4e0c-b4e0-c262fcec05a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:25.711278 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c969b38-141f-4e0c-b4e0-c262fcec05a2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:25.731519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 386/766] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jul 27 15:12:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:25.737647 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c969b38-141f-4e0c-b4e0-c262fcec05a2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:25.753594 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 381/767] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:12:25.809081 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45374c-e806-4a35-92d7-3840432f491f None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:25.857111 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c969b38-141f-4e0c-b4e0-c262fcec05a2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:25.880308 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:25.906151 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea34c7-cd5f-42f9-8eb9-73c5b0a240a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:25.907272 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea34c7-cd5f-42f9-8eb9-73c5b0a240a1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:25.908496 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea34c7-cd5f-42f9-8eb9-73c5b0a240a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:25.908680 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ea34c7-cd5f-42f9-8eb9-73c5b0a240a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:25.911425 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea34c7-cd5f-42f9-8eb9-73c5b0a240a1 None admin] RBAC: Adding query filter params (role.id=6a54ab92d32843d6bc4c2dcedae4bd13, scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5, user.id=b470b4c2ca1a4d1a8a864789bf603d02) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:25.912573 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea34c7-cd5f-42f9-8eb9-73c5b0a240a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:25.915621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ea34c7-cd5f-42f9-8eb9-73c5b0a240a1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:25.924024 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 387/768] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:12:25 2022] GET /identity/v3/role_assignments?user.id=b470b4c2ca1a4d1a8a864789bf603d02&scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5&role.id=6a54ab92d32843d6bc4c2dcedae4bd13 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:26.015886 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf45374c-e806-4a35-92d7-3840432f491f None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:26.071860 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034cf48-7fb3-449e-a367-9ea3aa2189b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:26.072558 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034cf48-7fb3-449e-a367-9ea3aa2189b3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:26.072839 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034cf48-7fb3-449e-a367-9ea3aa2189b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:26.073111 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0034cf48-7fb3-449e-a367-9ea3aa2189b3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:26.073750 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0034cf48-7fb3-449e-a367-9ea3aa2189b3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:26.075126 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0034cf48-7fb3-449e-a367-9ea3aa2189b3 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:26.090050 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-0034cf48-7fb3-449e-a367-9ea3aa2189b3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 15:12:26.090050 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:26.090050 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 15:12:26.090050 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 15:12:26.090050 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 15:12:26.090050 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 15:12:26.090050 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 15:12:26.090050 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:26.090050 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 15:12:26.090050 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:26.090050 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 15:12:26.090050 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:26.090050 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:26.090050 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:26.090050 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:26.090050 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:26.091042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:26.091042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:26.091042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:26.091042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:26.091042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:26.091042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:26.091042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:26.091042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 15:12:26.091042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 15:12:26.091042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 15:12:26.091042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 15:12:26.091042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:26.091042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:26.091042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:26.091042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:26.091042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:26.091890 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:26.091890 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:26.091890 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:26.091890 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:26.091890 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:26.091890 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:26.091890 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:26.091890 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:26.091890 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:26.091890 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:26.091890 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:26.091890 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 15:12:26.091890 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:26.091890 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 15:12:26.091890 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:26.091890 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 382/769] 10.222.0.40 () {56 vars in 1129 bytes} [Wed Jul 27 15:12:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:26.097319 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea34c7-cd5f-42f9-8eb9-73c5b0a240a1 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:26.179793 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:26.241997 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ea34c7-cd5f-42f9-8eb9-73c5b0a240a1 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:26.276324 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772dbf9-8d8a-457a-b4c4-f408f4fbd1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:26.276934 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772dbf9-8d8a-457a-b4c4-f408f4fbd1c4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:26.277213 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772dbf9-8d8a-457a-b4c4-f408f4fbd1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:26.277488 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772dbf9-8d8a-457a-b4c4-f408f4fbd1c4 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:26.278194 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772dbf9-8d8a-457a-b4c4-f408f4fbd1c4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:26.278497 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772dbf9-8d8a-457a-b4c4-f408f4fbd1c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:26.279885 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772dbf9-8d8a-457a-b4c4-f408f4fbd1c4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:26.285074 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 388/770] 10.222.0.40 () {56 vars in 1124 bytes} [Wed Jul 27 15:12:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:26.292249 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034cf48-7fb3-449e-a367-9ea3aa2189b3 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:26.294888 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554b9e3-8866-4481-9ba8-d1d746172cc1 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:26.295226 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554b9e3-8866-4481-9ba8-d1d746172cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:26.295714 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b554b9e3-8866-4481-9ba8-d1d746172cc1 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:26.299130 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 389/771] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:12:26.304458 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57cea11-8f21-4ce1-8666-b5704fa1dc1c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:26.304790 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57cea11-8f21-4ce1-8666-b5704fa1dc1c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:26.305026 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57cea11-8f21-4ce1-8666-b5704fa1dc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:26.325416 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-e57cea11-8f21-4ce1-8666-b5704fa1dc1c None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:26.326625 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e57cea11-8f21-4ce1-8666-b5704fa1dc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:26.424122 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 390/772] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 15:12:26.439900 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57cea11-8f21-4ce1-8666-b5704fa1dc1c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:26.465154 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:26.514718 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0034cf48-7fb3-449e-a367-9ea3aa2189b3 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:26.597499 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c82631-f357-401c-9199-667c352213e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:26.598333 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c82631-f357-401c-9199-667c352213e9 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:26.598794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c82631-f357-401c-9199-667c352213e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:26.599224 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c82631-f357-401c-9199-667c352213e9 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:26.600133 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c82631-f357-401c-9199-667c352213e9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:26.600590 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c82631-f357-401c-9199-667c352213e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:26.612641 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c82631-f357-401c-9199-667c352213e9 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:26.623575 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 383/773] 10.222.0.40 () {56 vars in 1124 bytes} [Wed Jul 27 15:12:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:26.627346 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c82631-f357-401c-9199-667c352213e9 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:26.641092 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:26.730132 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57cea11-8f21-4ce1-8666-b5704fa1dc1c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:26.751694 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c82631-f357-401c-9199-667c352213e9 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:26.803191 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3da087-7db5-43c9-bfc6-67a904c7f605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:26.803838 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3da087-7db5-43c9-bfc6-67a904c7f605 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:26.804145 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3da087-7db5-43c9-bfc6-67a904c7f605 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:26.804416 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3da087-7db5-43c9-bfc6-67a904c7f605 None admin] PATH_INFO: `/v3/services/network` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:26.805043 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3da087-7db5-43c9-bfc6-67a904c7f605 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:26.806394 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3da087-7db5-43c9-bfc6-67a904c7f605 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:26.821850 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-3e3da087-7db5-43c9-bfc6-67a904c7f605 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 15:12:26.821850 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:26.821850 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 15:12:26.821850 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 15:12:26.821850 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 15:12:26.821850 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 15:12:26.821850 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 15:12:26.821850 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:26.821850 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 15:12:26.821850 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:26.821850 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 15:12:26.821850 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:26.821850 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:26.821850 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:26.821850 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:26.821850 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:26.821850 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:26.823072 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:26.823072 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:26.823072 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:26.823072 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:26.823072 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:26.823072 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:26.823072 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 15:12:26.823072 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 15:12:26.823072 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 15:12:26.823072 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 15:12:26.823072 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:26.823072 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:26.823072 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:26.823072 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:26.823072 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:26.823072 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:26.824190 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:26.824190 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:26.824190 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:26.824190 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:26.824190 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:26.824190 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:26.824190 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:26.824190 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:26.824190 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:26.824190 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:26.824190 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 15:12:26.824190 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:26.824190 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 15:12:26.824190 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:26.824190 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 391/774] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:12:26 2022] GET /identity/v3/services/network => generated 88 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:12:26.825017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ef9e2-683a-4dba-8f10-6d41400a7bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:26.825017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ef9e2-683a-4dba-8f10-6d41400a7bef None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:26.825017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ef9e2-683a-4dba-8f10-6d41400a7bef None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:26.825017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3ef9e2-683a-4dba-8f10-6d41400a7bef None admin] PATH_INFO: `/v3/endpoints` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:26.825567 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ef9e2-683a-4dba-8f10-6d41400a7bef None admin] RBAC: Adding query filter params (interface=public, service_id=157dc19e61f64f5ba7bb03e25898cda5, region_id=RegionOne) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:26.826712 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ef9e2-683a-4dba-8f10-6d41400a7bef None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:26.828751 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3ef9e2-683a-4dba-8f10-6d41400a7bef None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:26.832996 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3da087-7db5-43c9-bfc6-67a904c7f605 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:26.840185 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 384/775] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Jul 27 15:12:26 2022] GET /identity/v3/endpoints?service_id=157dc19e61f64f5ba7bb03e25898cda5&interface=public®ion_id=RegionOne => generated 194 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:26.844954 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ef9e2-683a-4dba-8f10-6d41400a7bef None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:26.870344 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:27.005256 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3da087-7db5-43c9-bfc6-67a904c7f605 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:27.009152 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:27.026138 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3ef9e2-683a-4dba-8f10-6d41400a7bef None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:27.041948 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96065a22-af11-4149-ac1d-0147d34547f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:27.042871 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96065a22-af11-4149-ac1d-0147d34547f4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:27.043381 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96065a22-af11-4149-ac1d-0147d34547f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:27.043859 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96065a22-af11-4149-ac1d-0147d34547f4 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:27.044771 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96065a22-af11-4149-ac1d-0147d34547f4 None admin] RBAC: Adding query filter params (name=network) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:27.045282 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96065a22-af11-4149-ac1d-0147d34547f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:27.046864 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96065a22-af11-4149-ac1d-0147d34547f4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:27.056787 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 392/776] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Jul 27 15:12:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:27.058264 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba8a28-ecfc-4db0-bee0-523076cea6b1 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:27.058760 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba8a28-ecfc-4db0-bee0-523076cea6b1 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:27.059303 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ba8a28-ecfc-4db0-bee0-523076cea6b1 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:27.061356 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 393/777] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:27.062372 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba8a28-ecfc-4db0-bee0-523076cea6b1 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:27.067235 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e793d78a-f572-4362-acef-48c2dfe63cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:27.067569 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793d78a-f572-4362-acef-48c2dfe63cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:27.067848 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793d78a-f572-4362-acef-48c2dfe63cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:27.069030 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793d78a-f572-4362-acef-48c2dfe63cd1 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:27.069704 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e793d78a-f572-4362-acef-48c2dfe63cd1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:27.071073 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e793d78a-f572-4362-acef-48c2dfe63cd1 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:27.080068 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 385/778] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Jul 27 15:12:26 2022] GET /identity/v3/services => generated 772 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:27.080068 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14b2cd-bb57-479d-b7f3-a434334da1a2 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:27.080068 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14b2cd-bb57-479d-b7f3-a434334da1a2 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:27.080068 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14b2cd-bb57-479d-b7f3-a434334da1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:27.105966 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-8a14b2cd-bb57-479d-b7f3-a434334da1a2 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:27.107199 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8a14b2cd-bb57-479d-b7f3-a434334da1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:27.257603 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 386/779] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:12:27.275162 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ba8a28-ecfc-4db0-bee0-523076cea6b1 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:27.282944 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14b2cd-bb57-479d-b7f3-a434334da1a2 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:27.294287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:27.314707 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232a041-ba6a-4806-b68e-533b0d8e2d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:27.315360 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232a041-ba6a-4806-b68e-533b0d8e2d71 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:27.315645 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232a041-ba6a-4806-b68e-533b0d8e2d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:27.315923 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3232a041-ba6a-4806-b68e-533b0d8e2d71 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:27.316702 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3232a041-ba6a-4806-b68e-533b0d8e2d71 None admin] RBAC: Adding query filter params (type=network) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:27.317006 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3232a041-ba6a-4806-b68e-533b0d8e2d71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:27.318941 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3232a041-ba6a-4806-b68e-533b0d8e2d71 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:27.324349 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 394/780] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Jul 27 15:12:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:27.332948 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232a041-ba6a-4806-b68e-533b0d8e2d71 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:27.367621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:27.401724 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a14b2cd-bb57-479d-b7f3-a434334da1a2 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:27.438411 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654aa78-62a1-4606-b2e4-b7d11a2cc244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:27.439049 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654aa78-62a1-4606-b2e4-b7d11a2cc244 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:27.439331 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654aa78-62a1-4606-b2e4-b7d11a2cc244 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:27.439553 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3232a041-ba6a-4806-b68e-533b0d8e2d71 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:27.439661 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654aa78-62a1-4606-b2e4-b7d11a2cc244 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:27.451293 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8654aa78-62a1-4606-b2e4-b7d11a2cc244 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:12:27.456459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-8654aa78-62a1-4606-b2e4-b7d11a2cc244 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:12:27.456459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:27.456459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:27.456459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:27.456459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:27.456459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:27.456459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:27.456459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:27.456459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:27.456459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:27.456459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:27.456459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:27.456459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:12:27.456459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:12:27.456459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:12:27.456459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:12:27.457418 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:12:27.457418 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:12:27.457418 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:12:27.457418 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:12:27.457418 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:27.457418 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:27.457418 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:27.457418 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:27.457418 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:27.457418 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:27.457418 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:27.457418 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:27.457418 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:27.457418 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:27.457418 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:27.457418 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:27.458280 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:27.458280 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:27.458280 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:27.458280 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:27.458280 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:12:27.458280 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:12:27.458280 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:12:27.458280 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:12:27.458280 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:12:27.458280 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:12:27.458280 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:12:27.458280 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:27.458280 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 387/781] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jul 27 15:12:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:27.464264 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654aa78-62a1-4606-b2e4-b7d11a2cc244 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:27.476342 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da27a4d-6942-4b63-8e6e-71fbdb24651c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:27.476965 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da27a4d-6942-4b63-8e6e-71fbdb24651c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:27.477246 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da27a4d-6942-4b63-8e6e-71fbdb24651c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:27.477521 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da27a4d-6942-4b63-8e6e-71fbdb24651c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:27.478285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da27a4d-6942-4b63-8e6e-71fbdb24651c None admin] RBAC: Adding query filter params (interface=public, service_id=13f4b32bbcfc4a8892079cce12657e9a, region_id=RegionOne) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:27.478599 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da27a4d-6942-4b63-8e6e-71fbdb24651c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:27.480083 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da27a4d-6942-4b63-8e6e-71fbdb24651c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:27.493889 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 395/782] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Jul 27 15:12:27 2022] GET /identity/v3/endpoints?service_id=13f4b32bbcfc4a8892079cce12657e9a&interface=public®ion_id=RegionOne => generated 194 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:27.495118 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da27a4d-6942-4b63-8e6e-71fbdb24651c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:27.536476 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:27.581160 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654aa78-62a1-4606-b2e4-b7d11a2cc244 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:27.597378 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:27.603847 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da27a4d-6942-4b63-8e6e-71fbdb24651c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:27.624098 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ecebd-0529-4518-b263-134c822cba23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:27.624723 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ecebd-0529-4518-b263-134c822cba23 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:27.625001 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ecebd-0529-4518-b263-134c822cba23 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:27.625272 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ecebd-0529-4518-b263-134c822cba23 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:27.626095 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ecebd-0529-4518-b263-134c822cba23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:27.626403 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ecebd-0529-4518-b263-134c822cba23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:27.627768 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ecebd-0529-4518-b263-134c822cba23 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:27.640832 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 388/783] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:12:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:27.643038 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b27e0-77e6-4146-a429-fbbb27ab887c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:27.643664 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b27e0-77e6-4146-a429-fbbb27ab887c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:27.643951 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b27e0-77e6-4146-a429-fbbb27ab887c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:27.644259 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275b27e0-77e6-4146-a429-fbbb27ab887c None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:27.644926 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b27e0-77e6-4146-a429-fbbb27ab887c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:27.646703 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ecebd-0529-4518-b263-134c822cba23 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:27.646997 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275b27e0-77e6-4146-a429-fbbb27ab887c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:27.660179 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 396/784] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Jul 27 15:12:27 2022] GET /identity/v3/services => generated 772 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:27.766115 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ecebd-0529-4518-b263-134c822cba23 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:27.798746 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:27.807071 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff598f-e4be-4fd1-92dc-035224bec97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:27.807727 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff598f-e4be-4fd1-92dc-035224bec97f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:27.808030 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff598f-e4be-4fd1-92dc-035224bec97f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:27.808313 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff598f-e4be-4fd1-92dc-035224bec97f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:27.820892 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff598f-e4be-4fd1-92dc-035224bec97f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:27.822855 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff598f-e4be-4fd1-92dc-035224bec97f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:27.838812 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-b7ff598f-e4be-4fd1-92dc-035224bec97f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:27.838812 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:27.838812 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:27.838812 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:27.838812 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:27.838812 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:27.838812 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:27.838812 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:27.838812 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:27.838812 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:27.838812 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:27.838812 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:27.838812 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:27.838812 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:27.838812 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:27.840966 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:27.840966 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:27.840966 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:27.840966 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:27.840966 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:27.840966 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:27.840966 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:27.840966 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:27.840966 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:27.840966 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:27.840966 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:27.840966 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:27.840966 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:27.840966 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:27.840966 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:27.840966 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:27.840966 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:27.843106 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:27.843106 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:27.843106 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:27.843106 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:27.843106 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 389/785] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:12:27.853109 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b27e0-77e6-4146-a429-fbbb27ab887c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:27.963573 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275b27e0-77e6-4146-a429-fbbb27ab887c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:28.002291 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6e4a1-cd22-46b0-8db5-bb7d787b9b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:28.003208 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6e4a1-cd22-46b0-8db5-bb7d787b9b6f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:28.003668 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6e4a1-cd22-46b0-8db5-bb7d787b9b6f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:28.004146 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6e4a1-cd22-46b0-8db5-bb7d787b9b6f None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:28.005014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6e4a1-cd22-46b0-8db5-bb7d787b9b6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:28.005518 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6e4a1-cd22-46b0-8db5-bb7d787b9b6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:28.007677 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6e4a1-cd22-46b0-8db5-bb7d787b9b6f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:28.020736 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 397/786] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:28.027485 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff598f-e4be-4fd1-92dc-035224bec97f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:28.138850 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff598f-e4be-4fd1-92dc-035224bec97f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:28.175587 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7464e-38ae-4d0c-adb5-f40ee138f139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:28.176590 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7464e-38ae-4d0c-adb5-f40ee138f139 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:28.177052 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7464e-38ae-4d0c-adb5-f40ee138f139 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:28.177545 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7464e-38ae-4d0c-adb5-f40ee138f139 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:28.185964 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7464e-38ae-4d0c-adb5-f40ee138f139 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:28.187653 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7464e-38ae-4d0c-adb5-f40ee138f139 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:28.197218 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5c11d-a938-4222-b658-e3596a2cea43 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:28.197759 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5c11d-a938-4222-b658-e3596a2cea43 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:28.198209 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5c11d-a938-4222-b658-e3596a2cea43 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:28.199705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 398/787] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:12:28.204601 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75041216-ded9-4dcb-abbd-e8071d4c2dfb None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:28.205077 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75041216-ded9-4dcb-abbd-e8071d4c2dfb None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:28.205528 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75041216-ded9-4dcb-abbd-e8071d4c2dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:28.214065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-7ac7464e-38ae-4d0c-adb5-f40ee138f139 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 15:12:28.214065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:28.214065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:28.214065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:28.214065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:28.214065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:28.214065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:28.214065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:28.214065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:28.214065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:28.214065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:28.214065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:28.214065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:12:28.214065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:12:28.214065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:12:28.214065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:12:28.215017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:28.215017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:28.215017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:12:28.215017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:28.215017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:12:28.215017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:28.215017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:28.215017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:28.215017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:28.215017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:28.215017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:28.215017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:28.215017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:28.215017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:28.215017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:28.215017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:28.215017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:28.215017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:28.215956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:28.215956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:28.215956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:12:28.215956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:12:28.215956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:12:28.215956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:12:28.215956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:12:28.215956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:12:28.215956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 15:12:28.215956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:28.223138 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 390/788] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jul 27 15:12:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:12:28.229154 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7464e-38ae-4d0c-adb5-f40ee138f139 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:28.241049 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-75041216-ded9-4dcb-abbd-e8071d4c2dfb None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:28.242292 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-75041216-ded9-4dcb-abbd-e8071d4c2dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:28.261819 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:28.284250 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:28.323011 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 399/789] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:12:28.324317 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ea724-915d-411d-b100-30379a12b771 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:28.324643 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ea724-915d-411d-b100-30379a12b771 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:28.325116 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ea724-915d-411d-b100-30379a12b771 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:28.330272 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 400/790] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:28.332127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4887074-cf59-4198-91a3-ea3c8b2336af None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:28.332344 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4887074-cf59-4198-91a3-ea3c8b2336af None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:28.332619 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4887074-cf59-4198-91a3-ea3c8b2336af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:28.348431 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7464e-38ae-4d0c-adb5-f40ee138f139 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:28.352685 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f4887074-cf59-4198-91a3-ea3c8b2336af None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:28.353876 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f4887074-cf59-4198-91a3-ea3c8b2336af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:28.386408 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a0964-fcb9-4ea8-9f57-b76817b18e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:28.387285 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a0964-fcb9-4ea8-9f57-b76817b18e93 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:28.387717 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a0964-fcb9-4ea8-9f57-b76817b18e93 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:28.388171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a0964-fcb9-4ea8-9f57-b76817b18e93 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:28.389332 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a0964-fcb9-4ea8-9f57-b76817b18e93 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:28.389897 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a0964-fcb9-4ea8-9f57-b76817b18e93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:28.391488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a0964-fcb9-4ea8-9f57-b76817b18e93 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:28.411397 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 391/791] 10.222.0.40 () {56 vars in 1135 bytes} [Wed Jul 27 15:12:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:28.413109 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a0964-fcb9-4ea8-9f57-b76817b18e93 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:28.452100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 401/792] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:12:28.453011 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4887074-cf59-4198-91a3-ea3c8b2336af None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:28.518561 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a0964-fcb9-4ea8-9f57-b76817b18e93 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:28.522360 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:28.550842 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:28.558156 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf97f7-36d7-4f02-a331-9b2bd93afdbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:28.559105 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf97f7-36d7-4f02-a331-9b2bd93afdbd None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:28.559572 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf97f7-36d7-4f02-a331-9b2bd93afdbd None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:28.560066 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addf97f7-36d7-4f02-a331-9b2bd93afdbd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:28.570689 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4887074-cf59-4198-91a3-ea3c8b2336af None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:28.571464 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addf97f7-36d7-4f02-a331-9b2bd93afdbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:12:28.582378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-addf97f7-36d7-4f02-a331-9b2bd93afdbd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:12:28.582378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:28.582378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:28.582378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:28.582378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:28.582378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:28.582378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:28.582378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:28.582378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:28.582378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:28.582378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:28.582378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:28.582378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:12:28.582378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:12:28.582378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:12:28.582378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:12:28.583374 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:12:28.583374 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:12:28.583374 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:12:28.583374 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:12:28.583374 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:28.583374 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:28.583374 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:28.583374 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:28.583374 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:28.583374 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:28.583374 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:28.583374 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:28.583374 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:28.583374 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:28.583374 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:28.583374 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:28.585136 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:28.585136 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:28.585136 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:28.585136 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:28.585136 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:12:28.585136 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:12:28.585136 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:12:28.585136 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:12:28.585136 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:12:28.585136 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:12:28.585136 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:12:28.585136 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:28.587617 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 392/793] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jul 27 15:12:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:28.588590 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf97f7-36d7-4f02-a331-9b2bd93afdbd None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:28.612621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c339e-62b7-4f9d-9b2b-b9607ab4a7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:28.613572 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c339e-62b7-4f9d-9b2b-b9607ab4a7fe None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:28.613572 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c339e-62b7-4f9d-9b2b-b9607ab4a7fe None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:28.613802 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908c339e-62b7-4f9d-9b2b-b9607ab4a7fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:28.624491 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c339e-62b7-4f9d-9b2b-b9607ab4a7fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:28.625938 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908c339e-62b7-4f9d-9b2b-b9607ab4a7fe None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:28.641445 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-908c339e-62b7-4f9d-9b2b-b9607ab4a7fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:28.641445 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:28.641445 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:28.641445 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:28.641445 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:28.641445 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:28.641445 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:28.641445 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:28.641445 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:28.641445 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:28.641445 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:28.641445 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:28.641445 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:28.641445 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:28.641445 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:28.642321 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:28.642321 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:28.642321 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:28.642321 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:28.642321 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:28.642321 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:28.642321 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:28.642321 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:28.642321 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:28.642321 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:28.642321 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:28.642321 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:28.642321 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:28.642321 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:28.642321 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:28.642321 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:28.642321 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:28.643661 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:28.643661 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:28.643661 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:28.643661 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:28.647723 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 402/794] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:28.648613 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c339e-62b7-4f9d-9b2b-b9607ab4a7fe None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:28.701668 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addf97f7-36d7-4f02-a331-9b2bd93afdbd None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:28.742788 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0b8c3-6b14-4cd9-ba68-d9ca3eb98a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:28.743907 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0b8c3-6b14-4cd9-ba68-d9ca3eb98a59 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:28.744441 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0b8c3-6b14-4cd9-ba68-d9ca3eb98a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:28.744988 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b0b8c3-6b14-4cd9-ba68-d9ca3eb98a59 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:28.756712 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b0b8c3-6b14-4cd9-ba68-d9ca3eb98a59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:12:28.759843 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908c339e-62b7-4f9d-9b2b-b9607ab4a7fe None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:28.763380 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-c0b0b8c3-6b14-4cd9-ba68-d9ca3eb98a59 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:12:28.763380 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:28.763380 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:28.763380 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:28.763380 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:28.763380 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:28.763380 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:28.763380 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:28.763380 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:28.763380 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:28.763380 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:28.763380 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:28.763380 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:12:28.763380 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:12:28.763380 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:12:28.763380 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:12:28.764541 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:12:28.764541 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:12:28.764541 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:12:28.764541 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:12:28.764541 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:28.764541 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:28.764541 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:28.764541 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:28.764541 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:28.764541 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:28.764541 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:28.764541 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:28.764541 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:28.764541 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:28.764541 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:28.764541 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:28.765787 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:28.765787 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:28.765787 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:28.765787 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:28.765787 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:12:28.765787 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:12:28.765787 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:12:28.765787 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:12:28.765787 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:12:28.765787 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:12:28.765787 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:12:28.765787 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:28.768727 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 393/795] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jul 27 15:12:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:28.769813 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0b8c3-6b14-4cd9-ba68-d9ca3eb98a59 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:28.796819 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:28.803887 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276a0dc-1557-4bfc-a55d-8c71b8833303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:28.804706 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276a0dc-1557-4bfc-a55d-8c71b8833303 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:28.805197 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276a0dc-1557-4bfc-a55d-8c71b8833303 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:28.805651 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276a0dc-1557-4bfc-a55d-8c71b8833303 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:28.806545 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2276a0dc-1557-4bfc-a55d-8c71b8833303 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:28.807032 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2276a0dc-1557-4bfc-a55d-8c71b8833303 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:28.808593 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2276a0dc-1557-4bfc-a55d-8c71b8833303 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:28.818021 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 403/796] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:12:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:28.819208 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276a0dc-1557-4bfc-a55d-8c71b8833303 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:28.852426 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:28.878659 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b0b8c3-6b14-4cd9-ba68-d9ca3eb98a59 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:28.916009 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb193a1-7196-466c-b8f7-ac5f003f6e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:28.916662 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb193a1-7196-466c-b8f7-ac5f003f6e54 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:28.917103 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb193a1-7196-466c-b8f7-ac5f003f6e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:28.917353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb193a1-7196-466c-b8f7-ac5f003f6e54 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:28.918118 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb193a1-7196-466c-b8f7-ac5f003f6e54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:28.918491 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb193a1-7196-466c-b8f7-ac5f003f6e54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:28.920127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb193a1-7196-466c-b8f7-ac5f003f6e54 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:28.922942 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276a0dc-1557-4bfc-a55d-8c71b8833303 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:28.936961 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 394/797] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:28.936961 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb193a1-7196-466c-b8f7-ac5f003f6e54 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:28.963905 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6589b4-ede5-48f0-b00b-8aac83555a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:28.964809 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6589b4-ede5-48f0-b00b-8aac83555a96 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:28.965243 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6589b4-ede5-48f0-b00b-8aac83555a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:28.965666 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6589b4-ede5-48f0-b00b-8aac83555a96 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:28.966523 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6589b4-ede5-48f0-b00b-8aac83555a96 None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:28.967024 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6589b4-ede5-48f0-b00b-8aac83555a96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:28.968579 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6589b4-ede5-48f0-b00b-8aac83555a96 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:28.982089 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 404/798] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jul 27 15:12:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:28.983171 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6589b4-ede5-48f0-b00b-8aac83555a96 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:29.039878 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb193a1-7196-466c-b8f7-ac5f003f6e54 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:29.041593 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:29.060418 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:29.078752 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf5e3f-6f32-4acd-a961-a7370cf524b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:29.079495 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf5e3f-6f32-4acd-a961-a7370cf524b3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:29.079784 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf5e3f-6f32-4acd-a961-a7370cf524b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:29.080116 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf5e3f-6f32-4acd-a961-a7370cf524b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:29.092566 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf5e3f-6f32-4acd-a961-a7370cf524b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:29.094128 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf5e3f-6f32-4acd-a961-a7370cf524b3 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:29.096551 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6589b4-ede5-48f0-b00b-8aac83555a96 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:29.109995 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-c7bf5e3f-6f32-4acd-a961-a7370cf524b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:29.109995 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:29.109995 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:29.109995 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:29.109995 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:29.109995 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:29.109995 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:29.109995 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:29.109995 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:29.109995 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:29.109995 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:29.109995 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:29.109995 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:29.109995 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:29.109995 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:29.110976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:29.110976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:29.110976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:29.110976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:29.110976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:29.110976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:29.110976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:29.110976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:29.110976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:29.110976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:29.110976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:29.110976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:29.110976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:29.110976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:29.110976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:29.110976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:29.110976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:29.111878 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:29.111878 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:29.111878 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:29.111878 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:29.116173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 395/799] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:29.117314 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf5e3f-6f32-4acd-a961-a7370cf524b3 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:29.137902 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efb96a-e0cc-4101-b978-4ad6238e6488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:29.138919 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efb96a-e0cc-4101-b978-4ad6238e6488 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:29.139407 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efb96a-e0cc-4101-b978-4ad6238e6488 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:29.139981 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87efb96a-e0cc-4101-b978-4ad6238e6488 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:29.147805 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87efb96a-e0cc-4101-b978-4ad6238e6488 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:29.149516 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87efb96a-e0cc-4101-b978-4ad6238e6488 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:29.165476 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-87efb96a-e0cc-4101-b978-4ad6238e6488 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:29.165476 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:29.165476 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:29.165476 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:29.165476 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:29.165476 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:29.165476 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:29.165476 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:29.165476 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:29.165476 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:29.165476 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:29.165476 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:29.165476 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:12:29.165476 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:12:29.165476 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:12:29.166489 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:12:29.166489 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:29.166489 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:29.166489 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:29.166489 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:29.166489 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:29.166489 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:29.166489 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:29.166489 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:29.166489 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:29.166489 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:29.166489 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:29.166489 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:29.166489 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:29.166489 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:29.166489 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:29.166489 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:29.167417 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:12:29.167417 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:12:29.167417 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:12:29.167417 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:12:29.167417 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:12:29.167417 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:12:29.167417 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:29.167417 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:29.174573 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 405/800] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:12:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:29.174573 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efb96a-e0cc-4101-b978-4ad6238e6488 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:29.230895 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf5e3f-6f32-4acd-a961-a7370cf524b3 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:29.262784 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:29.266699 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81a4e6-3de0-49f3-85af-f87844673b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:29.267343 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81a4e6-3de0-49f3-85af-f87844673b7e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:29.267624 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81a4e6-3de0-49f3-85af-f87844673b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:29.267902 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a81a4e6-3de0-49f3-85af-f87844673b7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:29.280454 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81a4e6-3de0-49f3-85af-f87844673b7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:29.282065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a81a4e6-3de0-49f3-85af-f87844673b7e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:29.300734 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-2a81a4e6-3de0-49f3-85af-f87844673b7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:29.300734 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:29.300734 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:29.300734 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:29.300734 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:29.300734 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:29.300734 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:29.300734 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:29.300734 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:29.300734 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:29.300734 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:29.300734 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:29.300734 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:29.300734 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:29.300734 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:29.301679 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:29.301679 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:29.301679 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:29.301679 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:29.301679 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:29.301679 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:29.301679 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:29.301679 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:29.301679 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:29.301679 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:29.301679 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:29.301679 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:29.301679 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:29.301679 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:29.301679 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:29.301679 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:29.301679 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:29.302656 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:29.302656 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:29.302656 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:29.302656 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:29.302656 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 396/801] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:29.302656 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81a4e6-3de0-49f3-85af-f87844673b7e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:29.309718 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87efb96a-e0cc-4101-b978-4ad6238e6488 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:29.333622 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:29.358619 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e95e1e-5236-486f-8539-728578ab7d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:29.359934 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e95e1e-5236-486f-8539-728578ab7d6e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:29.360726 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e95e1e-5236-486f-8539-728578ab7d6e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:29.361211 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e95e1e-5236-486f-8539-728578ab7d6e None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:29.362291 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e95e1e-5236-486f-8539-728578ab7d6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:29.363086 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e95e1e-5236-486f-8539-728578ab7d6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:29.364693 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e95e1e-5236-486f-8539-728578ab7d6e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:29.381221 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 406/802] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:29.382456 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e95e1e-5236-486f-8539-728578ab7d6e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:29.430608 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a81a4e6-3de0-49f3-85af-f87844673b7e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:29.477080 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094578bf-67ec-4153-9cef-f808e2b16f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:29.478409 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094578bf-67ec-4153-9cef-f808e2b16f9c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:29.478965 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094578bf-67ec-4153-9cef-f808e2b16f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:29.479446 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094578bf-67ec-4153-9cef-f808e2b16f9c None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:29.480887 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094578bf-67ec-4153-9cef-f808e2b16f9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:29.481458 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094578bf-67ec-4153-9cef-f808e2b16f9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:29.483529 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094578bf-67ec-4153-9cef-f808e2b16f9c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:29.492845 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e95e1e-5236-486f-8539-728578ab7d6e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:29.509405 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 397/803] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jul 27 15:12:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:29.509405 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094578bf-67ec-4153-9cef-f808e2b16f9c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:29.543771 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b94651-f117-4e26-a031-399ce654bba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:29.544416 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b94651-f117-4e26-a031-399ce654bba6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:29.544701 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b94651-f117-4e26-a031-399ce654bba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:29.544976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b94651-f117-4e26-a031-399ce654bba6 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:29.545665 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b94651-f117-4e26-a031-399ce654bba6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:29.545971 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b94651-f117-4e26-a031-399ce654bba6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:29.547319 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b94651-f117-4e26-a031-399ce654bba6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:29.564125 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 407/804] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:29.564125 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b94651-f117-4e26-a031-399ce654bba6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:29.579582 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:29.610661 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:29.655636 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094578bf-67ec-4153-9cef-f808e2b16f9c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:29.687181 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b94651-f117-4e26-a031-399ce654bba6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:29.701612 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1376fc-d64c-40d9-bffc-46a12791f161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:29.702451 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1376fc-d64c-40d9-bffc-46a12791f161 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:29.702885 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1376fc-d64c-40d9-bffc-46a12791f161 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:29.703324 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1376fc-d64c-40d9-bffc-46a12791f161 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:29.711567 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1376fc-d64c-40d9-bffc-46a12791f161 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:29.713241 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1376fc-d64c-40d9-bffc-46a12791f161 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:29.723309 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb9ef8-b315-4f21-b7e2-01107e52d89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:29.723971 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb9ef8-b315-4f21-b7e2-01107e52d89c None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:29.724276 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb9ef8-b315-4f21-b7e2-01107e52d89c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:29.724582 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb9ef8-b315-4f21-b7e2-01107e52d89c None admin] PATH_INFO: `/v3/projects/0b616213eaea4a22afee15d4cbe5a3c5/users/68bbf8bb59a84829afacd9677c9639a6/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:29.725488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-cc1376fc-d64c-40d9-bffc-46a12791f161 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 15:12:29.725488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:29.725488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:29.725488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:29.725488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:29.725488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:29.725488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:29.725488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:29.725488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:29.725488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:29.725488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:29.725488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:29.725488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:12:29.725488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:12:29.725488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:12:29.725488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:12:29.726387 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:29.726387 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:29.726387 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:12:29.726387 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:29.726387 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:12:29.726387 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:29.726387 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:29.726387 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:29.726387 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:29.726387 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:29.726387 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:29.726387 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:29.726387 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:29.726387 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:29.726387 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:29.726387 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:29.726387 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:29.726387 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:29.727353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:29.727353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:29.727353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:12:29.727353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:12:29.727353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:12:29.727353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:12:29.727353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:12:29.727353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:12:29.727353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 15:12:29.727353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:29.727353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 398/805] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Jul 27 15:12:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:29.728654 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1376fc-d64c-40d9-bffc-46a12791f161 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:29.731766 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb9ef8-b315-4f21-b7e2-01107e52d89c None admin] RBAC: Authorizing `identity:create_grant(project_id=0b616213eaea4a22afee15d4cbe5a3c5, user_id=68bbf8bb59a84829afacd9677c9639a6, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:29.733221 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb9ef8-b315-4f21-b7e2-01107e52d89c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:29.752242 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 408/806] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jul 27 15:12:29 2022] PUT /identity/v3/projects/0b616213eaea4a22afee15d4cbe5a3c5/users/68bbf8bb59a84829afacd9677c9639a6/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:12:29.753967 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f4db4-f7d2-43dc-8081-38379acf049c None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:29.754472 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f4db4-f7d2-43dc-8081-38379acf049c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:29.754930 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f4db4-f7d2-43dc-8081-38379acf049c None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:29.762339 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 409/807] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:29.762339 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f4db4-f7d2-43dc-8081-38379acf049c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:29.850627 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1376fc-d64c-40d9-bffc-46a12791f161 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:29.854005 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:29.902646 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba947d6e-bdd4-4016-8b0c-cabaa0454665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:29.903426 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba947d6e-bdd4-4016-8b0c-cabaa0454665 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:29.903710 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba947d6e-bdd4-4016-8b0c-cabaa0454665 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:29.904244 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba947d6e-bdd4-4016-8b0c-cabaa0454665 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:29.905515 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:29.915857 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f4db4-f7d2-43dc-8081-38379acf049c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:29.916395 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba947d6e-bdd4-4016-8b0c-cabaa0454665 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:29.917866 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba947d6e-bdd4-4016-8b0c-cabaa0454665 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:29.931853 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-ba947d6e-bdd4-4016-8b0c-cabaa0454665 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 15:12:29.931853 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:29.931853 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:29.931853 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:29.931853 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:29.931853 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:29.931853 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:29.931853 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:29.931853 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:29.931853 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:29.931853 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:29.931853 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:29.931853 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:12:29.931853 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:12:29.931853 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:12:29.931853 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:12:29.932880 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:29.932880 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:29.932880 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:12:29.932880 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:29.932880 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:12:29.932880 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:29.932880 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:29.932880 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:29.932880 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:29.932880 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:29.932880 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:29.932880 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:29.932880 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:29.932880 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:29.932880 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:29.932880 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:29.932880 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:29.932880 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:29.933823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:29.933823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:29.933823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:12:29.933823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:12:29.933823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:12:29.933823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:12:29.933823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:12:29.933823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:12:29.933823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 15:12:29.933823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:29.933823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 399/808] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Jul 27 15:12:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:29.934475 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a8840-e2e1-48b3-a756-48f22308a53c None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:29.934557 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a8840-e2e1-48b3-a756-48f22308a53c None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:29.934795 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520a8840-e2e1-48b3-a756-48f22308a53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:29.956047 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-520a8840-e2e1-48b3-a756-48f22308a53c None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:29.957173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-520a8840-e2e1-48b3-a756-48f22308a53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:29.960950 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae992f3b-3da3-4cf0-8b47-eb3f24a505ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:29.961572 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae992f3b-3da3-4cf0-8b47-eb3f24a505ed None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:29.961860 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae992f3b-3da3-4cf0-8b47-eb3f24a505ed None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:29.962133 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae992f3b-3da3-4cf0-8b47-eb3f24a505ed None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:29.962929 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae992f3b-3da3-4cf0-8b47-eb3f24a505ed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:29.963236 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae992f3b-3da3-4cf0-8b47-eb3f24a505ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:29.964678 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae992f3b-3da3-4cf0-8b47-eb3f24a505ed None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:29.991849 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 410/809] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Jul 27 15:12:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:29.992801 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae992f3b-3da3-4cf0-8b47-eb3f24a505ed None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:30.036493 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 400/810] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:12:30.037395 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a8840-e2e1-48b3-a756-48f22308a53c None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:30.112522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae992f3b-3da3-4cf0-8b47-eb3f24a505ed None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:30.148734 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:30.149067 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28721c4-45c6-42b2-8ab5-cae52aa7656e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:30.149767 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28721c4-45c6-42b2-8ab5-cae52aa7656e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:30.150415 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28721c4-45c6-42b2-8ab5-cae52aa7656e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:30.150711 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28721c4-45c6-42b2-8ab5-cae52aa7656e None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:30.151587 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28721c4-45c6-42b2-8ab5-cae52aa7656e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:30.151936 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28721c4-45c6-42b2-8ab5-cae52aa7656e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:30.153475 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28721c4-45c6-42b2-8ab5-cae52aa7656e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:30.156702 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520a8840-e2e1-48b3-a756-48f22308a53c None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:30.176666 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 411/811] 10.222.0.40 () {56 vars in 1149 bytes} [Wed Jul 27 15:12:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:30.176666 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30951b9f-c8d9-40e2-b675-3c1d8f611a43 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:30.176666 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30951b9f-c8d9-40e2-b675-3c1d8f611a43 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:30.176666 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30951b9f-c8d9-40e2-b675-3c1d8f611a43 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:30.176666 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 412/812] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:30.176666 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30951b9f-c8d9-40e2-b675-3c1d8f611a43 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:30.193156 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:30.200289 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a725b586-f5fb-4722-a727-dae4b6dbba5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:30.200915 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725b586-f5fb-4722-a727-dae4b6dbba5f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:30.201626 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725b586-f5fb-4722-a727-dae4b6dbba5f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:30.201917 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a725b586-f5fb-4722-a727-dae4b6dbba5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:30.277132 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725b586-f5fb-4722-a727-dae4b6dbba5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:30.278948 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a725b586-f5fb-4722-a727-dae4b6dbba5f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:30.285967 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30951b9f-c8d9-40e2-b675-3c1d8f611a43 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:30.321005 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff3c44-561c-4c70-baeb-1845a0c4bd8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:30.322045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff3c44-561c-4c70-baeb-1845a0c4bd8b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:30.322325 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff3c44-561c-4c70-baeb-1845a0c4bd8b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:30.322596 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff3c44-561c-4c70-baeb-1845a0c4bd8b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:30.323569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff3c44-561c-4c70-baeb-1845a0c4bd8b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:30.325283 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ff3c44-561c-4c70-baeb-1845a0c4bd8b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:30.334621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-b4ff3c44-561c-4c70-baeb-1845a0c4bd8b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 15:12:30.334621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:30.334621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 15:12:30.334621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 15:12:30.334621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 15:12:30.334621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 15:12:30.334621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 15:12:30.334621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:30.334621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 15:12:30.334621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:30.334621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 15:12:30.334621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:30.334621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:30.334621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:30.334621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:30.334621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:30.335734 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:30.335734 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:30.335734 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:30.335734 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:30.335734 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:30.335734 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:30.335734 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:30.335734 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 15:12:30.335734 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 15:12:30.335734 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 15:12:30.335734 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 15:12:30.335734 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:30.335734 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:30.335734 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:30.335734 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:30.335734 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:30.336807 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:30.336807 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:30.336807 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:30.336807 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:30.336807 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:30.336807 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:30.336807 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:30.336807 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:30.336807 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:30.336807 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:30.336807 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:30.336807 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 15:12:30.336807 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:30.336807 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 15:12:30.336807 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:30.340590 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 413/813] 10.222.0.40 () {56 vars in 1129 bytes} [Wed Jul 27 15:12:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:30.341389 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff3c44-561c-4c70-baeb-1845a0c4bd8b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:30.381032 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:30.389754 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 401/814] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:12:30 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 15:12:30.395365 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10bf5d-fcb2-4d06-b6ee-5e73be883523 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:30.395651 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10bf5d-fcb2-4d06-b6ee-5e73be883523 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:30.395922 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10bf5d-fcb2-4d06-b6ee-5e73be883523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:30.413557 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-5b10bf5d-fcb2-4d06-b6ee-5e73be883523 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:30.414976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5b10bf5d-fcb2-4d06-b6ee-5e73be883523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:30.421811 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:30.446283 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff3c44-561c-4c70-baeb-1845a0c4bd8b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:30.480717 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3265e8a-552f-4d90-8759-b7e79aa6a05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:30.481345 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3265e8a-552f-4d90-8759-b7e79aa6a05a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:30.481621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3265e8a-552f-4d90-8759-b7e79aa6a05a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:30.481889 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3265e8a-552f-4d90-8759-b7e79aa6a05a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:30.492016 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 402/815] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:12:30.492016 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10bf5d-fcb2-4d06-b6ee-5e73be883523 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:30.503007 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3265e8a-552f-4d90-8759-b7e79aa6a05a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:30.504642 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3265e8a-552f-4d90-8759-b7e79aa6a05a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:30.520303 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-d3265e8a-552f-4d90-8759-b7e79aa6a05a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:30.520303 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:30.520303 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:30.520303 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:30.520303 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:30.520303 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:30.520303 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:30.520303 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:30.520303 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:30.520303 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:30.520303 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:30.520303 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:30.520303 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:30.520303 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:30.520303 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:30.521869 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:30.521869 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:30.521869 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:30.521869 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:30.521869 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:30.521869 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:30.521869 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:30.521869 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:30.521869 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:30.521869 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:30.521869 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:30.521869 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:30.521869 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:30.521869 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:30.521869 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:30.521869 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:30.521869 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:30.522768 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:30.522768 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:30.522768 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:30.522768 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:30.522768 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 414/816] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:30.522768 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3265e8a-552f-4d90-8759-b7e79aa6a05a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:30.600989 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10bf5d-fcb2-4d06-b6ee-5e73be883523 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:30.625132 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:30.637674 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a7608-7582-4e25-91b8-3631c535a0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:30.638459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a7608-7582-4e25-91b8-3631c535a0ca None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:30.638646 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3265e8a-552f-4d90-8759-b7e79aa6a05a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:30.639044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a7608-7582-4e25-91b8-3631c535a0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:30.639457 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495a7608-7582-4e25-91b8-3631c535a0ca None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:30.640413 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a7608-7582-4e25-91b8-3631c535a0ca None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:30.640971 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a7608-7582-4e25-91b8-3631c535a0ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:30.642333 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495a7608-7582-4e25-91b8-3631c535a0ca None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:30.651888 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 403/817] 10.222.0.40 () {56 vars in 1124 bytes} [Wed Jul 27 15:12:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:30.651888 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a7608-7582-4e25-91b8-3631c535a0ca None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:30.671518 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:30.679899 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e005483-5c23-4817-957a-b0df4df2fb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:30.680753 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e005483-5c23-4817-957a-b0df4df2fb73 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:30.680864 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e005483-5c23-4817-957a-b0df4df2fb73 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:30.681079 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e005483-5c23-4817-957a-b0df4df2fb73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:30.692693 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e005483-5c23-4817-957a-b0df4df2fb73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:30.694735 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e005483-5c23-4817-957a-b0df4df2fb73 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:30.710097 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-9e005483-5c23-4817-957a-b0df4df2fb73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:30.710097 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:30.710097 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:30.710097 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:30.710097 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:30.710097 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:30.710097 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:30.710097 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:30.710097 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:30.710097 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:30.710097 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:30.710097 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:30.710097 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:30.710097 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:30.710097 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:30.710975 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:30.710975 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:30.710975 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:30.710975 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:30.710975 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:30.710975 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:30.710975 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:30.710975 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:30.710975 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:30.710975 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:30.710975 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:30.710975 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:30.710975 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:30.710975 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:30.710975 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:30.710975 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:30.710975 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:30.711862 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:30.711862 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:30.711862 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:30.711862 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:30.711862 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 415/818] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:30.712627 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e005483-5c23-4817-957a-b0df4df2fb73 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:30.759061 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495a7608-7582-4e25-91b8-3631c535a0ca None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:30.794236 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05305e82-06f4-4a2f-8ec3-b22e1697aebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:30.795042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05305e82-06f4-4a2f-8ec3-b22e1697aebd None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:30.795330 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05305e82-06f4-4a2f-8ec3-b22e1697aebd None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:30.795606 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05305e82-06f4-4a2f-8ec3-b22e1697aebd None admin] PATH_INFO: `/v3/services/network` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:30.796263 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05305e82-06f4-4a2f-8ec3-b22e1697aebd None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:30.797630 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05305e82-06f4-4a2f-8ec3-b22e1697aebd None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:30.807516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-05305e82-06f4-4a2f-8ec3-b22e1697aebd None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 15:12:30.807516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:30.807516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 15:12:30.807516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 15:12:30.807516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 15:12:30.807516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 15:12:30.807516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 15:12:30.807516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:30.807516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 15:12:30.807516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:30.807516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 15:12:30.807516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:30.807516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:30.807516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:30.807516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:30.807516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:30.807516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:30.808589 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:30.808589 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:30.808589 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:30.808589 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:30.808589 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:30.808589 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:30.808589 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 15:12:30.808589 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 15:12:30.808589 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 15:12:30.808589 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 15:12:30.808589 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:30.808589 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:30.808589 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:30.808589 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:30.808589 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:30.808589 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:30.809428 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:30.809428 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:30.809428 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:30.809428 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:30.809428 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:30.809428 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:30.809428 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:30.809428 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:30.809428 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:30.809428 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:30.809428 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 15:12:30.809428 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:30.809428 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 15:12:30.809428 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:30.809428 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 404/819] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:12:30 2022] GET /identity/v3/services/network => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:30.810216 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05305e82-06f4-4a2f-8ec3-b22e1697aebd None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:30.819610 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e005483-5c23-4817-957a-b0df4df2fb73 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:30.855762 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583ca2f-625d-41f9-bba3-22a3b74ab68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:30.856444 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583ca2f-625d-41f9-bba3-22a3b74ab68d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:30.856723 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583ca2f-625d-41f9-bba3-22a3b74ab68d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:30.856991 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a583ca2f-625d-41f9-bba3-22a3b74ab68d None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:30.857679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a583ca2f-625d-41f9-bba3-22a3b74ab68d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:30.857986 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a583ca2f-625d-41f9-bba3-22a3b74ab68d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:30.859615 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a583ca2f-625d-41f9-bba3-22a3b74ab68d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:30.868339 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:30.877339 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 416/820] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:30.877339 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583ca2f-625d-41f9-bba3-22a3b74ab68d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:30.920144 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:30.924072 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05305e82-06f4-4a2f-8ec3-b22e1697aebd None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:30.960831 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135aec0-5383-4236-b99c-1ebf164661d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:30.961441 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135aec0-5383-4236-b99c-1ebf164661d1 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:30.961720 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135aec0-5383-4236-b99c-1ebf164661d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:30.961992 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135aec0-5383-4236-b99c-1ebf164661d1 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:30.962673 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135aec0-5383-4236-b99c-1ebf164661d1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:30.962972 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135aec0-5383-4236-b99c-1ebf164661d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:30.964463 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8135aec0-5383-4236-b99c-1ebf164661d1 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:30.973780 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 405/821] 10.222.0.40 () {56 vars in 1124 bytes} [Wed Jul 27 15:12:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:30.973780 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135aec0-5383-4236-b99c-1ebf164661d1 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:30.987878 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a583ca2f-625d-41f9-bba3-22a3b74ab68d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:31.024974 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a269c-0423-4d7c-92bb-30fac608622f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:31.025584 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a269c-0423-4d7c-92bb-30fac608622f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:31.025865 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a269c-0423-4d7c-92bb-30fac608622f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:31.026142 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a269c-0423-4d7c-92bb-30fac608622f None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:31.026864 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a269c-0423-4d7c-92bb-30fac608622f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:31.027166 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a269c-0423-4d7c-92bb-30fac608622f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:31.028588 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1a269c-0423-4d7c-92bb-30fac608622f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:31.041648 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 417/822] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:31.042258 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a269c-0423-4d7c-92bb-30fac608622f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:31.093566 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135aec0-5383-4236-b99c-1ebf164661d1 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:31.110335 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:31.128487 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef8951-1500-4a3f-8b81-7e6bb704016a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:31.129243 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef8951-1500-4a3f-8b81-7e6bb704016a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:31.129620 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef8951-1500-4a3f-8b81-7e6bb704016a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:31.129985 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ef8951-1500-4a3f-8b81-7e6bb704016a None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:31.131245 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef8951-1500-4a3f-8b81-7e6bb704016a None admin] RBAC: Adding query filter params (name=network) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:31.131644 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef8951-1500-4a3f-8b81-7e6bb704016a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:31.133138 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ef8951-1500-4a3f-8b81-7e6bb704016a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:31.137859 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 406/823] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Jul 27 15:12:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:31.138625 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef8951-1500-4a3f-8b81-7e6bb704016a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:31.148965 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:31.152161 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a269c-0423-4d7c-92bb-30fac608622f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:31.189851 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfeb87f-54f7-464a-a0a2-593ec7789128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:31.190475 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfeb87f-54f7-464a-a0a2-593ec7789128 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:31.190754 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfeb87f-54f7-464a-a0a2-593ec7789128 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:31.191024 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfeb87f-54f7-464a-a0a2-593ec7789128 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:31.198072 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfeb87f-54f7-464a-a0a2-593ec7789128 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:31.199484 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfeb87f-54f7-464a-a0a2-593ec7789128 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:31.212084 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-bcfeb87f-54f7-464a-a0a2-593ec7789128 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:31.212084 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:31.212084 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:31.212084 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:31.212084 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:31.212084 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:31.212084 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:31.212084 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:31.212084 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:31.212084 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:31.212084 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:31.212084 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:31.212084 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:12:31.212084 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:12:31.212084 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:12:31.212972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:12:31.212972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:31.212972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:31.212972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:31.212972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:31.212972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:31.212972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:31.212972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:31.212972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:31.212972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:31.212972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:31.212972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:31.212972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:31.212972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:31.212972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:31.212972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:31.212972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:31.213915 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:12:31.213915 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:12:31.213915 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:12:31.213915 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:12:31.213915 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:12:31.213915 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:12:31.213915 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:31.213915 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:31.213915 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 418/824] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:12:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:31.214878 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfeb87f-54f7-464a-a0a2-593ec7789128 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:31.253264 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ef8951-1500-4a3f-8b81-7e6bb704016a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:31.288362 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24358e8e-c88d-4a9e-bcab-3a35d410b28b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:31.289232 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24358e8e-c88d-4a9e-bcab-3a35d410b28b None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:31.289516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24358e8e-c88d-4a9e-bcab-3a35d410b28b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:31.289790 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24358e8e-c88d-4a9e-bcab-3a35d410b28b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:31.290508 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24358e8e-c88d-4a9e-bcab-3a35d410b28b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:31.291871 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24358e8e-c88d-4a9e-bcab-3a35d410b28b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:31.316395 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 407/825] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:12:31 2022] POST /identity/v3/endpoints => generated 346 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:12:31.317207 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24358e8e-c88d-4a9e-bcab-3a35d410b28b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:31.339415 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfeb87f-54f7-464a-a0a2-593ec7789128 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:31.358819 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:31.408997 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c0459-c817-4c66-ba7f-cad3029a6e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:31.410297 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c0459-c817-4c66-ba7f-cad3029a6e38 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:31.410745 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c0459-c817-4c66-ba7f-cad3029a6e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:31.411492 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c0459-c817-4c66-ba7f-cad3029a6e38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:31.421819 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c0459-c817-4c66-ba7f-cad3029a6e38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:31.424295 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c0459-c817-4c66-ba7f-cad3029a6e38 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:31.437088 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24358e8e-c88d-4a9e-bcab-3a35d410b28b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:31.441100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-b80c0459-c817-4c66-ba7f-cad3029a6e38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:31.441100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:31.441100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:31.441100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:31.441100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:31.441100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:31.441100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:31.441100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:31.441100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:31.441100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:31.441100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:31.441100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:31.441100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:12:31.441100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:12:31.441100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:12:31.442193 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:12:31.442193 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:31.442193 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:31.442193 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:31.442193 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:31.442193 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:31.442193 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:31.442193 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:31.442193 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:31.442193 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:31.442193 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:31.442193 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:31.442193 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:31.442193 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:31.442193 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:31.442193 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:31.442193 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:31.443944 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:12:31.443944 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:12:31.443944 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:12:31.443944 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:12:31.443944 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:12:31.443944 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:12:31.443944 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:31.443944 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:31.451301 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 419/826] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:12:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:31.453515 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c0459-c817-4c66-ba7f-cad3029a6e38 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:31.476153 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:31.487214 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa32b33-4238-4dae-ab29-83b0e3137315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:31.487852 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa32b33-4238-4dae-ab29-83b0e3137315 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:31.488210 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa32b33-4238-4dae-ab29-83b0e3137315 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:31.488491 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa32b33-4238-4dae-ab29-83b0e3137315 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:31.489178 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa32b33-4238-4dae-ab29-83b0e3137315 None admin] RBAC: Adding query filter params (type=network) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:31.489485 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa32b33-4238-4dae-ab29-83b0e3137315 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:31.491382 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa32b33-4238-4dae-ab29-83b0e3137315 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:31.498438 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 408/827] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Jul 27 15:12:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:31.503757 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa32b33-4238-4dae-ab29-83b0e3137315 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:31.571407 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c0459-c817-4c66-ba7f-cad3029a6e38 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:31.620134 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e207f78-6bf3-406e-85b2-582c87909aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:31.620903 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e207f78-6bf3-406e-85b2-582c87909aea None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:31.621270 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e207f78-6bf3-406e-85b2-582c87909aea None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:31.621637 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e207f78-6bf3-406e-85b2-582c87909aea None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:31.622471 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e207f78-6bf3-406e-85b2-582c87909aea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:31.622861 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e207f78-6bf3-406e-85b2-582c87909aea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:31.624437 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e207f78-6bf3-406e-85b2-582c87909aea None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:31.626122 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:31.631284 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa32b33-4238-4dae-ab29-83b0e3137315 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:31.639061 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 420/828] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jul 27 15:12:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:31.640125 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e207f78-6bf3-406e-85b2-582c87909aea None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:31.671042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca548dd-f609-455e-bb23-b935a3972062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:31.671716 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca548dd-f609-455e-bb23-b935a3972062 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:31.672149 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca548dd-f609-455e-bb23-b935a3972062 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:31.672518 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca548dd-f609-455e-bb23-b935a3972062 None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:31.673418 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca548dd-f609-455e-bb23-b935a3972062 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:31.673823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca548dd-f609-455e-bb23-b935a3972062 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:31.675386 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca548dd-f609-455e-bb23-b935a3972062 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:31.689074 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 409/829] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jul 27 15:12:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:31.694762 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca548dd-f609-455e-bb23-b935a3972062 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:31.738347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:31.766850 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e207f78-6bf3-406e-85b2-582c87909aea None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:31.808316 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6f6b5-5477-4630-98d6-1f984680fcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:31.809473 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6f6b5-5477-4630-98d6-1f984680fcee None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:31.810287 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6f6b5-5477-4630-98d6-1f984680fcee None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:31.810713 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c6f6b5-5477-4630-98d6-1f984680fcee None admin] PATH_INFO: `/v3/endpoints` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:31.811578 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6f6b5-5477-4630-98d6-1f984680fcee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:31.813676 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c6f6b5-5477-4630-98d6-1f984680fcee None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:31.826266 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca548dd-f609-455e-bb23-b935a3972062 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:31.838757 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 421/830] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:12:31 2022] POST /identity/v3/endpoints => generated 327 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:12:31.845375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6f6b5-5477-4630-98d6-1f984680fcee None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:31.883892 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bae1eb-a160-42fa-9ca5-3c6bc4338fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:31.884602 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bae1eb-a160-42fa-9ca5-3c6bc4338fbb None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:31.884882 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bae1eb-a160-42fa-9ca5-3c6bc4338fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:31.885153 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bae1eb-a160-42fa-9ca5-3c6bc4338fbb None admin] PATH_INFO: `/v3/projects/0b616213eaea4a22afee15d4cbe5a3c5/users/b470b4c2ca1a4d1a8a864789bf603d02/roles/6a54ab92d32843d6bc4c2dcedae4bd13` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:31.908265 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bae1eb-a160-42fa-9ca5-3c6bc4338fbb None admin] RBAC: Authorizing `identity:create_grant(project_id=0b616213eaea4a22afee15d4cbe5a3c5, user_id=b470b4c2ca1a4d1a8a864789bf603d02, role_id=6a54ab92d32843d6bc4c2dcedae4bd13)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:31.911275 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bae1eb-a160-42fa-9ca5-3c6bc4338fbb None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:31.933937 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 410/831] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jul 27 15:12:31 2022] PUT /identity/v3/projects/0b616213eaea4a22afee15d4cbe5a3c5/users/b470b4c2ca1a4d1a8a864789bf603d02/roles/6a54ab92d32843d6bc4c2dcedae4bd13 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:12:31.935747 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e080a-4887-4c31-aebe-1701c7151595 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:31.936280 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e080a-4887-4c31-aebe-1701c7151595 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:31.936772 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e080a-4887-4c31-aebe-1701c7151595 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:31.944462 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 411/832] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:31.946776 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c78337-dec9-4fa0-b137-af384cb12b8e None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:31.947642 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c78337-dec9-4fa0-b137-af384cb12b8e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:31.948146 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c78337-dec9-4fa0-b137-af384cb12b8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:31.968084 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:31.976277 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c6f6b5-5477-4630-98d6-1f984680fcee None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:31.978853 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-55c78337-dec9-4fa0-b137-af384cb12b8e None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:31.985558 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-55c78337-dec9-4fa0-b137-af384cb12b8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:32.012287 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:32.020189 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9754c2c-e03c-40fc-ae7e-2cd73e6ea3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:32.022026 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9754c2c-e03c-40fc-ae7e-2cd73e6ea3c5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:32.022973 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9754c2c-e03c-40fc-ae7e-2cd73e6ea3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:32.023291 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9754c2c-e03c-40fc-ae7e-2cd73e6ea3c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:32.024223 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9754c2c-e03c-40fc-ae7e-2cd73e6ea3c5 None admin] RBAC: Adding query filter params (role.id=6535f8b98008471dba33e89bd460880d, scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5, user.id=d3e01aa0ef1340cbba7170bac4a82783) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:32.024703 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9754c2c-e03c-40fc-ae7e-2cd73e6ea3c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:32.027855 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9754c2c-e03c-40fc-ae7e-2cd73e6ea3c5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:32.038705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 422/833] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:12:31 2022] GET /identity/v3/role_assignments?user.id=d3e01aa0ef1340cbba7170bac4a82783&scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5&role.id=6535f8b98008471dba33e89bd460880d => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:32.088644 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 412/834] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:12:32.116011 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9754c2c-e03c-40fc-ae7e-2cd73e6ea3c5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:32.238115 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9754c2c-e03c-40fc-ae7e-2cd73e6ea3c5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:32.273148 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7c786-1762-422b-ba53-84e6632f10b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:32.273782 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7c786-1762-422b-ba53-84e6632f10b7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:32.274061 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7c786-1762-422b-ba53-84e6632f10b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:32.274327 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d7c786-1762-422b-ba53-84e6632f10b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:32.287717 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d7c786-1762-422b-ba53-84e6632f10b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:12:32.293313 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-40d7c786-1762-422b-ba53-84e6632f10b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:12:32.293313 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:32.293313 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:32.293313 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:32.293313 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:32.293313 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:32.293313 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:32.293313 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:32.293313 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:32.293313 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:32.293313 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:32.293313 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:32.293313 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:12:32.293313 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:12:32.293313 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:12:32.293313 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:12:32.294247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:12:32.294247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:12:32.294247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:12:32.294247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:12:32.294247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:32.294247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:32.294247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:32.294247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:32.294247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:32.294247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:32.294247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:32.294247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:32.294247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:32.294247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:32.294247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:32.294247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:32.295090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:32.295090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:32.295090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:32.295090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:32.295090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:12:32.295090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:12:32.295090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:12:32.295090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:12:32.295090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:12:32.295090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:12:32.295090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:12:32.295090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:32.295090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 423/835] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jul 27 15:12:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:32.300273 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c78337-dec9-4fa0-b137-af384cb12b8e None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:32.410467 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c78337-dec9-4fa0-b137-af384cb12b8e None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:32.446808 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17c7d7-5cf9-4f57-8720-508468cf1bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:32.447430 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17c7d7-5cf9-4f57-8720-508468cf1bdd None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:32.447711 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17c7d7-5cf9-4f57-8720-508468cf1bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:32.447984 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa17c7d7-5cf9-4f57-8720-508468cf1bdd None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:32.448722 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17c7d7-5cf9-4f57-8720-508468cf1bdd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:32.449027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17c7d7-5cf9-4f57-8720-508468cf1bdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:32.450388 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa17c7d7-5cf9-4f57-8720-508468cf1bdd None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:32.452639 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:32.460426 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 413/836] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:12:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:32.466026 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7c786-1762-422b-ba53-84e6632f10b7 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:32.528105 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:32.579533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d7c786-1762-422b-ba53-84e6632f10b7 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:32.615052 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76433a-7818-49e2-9439-fdb452af3b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:32.615695 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76433a-7818-49e2-9439-fdb452af3b21 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:32.615977 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76433a-7818-49e2-9439-fdb452af3b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:32.616284 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76433a-7818-49e2-9439-fdb452af3b21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:32.627460 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76433a-7818-49e2-9439-fdb452af3b21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:32.628973 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76433a-7818-49e2-9439-fdb452af3b21 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:32.644324 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-ee76433a-7818-49e2-9439-fdb452af3b21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:32.644324 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:32.644324 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:32.644324 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:32.644324 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:32.644324 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:32.644324 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:32.644324 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:32.644324 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:32.644324 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:32.644324 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:32.644324 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:32.644324 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:32.644324 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:32.644324 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:32.645248 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:32.645248 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:32.645248 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:32.645248 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:32.645248 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:32.645248 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:32.645248 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:32.645248 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:32.645248 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:32.645248 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:32.645248 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:32.645248 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:32.645248 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:32.645248 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:32.645248 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:32.645248 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:32.645248 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:32.646210 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:32.646210 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:32.646210 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:32.646210 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:32.646210 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 424/837] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:32.651787 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17c7d7-5cf9-4f57-8720-508468cf1bdd None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:32.757572 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa17c7d7-5cf9-4f57-8720-508468cf1bdd None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:32.792363 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955b4bb-7fe3-44ad-81f8-c70d0b4d5981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:32.792904 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955b4bb-7fe3-44ad-81f8-c70d0b4d5981 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:32.793188 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955b4bb-7fe3-44ad-81f8-c70d0b4d5981 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:32.793469 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d955b4bb-7fe3-44ad-81f8-c70d0b4d5981 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:32.794169 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d955b4bb-7fe3-44ad-81f8-c70d0b4d5981 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:32.794474 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d955b4bb-7fe3-44ad-81f8-c70d0b4d5981 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:32.795909 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d955b4bb-7fe3-44ad-81f8-c70d0b4d5981 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:32.809051 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 414/838] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:32.817058 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76433a-7818-49e2-9439-fdb452af3b21 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:32.921858 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76433a-7818-49e2-9439-fdb452af3b21 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:32.931278 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:32.957297 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb657a10-14dc-4961-ac48-920790a7cf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:32.957934 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb657a10-14dc-4961-ac48-920790a7cf35 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:32.958214 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb657a10-14dc-4961-ac48-920790a7cf35 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:32.958486 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb657a10-14dc-4961-ac48-920790a7cf35 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:32.966126 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb657a10-14dc-4961-ac48-920790a7cf35 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:32.967558 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb657a10-14dc-4961-ac48-920790a7cf35 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:32.978771 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-eb657a10-14dc-4961-ac48-920790a7cf35 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 15:12:32.978771 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:32.978771 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:32.978771 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:32.978771 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:32.978771 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:32.978771 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:32.978771 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:32.978771 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:32.978771 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:32.978771 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:32.978771 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:32.978771 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:12:32.978771 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:12:32.978771 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:12:32.978771 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:12:32.979705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:32.979705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:32.979705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:12:32.979705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:32.979705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:12:32.979705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:32.979705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:32.979705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:32.979705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:32.979705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:32.979705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:32.979705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:32.979705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:32.979705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:32.979705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:32.979705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:32.979705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:32.979705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:32.980679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:32.980679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:32.980679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:12:32.980679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:12:32.980679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:12:32.980679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:12:32.980679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:12:32.980679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:12:32.980679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 15:12:32.980679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:32.980679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 425/839] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jul 27 15:12:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:32.987062 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955b4bb-7fe3-44ad-81f8-c70d0b4d5981 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:33.046780 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:33.089923 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d955b4bb-7fe3-44ad-81f8-c70d0b4d5981 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:33.124956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e1355-1300-484f-9a24-1d60f87cdfc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:33.125930 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e1355-1300-484f-9a24-1d60f87cdfc3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:33.126416 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e1355-1300-484f-9a24-1d60f87cdfc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:33.126893 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5e1355-1300-484f-9a24-1d60f87cdfc3 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:33.127880 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e1355-1300-484f-9a24-1d60f87cdfc3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:33.128415 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e1355-1300-484f-9a24-1d60f87cdfc3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:33.130132 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5e1355-1300-484f-9a24-1d60f87cdfc3 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:33.149078 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 415/840] 10.222.0.40 () {56 vars in 1135 bytes} [Wed Jul 27 15:12:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:33.154897 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb657a10-14dc-4961-ac48-920790a7cf35 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:33.259854 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb657a10-14dc-4961-ac48-920790a7cf35 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:33.299825 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c172d30-b2ca-4cc9-9ec2-3988ce763bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:33.300395 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c172d30-b2ca-4cc9-9ec2-3988ce763bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:33.300688 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c172d30-b2ca-4cc9-9ec2-3988ce763bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:33.300960 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c172d30-b2ca-4cc9-9ec2-3988ce763bd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:33.338752 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:33.372937 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c172d30-b2ca-4cc9-9ec2-3988ce763bd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:33.374383 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c172d30-b2ca-4cc9-9ec2-3988ce763bd6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:33.476374 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 426/841] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:12:33 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 15:12:33.481829 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e1355-1300-484f-9a24-1d60f87cdfc3 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:33.587016 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5e1355-1300-484f-9a24-1d60f87cdfc3 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:33.599498 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc64fb5-3b0c-4c76-a1cc-bc2d6a784ced None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:33.599794 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc64fb5-3b0c-4c76-a1cc-bc2d6a784ced None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:33.600090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc64fb5-3b0c-4c76-a1cc-bc2d6a784ced None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:33.601676 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 427/842] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:33.606965 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c753f-1d4e-40c2-943a-c7b41e8a61f7 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:33.607250 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c753f-1d4e-40c2-943a-c7b41e8a61f7 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:33.607520 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c753f-1d4e-40c2-943a-c7b41e8a61f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:33.611517 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:33.626735 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6de09-4328-48c4-9f89-444c2f2d62d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:33.627681 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6de09-4328-48c4-9f89-444c2f2d62d8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:33.628200 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6de09-4328-48c4-9f89-444c2f2d62d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:33.628704 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6de09-4328-48c4-9f89-444c2f2d62d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:33.628810 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-ba9c753f-1d4e-40c2-943a-c7b41e8a61f7 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:33.630119 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ba9c753f-1d4e-40c2-943a-c7b41e8a61f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:33.642081 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6de09-4328-48c4-9f89-444c2f2d62d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:33.644404 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6de09-4328-48c4-9f89-444c2f2d62d8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:33.665130 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-23b6de09-4328-48c4-9f89-444c2f2d62d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:33.665130 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:33.665130 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:33.665130 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:33.665130 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:33.665130 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:33.665130 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:33.665130 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:33.665130 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:33.665130 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:33.665130 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:33.665130 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:33.665130 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:33.665130 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:33.665130 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:33.666488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:33.666488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:33.666488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:33.666488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:33.666488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:33.666488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:33.666488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:33.666488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:33.666488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:33.666488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:33.666488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:33.666488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:33.666488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:33.666488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:33.666488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:33.666488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:33.666488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:33.667383 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:33.667383 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:33.667383 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:33.667383 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:33.670373 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 416/843] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:33.675579 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6de09-4328-48c4-9f89-444c2f2d62d8 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:33.700906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:33.707357 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 428/844] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:12:33.730506 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c753f-1d4e-40c2-943a-c7b41e8a61f7 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:33.799332 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6de09-4328-48c4-9f89-444c2f2d62d8 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:33.837676 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c6e49-4c7a-49ea-9ce9-fc4ea7f55ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:33.838635 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c6e49-4c7a-49ea-9ce9-fc4ea7f55ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:33.839192 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c6e49-4c7a-49ea-9ce9-fc4ea7f55ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:33.839780 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c6e49-4c7a-49ea-9ce9-fc4ea7f55ec7 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:33.840856 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c6e49-4c7a-49ea-9ce9-fc4ea7f55ec7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:33.841638 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c6e49-4c7a-49ea-9ce9-fc4ea7f55ec7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:33.843297 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c6e49-4c7a-49ea-9ce9-fc4ea7f55ec7 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:33.858773 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 417/845] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:33.864228 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c6e49-4c7a-49ea-9ce9-fc4ea7f55ec7 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:33.867267 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c753f-1d4e-40c2-943a-c7b41e8a61f7 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:33.903080 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:33.903276 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561a919-0d9e-47b3-bb48-1f7ead430c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:33.904093 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561a919-0d9e-47b3-bb48-1f7ead430c93 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:33.904340 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561a919-0d9e-47b3-bb48-1f7ead430c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:33.904852 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561a919-0d9e-47b3-bb48-1f7ead430c93 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:33.905545 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561a919-0d9e-47b3-bb48-1f7ead430c93 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:33.907106 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561a919-0d9e-47b3-bb48-1f7ead430c93 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:33.917951 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-2561a919-0d9e-47b3-bb48-1f7ead430c93 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 15:12:33.917951 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:33.917951 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 15:12:33.917951 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 15:12:33.917951 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 15:12:33.917951 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 15:12:33.917951 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 15:12:33.917951 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:33.917951 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 15:12:33.917951 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:33.917951 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 15:12:33.917951 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:33.917951 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:33.917951 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:33.917951 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:33.917951 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:33.917951 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:33.918965 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:33.918965 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:33.918965 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:33.918965 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:33.918965 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:33.918965 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:33.918965 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 15:12:33.918965 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 15:12:33.918965 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 15:12:33.918965 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 15:12:33.918965 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:33.918965 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:33.918965 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:33.918965 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:33.918965 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:33.918965 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:33.919833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:33.919833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:33.919833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:33.919833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:33.919833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:33.919833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:33.919833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:33.919833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:33.919833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:33.919833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:33.919833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 15:12:33.919833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:33.919833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 15:12:33.919833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:33.924442 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 429/846] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jul 27 15:12:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:12:33.925419 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561a919-0d9e-47b3-bb48-1f7ead430c93 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:33.990496 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:34.002685 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c6e49-4c7a-49ea-9ce9-fc4ea7f55ec7 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:34.037276 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561a919-0d9e-47b3-bb48-1f7ead430c93 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:34.043433 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7035e7-d7c3-4c71-b02f-fb348d7c8043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:34.044245 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7035e7-d7c3-4c71-b02f-fb348d7c8043 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:34.044592 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7035e7-d7c3-4c71-b02f-fb348d7c8043 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:34.044938 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7035e7-d7c3-4c71-b02f-fb348d7c8043 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:34.053262 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7035e7-d7c3-4c71-b02f-fb348d7c8043 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:34.054985 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7035e7-d7c3-4c71-b02f-fb348d7c8043 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:34.067378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-4d7035e7-d7c3-4c71-b02f-fb348d7c8043 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:34.067378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:34.067378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:34.067378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:34.067378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:34.067378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:34.067378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:34.067378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:34.067378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:34.067378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:34.067378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:34.067378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:34.067378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:12:34.067378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:12:34.067378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:12:34.068385 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:12:34.068385 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:34.068385 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:34.068385 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:34.068385 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:34.068385 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:34.068385 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:34.068385 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:34.068385 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:34.068385 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:34.068385 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:34.068385 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:34.068385 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:34.068385 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:34.068385 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:34.068385 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:34.068385 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:34.069303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:12:34.069303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:12:34.069303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:12:34.069303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:12:34.069303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:12:34.069303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:12:34.069303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:34.069303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:34.073597 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 418/847] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:12:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:12:34.074503 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7035e7-d7c3-4c71-b02f-fb348d7c8043 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:34.081989 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e25fda-f0df-4193-b095-f2bc4836abd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:34.082869 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e25fda-f0df-4193-b095-f2bc4836abd5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:34.083331 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e25fda-f0df-4193-b095-f2bc4836abd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:34.084257 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e25fda-f0df-4193-b095-f2bc4836abd5 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:34.084931 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e25fda-f0df-4193-b095-f2bc4836abd5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:34.085245 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e25fda-f0df-4193-b095-f2bc4836abd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:34.089453 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e25fda-f0df-4193-b095-f2bc4836abd5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:34.096521 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 430/848] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jul 27 15:12:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:34.101916 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e25fda-f0df-4193-b095-f2bc4836abd5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:34.184537 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:34.197956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7035e7-d7c3-4c71-b02f-fb348d7c8043 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:34.209522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e25fda-f0df-4193-b095-f2bc4836abd5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:34.233131 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13766eac-37c4-426b-82a7-ccf89d86341a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:34.233745 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13766eac-37c4-426b-82a7-ccf89d86341a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:34.234028 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13766eac-37c4-426b-82a7-ccf89d86341a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:34.234303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13766eac-37c4-426b-82a7-ccf89d86341a None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:34.235049 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13766eac-37c4-426b-82a7-ccf89d86341a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:34.235356 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13766eac-37c4-426b-82a7-ccf89d86341a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:34.236812 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13766eac-37c4-426b-82a7-ccf89d86341a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:34.236948 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:34.247091 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88caa140-4402-45dd-b158-db2a66baae6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:34.247900 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88caa140-4402-45dd-b158-db2a66baae6b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:34.248113 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88caa140-4402-45dd-b158-db2a66baae6b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:34.248272 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88caa140-4402-45dd-b158-db2a66baae6b None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:34.248955 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88caa140-4402-45dd-b158-db2a66baae6b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:34.249360 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88caa140-4402-45dd-b158-db2a66baae6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:34.250625 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88caa140-4402-45dd-b158-db2a66baae6b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:34.251564 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 419/849] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jul 27 15:12:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:34.253985 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e6f1e-f11d-47b5-b485-7ebd20fd0307 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:34.254450 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e6f1e-f11d-47b5-b485-7ebd20fd0307 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:34.254916 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e6f1e-f11d-47b5-b485-7ebd20fd0307 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:34.256286 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 431/850] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jul 27 15:12:34 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:34.256678 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 420/851] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:34.261519 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e6f1e-f11d-47b5-b485-7ebd20fd0307 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:34.262059 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0efcff-164b-41e1-af99-cf6f66ca64a8 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:34.262352 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0efcff-164b-41e1-af99-cf6f66ca64a8 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:34.262627 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0efcff-164b-41e1-af99-cf6f66ca64a8 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:34.265232 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 432/852] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:34.265511 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93281daf-b1c8-4750-9124-c03e24734aec None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:34.265795 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93281daf-b1c8-4750-9124-c03e24734aec None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:34.267465 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93281daf-b1c8-4750-9124-c03e24734aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:34.285906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-93281daf-b1c8-4750-9124-c03e24734aec None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:34.287711 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-93281daf-b1c8-4750-9124-c03e24734aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:34.368541 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 433/853] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:12:34.369679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031dd6f-6878-42ea-9cd7-7e4a84d08c8e None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:34.369964 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031dd6f-6878-42ea-9cd7-7e4a84d08c8e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:34.370236 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031dd6f-6878-42ea-9cd7-7e4a84d08c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:34.386966 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17e6f1e-f11d-47b5-b485-7ebd20fd0307 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:34.393495 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-3031dd6f-6878-42ea-9cd7-7e4a84d08c8e None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:34.394703 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3031dd6f-6878-42ea-9cd7-7e4a84d08c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:34.430239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7e18c-d2f0-4a2f-b409-e2812d7a647c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:34.432032 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7e18c-d2f0-4a2f-b409-e2812d7a647c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:34.432032 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7e18c-d2f0-4a2f-b409-e2812d7a647c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:34.432032 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7e18c-d2f0-4a2f-b409-e2812d7a647c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:34.432311 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7e18c-d2f0-4a2f-b409-e2812d7a647c None admin] RBAC: Adding query filter params (role.id=6535f8b98008471dba33e89bd460880d, scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5, user.id=68bbf8bb59a84829afacd9677c9639a6) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:34.432512 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7e18c-d2f0-4a2f-b409-e2812d7a647c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:34.434135 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7e18c-d2f0-4a2f-b409-e2812d7a647c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:34.440276 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 421/854] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:12:34 2022] GET /identity/v3/role_assignments?user.id=68bbf8bb59a84829afacd9677c9639a6&scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5&role.id=6535f8b98008471dba33e89bd460880d => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:34.441085 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7e18c-d2f0-4a2f-b409-e2812d7a647c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:34.469953 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:34.472873 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 434/855] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:12:34.495114 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031dd6f-6878-42ea-9cd7-7e4a84d08c8e None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:34.572740 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7e18c-d2f0-4a2f-b409-e2812d7a647c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:34.575395 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:34.622207 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9e361-9acf-4096-bd95-c08c2a688df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:34.623336 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9e361-9acf-4096-bd95-c08c2a688df1 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:34.623831 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9e361-9acf-4096-bd95-c08c2a688df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:34.624138 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a9e361-9acf-4096-bd95-c08c2a688df1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:34.637468 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a9e361-9acf-4096-bd95-c08c2a688df1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:12:34.642872 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-03a9e361-9acf-4096-bd95-c08c2a688df1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:12:34.642872 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:34.642872 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:34.642872 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:34.642872 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:34.642872 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:34.642872 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:34.642872 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:34.642872 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:34.642872 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:34.642872 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:34.642872 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:34.642872 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:12:34.642872 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:12:34.642872 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:12:34.642872 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:12:34.643793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:12:34.643793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:12:34.643793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:12:34.643793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:12:34.643793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:34.643793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:34.643793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:34.643793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:34.643793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:34.643793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:34.643793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:34.643793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:34.643793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:34.643793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:34.643793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:34.643793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:34.644658 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:34.644658 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:34.644658 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:34.644658 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:34.644658 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:12:34.644658 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:12:34.644658 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:12:34.644658 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:12:34.644658 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:12:34.644658 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:12:34.644658 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:12:34.644658 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:34.645275 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 422/856] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jul 27 15:12:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:34.649854 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9e361-9acf-4096-bd95-c08c2a688df1 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:34.657090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031dd6f-6878-42ea-9cd7-7e4a84d08c8e None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:34.703898 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9ff61-9a58-49d9-b5c0-64617f2f9e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:34.704583 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9ff61-9a58-49d9-b5c0-64617f2f9e08 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:34.704863 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9ff61-9a58-49d9-b5c0-64617f2f9e08 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:34.705137 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d9ff61-9a58-49d9-b5c0-64617f2f9e08 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:34.705764 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d9ff61-9a58-49d9-b5c0-64617f2f9e08 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:34.707126 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d9ff61-9a58-49d9-b5c0-64617f2f9e08 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:34.718347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-a7d9ff61-9a58-49d9-b5c0-64617f2f9e08 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 15:12:34.718347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:34.718347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 15:12:34.718347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 15:12:34.718347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 15:12:34.718347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 15:12:34.718347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 15:12:34.718347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:34.718347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 15:12:34.718347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:34.718347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 15:12:34.718347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:34.718347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:34.718347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:34.718347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:34.718347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:34.719368 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:34.719368 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:34.719368 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:34.719368 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:34.719368 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:34.719368 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:34.719368 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:34.719368 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 15:12:34.719368 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 15:12:34.719368 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 15:12:34.719368 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 15:12:34.719368 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:34.719368 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:34.719368 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:34.719368 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:34.719368 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:34.720238 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:34.720238 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:34.720238 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:34.720238 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:34.720238 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:34.720238 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:34.720238 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:34.720238 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:34.720238 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:34.720238 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:34.720238 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:34.720238 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 15:12:34.720238 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:34.720238 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 15:12:34.720238 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:34.720238 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 435/857] 10.222.0.40 () {56 vars in 1132 bytes} [Wed Jul 27 15:12:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:12:34.727520 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9ff61-9a58-49d9-b5c0-64617f2f9e08 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:34.747389 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:34.794998 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a9e361-9acf-4096-bd95-c08c2a688df1 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:34.844873 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d9ff61-9a58-49d9-b5c0-64617f2f9e08 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:34.845298 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5621f-aeba-45fb-aa15-0631c7969a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:34.845929 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5621f-aeba-45fb-aa15-0631c7969a0c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:34.846215 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5621f-aeba-45fb-aa15-0631c7969a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:34.846492 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc5621f-aeba-45fb-aa15-0631c7969a0c None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:34.847216 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5621f-aeba-45fb-aa15-0631c7969a0c None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:34.847522 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5621f-aeba-45fb-aa15-0631c7969a0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:34.850646 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc5621f-aeba-45fb-aa15-0631c7969a0c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:34.861399 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 423/858] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jul 27 15:12:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:34.862833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:34.868364 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5621f-aeba-45fb-aa15-0631c7969a0c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:34.886728 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c6f2d-c16b-401e-8144-aede4d79b59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:34.887963 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c6f2d-c16b-401e-8144-aede4d79b59c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:34.888490 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c6f2d-c16b-401e-8144-aede4d79b59c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:34.888940 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c6f2d-c16b-401e-8144-aede4d79b59c None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:34.889820 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c6f2d-c16b-401e-8144-aede4d79b59c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:34.890324 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c6f2d-c16b-401e-8144-aede4d79b59c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:34.891876 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c6f2d-c16b-401e-8144-aede4d79b59c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:34.901677 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 436/859] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Jul 27 15:12:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:34.903282 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c6f2d-c16b-401e-8144-aede4d79b59c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:34.985920 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc5621f-aeba-45fb-aa15-0631c7969a0c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:35.029747 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fba6e0-bc62-4d8c-b8b1-01ca7ec59dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:35.030282 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c6f2d-c16b-401e-8144-aede4d79b59c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:35.030418 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fba6e0-bc62-4d8c-b8b1-01ca7ec59dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:35.030663 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fba6e0-bc62-4d8c-b8b1-01ca7ec59dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:35.030940 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fba6e0-bc62-4d8c-b8b1-01ca7ec59dd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:35.033168 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:35.046389 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fba6e0-bc62-4d8c-b8b1-01ca7ec59dd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:35.048587 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fba6e0-bc62-4d8c-b8b1-01ca7ec59dd6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:35.063911 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-a8fba6e0-bc62-4d8c-b8b1-01ca7ec59dd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:35.063911 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:35.063911 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:35.063911 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:35.063911 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:35.063911 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:35.063911 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:35.063911 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:35.063911 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:35.063911 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:35.063911 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:35.063911 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:35.063911 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:35.063911 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:35.063911 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:35.064928 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:35.064928 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:35.064928 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:35.064928 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:35.064928 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:35.064928 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:35.064928 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:35.064928 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:35.064928 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:35.064928 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:35.064928 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:35.064928 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:35.064928 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:35.064928 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:35.064928 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:35.064928 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:35.064928 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:35.065814 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:35.065814 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:35.065814 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:35.065814 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:35.068049 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 424/860] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:12:35.073078 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fba6e0-bc62-4d8c-b8b1-01ca7ec59dd6 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:35.083434 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af203ba-7d4d-41e4-acc7-d82b89e5f5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:35.084978 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af203ba-7d4d-41e4-acc7-d82b89e5f5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:35.085459 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af203ba-7d4d-41e4-acc7-d82b89e5f5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:35.085927 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af203ba-7d4d-41e4-acc7-d82b89e5f5b1 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:35.086867 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af203ba-7d4d-41e4-acc7-d82b89e5f5b1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:35.087424 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af203ba-7d4d-41e4-acc7-d82b89e5f5b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:35.089174 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af203ba-7d4d-41e4-acc7-d82b89e5f5b1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:35.100143 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 437/861] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Jul 27 15:12:34 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:35.187818 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fba6e0-bc62-4d8c-b8b1-01ca7ec59dd6 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:35.225892 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be463a9-954a-4e7f-b8b6-30f71093507f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:35.226529 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be463a9-954a-4e7f-b8b6-30f71093507f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:35.226810 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be463a9-954a-4e7f-b8b6-30f71093507f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:35.227084 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be463a9-954a-4e7f-b8b6-30f71093507f None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:35.227794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be463a9-954a-4e7f-b8b6-30f71093507f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:35.228132 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be463a9-954a-4e7f-b8b6-30f71093507f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:35.229529 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be463a9-954a-4e7f-b8b6-30f71093507f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:35.243179 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 425/862] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:35.248755 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af203ba-7d4d-41e4-acc7-d82b89e5f5b1 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:35.297963 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:35.358810 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af203ba-7d4d-41e4-acc7-d82b89e5f5b1 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:35.393969 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3dfd7-dcf5-43ca-ac5e-6bd4da044a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:35.394636 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3dfd7-dcf5-43ca-ac5e-6bd4da044a1f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:35.394920 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3dfd7-dcf5-43ca-ac5e-6bd4da044a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:35.395193 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3dfd7-dcf5-43ca-ac5e-6bd4da044a1f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:35.404669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d3dfd7-dcf5-43ca-ac5e-6bd4da044a1f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:35.406128 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d3dfd7-dcf5-43ca-ac5e-6bd4da044a1f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:35.418177 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-39d3dfd7-dcf5-43ca-ac5e-6bd4da044a1f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 15:12:35.418177 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:35.418177 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:35.418177 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:35.418177 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:35.418177 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:35.418177 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:35.418177 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:35.418177 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:35.418177 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:35.418177 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:35.418177 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:35.418177 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:12:35.418177 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:12:35.418177 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:12:35.418177 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:12:35.419101 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:35.419101 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:35.419101 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:12:35.419101 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:35.419101 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:12:35.419101 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:35.419101 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:35.419101 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:35.419101 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:35.419101 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:35.419101 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:35.419101 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:35.419101 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:35.419101 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:35.419101 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:35.419101 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:35.419101 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:35.419101 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:35.420537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:35.420537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:35.420537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:12:35.420537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:12:35.420537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:12:35.420537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:12:35.420537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:12:35.420537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:12:35.420537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 15:12:35.420537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:35.420537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 438/863] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Jul 27 15:12:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:35.425152 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be463a9-954a-4e7f-b8b6-30f71093507f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:35.493459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:35.530411 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be463a9-954a-4e7f-b8b6-30f71093507f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:35.566021 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdf47e-0f50-4c9a-9a80-ac3569f7dc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:35.566632 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdf47e-0f50-4c9a-9a80-ac3569f7dc3c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:35.566914 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdf47e-0f50-4c9a-9a80-ac3569f7dc3c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:35.567187 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdf47e-0f50-4c9a-9a80-ac3569f7dc3c None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:35.568525 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cdf47e-0f50-4c9a-9a80-ac3569f7dc3c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:35.568835 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cdf47e-0f50-4c9a-9a80-ac3569f7dc3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:35.570242 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cdf47e-0f50-4c9a-9a80-ac3569f7dc3c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:35.588428 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 426/864] 10.222.0.40 () {56 vars in 1149 bytes} [Wed Jul 27 15:12:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:35.594048 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3dfd7-dcf5-43ca-ac5e-6bd4da044a1f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:35.703016 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3dfd7-dcf5-43ca-ac5e-6bd4da044a1f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:35.704610 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:35.738808 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228facc-030b-49c0-a0e9-4862680dced7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:35.739428 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228facc-030b-49c0-a0e9-4862680dced7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:35.739765 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228facc-030b-49c0-a0e9-4862680dced7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:35.740558 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228facc-030b-49c0-a0e9-4862680dced7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:35.812667 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f228facc-030b-49c0-a0e9-4862680dced7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:35.814123 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f228facc-030b-49c0-a0e9-4862680dced7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:35.916307 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 439/865] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:12:35 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 15:12:35.921737 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdf47e-0f50-4c9a-9a80-ac3569f7dc3c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:36.026164 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdf47e-0f50-4c9a-9a80-ac3569f7dc3c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:36.028907 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:36.064406 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c565f9-5a9a-4eb7-a7a8-c74f72a20f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:36.065356 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c565f9-5a9a-4eb7-a7a8-c74f72a20f4a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:36.065890 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c565f9-5a9a-4eb7-a7a8-c74f72a20f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:36.066365 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c565f9-5a9a-4eb7-a7a8-c74f72a20f4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:36.077683 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c565f9-5a9a-4eb7-a7a8-c74f72a20f4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:36.079385 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c565f9-5a9a-4eb7-a7a8-c74f72a20f4a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:36.094648 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-83c565f9-5a9a-4eb7-a7a8-c74f72a20f4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:36.094648 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:36.094648 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:36.094648 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:36.094648 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:36.094648 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:36.094648 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:36.094648 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:36.094648 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:36.094648 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:36.094648 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:36.094648 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:36.094648 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:36.094648 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:36.094648 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:36.095552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:36.095552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:36.095552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:36.095552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:36.095552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:36.095552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:36.095552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:36.095552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:36.095552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:36.095552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:36.095552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:36.095552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:36.095552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:36.095552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:36.095552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:36.095552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:36.095552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:36.096486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:36.096486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:36.096486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:36.096486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:36.098652 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 427/866] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:36.105929 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228facc-030b-49c0-a0e9-4862680dced7 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:36.106411 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:36.210917 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228facc-030b-49c0-a0e9-4862680dced7 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:36.248661 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11f2da3-3678-4c74-a16f-90ecb34e9a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:36.249282 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f2da3-3678-4c74-a16f-90ecb34e9a3e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:36.249560 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f2da3-3678-4c74-a16f-90ecb34e9a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:36.249833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f2da3-3678-4c74-a16f-90ecb34e9a3e None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:36.250533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f2da3-3678-4c74-a16f-90ecb34e9a3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:36.250836 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f2da3-3678-4c74-a16f-90ecb34e9a3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:36.252212 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11f2da3-3678-4c74-a16f-90ecb34e9a3e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:36.264527 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 440/867] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:36.270296 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c565f9-5a9a-4eb7-a7a8-c74f72a20f4a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:36.313994 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7e5a8-eb55-4f27-8291-46ff06d134f6 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:36.314339 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7e5a8-eb55-4f27-8291-46ff06d134f6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:36.314619 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea7e5a8-eb55-4f27-8291-46ff06d134f6 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:36.316096 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 441/868] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:12:36.321771 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60c174-8a04-4dd4-a21b-cd93963f1d23 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:36.322081 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60c174-8a04-4dd4-a21b-cd93963f1d23 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:36.322329 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d60c174-8a04-4dd4-a21b-cd93963f1d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:36.342251 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-1d60c174-8a04-4dd4-a21b-cd93963f1d23 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:36.344032 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1d60c174-8a04-4dd4-a21b-cd93963f1d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:36.391522 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c565f9-5a9a-4eb7-a7a8-c74f72a20f4a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:36.411343 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:36.432156 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 442/869] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:36 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 15:12:36.438036 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a929e-74bb-4090-9404-b0efb3a04ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:36.438833 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a929e-74bb-4090-9404-b0efb3a04ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:36.439257 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a929e-74bb-4090-9404-b0efb3a04ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:36.439672 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940a929e-74bb-4090-9404-b0efb3a04ed7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:36.446677 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a929e-74bb-4090-9404-b0efb3a04ed7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:36.448313 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940a929e-74bb-4090-9404-b0efb3a04ed7 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:36.451303 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60c174-8a04-4dd4-a21b-cd93963f1d23 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:36.464107 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-940a929e-74bb-4090-9404-b0efb3a04ed7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:36.464107 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:36.464107 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:36.464107 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:36.464107 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:36.464107 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:36.464107 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:36.464107 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:36.464107 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:36.464107 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:36.464107 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:36.464107 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:36.464107 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:12:36.464107 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:12:36.464107 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:12:36.465209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:12:36.465209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:36.465209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:36.465209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:36.465209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:36.465209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:36.465209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:36.465209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:36.465209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:36.465209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:36.465209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:36.465209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:36.465209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:36.465209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:36.465209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:36.465209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:36.465209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:36.466294 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:12:36.466294 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:12:36.466294 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:12:36.466294 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:12:36.466294 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:12:36.466294 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:12:36.466294 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:36.466294 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:36.468035 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 428/870] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:12:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:36.473461 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a929e-74bb-4090-9404-b0efb3a04ed7 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:36.500987 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:36.590413 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d60c174-8a04-4dd4-a21b-cd93963f1d23 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:36.610088 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940a929e-74bb-4090-9404-b0efb3a04ed7 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:36.634119 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaed8bbf-9146-4f6c-a5f1-5bc850334cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:36.634735 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed8bbf-9146-4f6c-a5f1-5bc850334cc2 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:36.635012 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed8bbf-9146-4f6c-a5f1-5bc850334cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:36.635280 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaed8bbf-9146-4f6c-a5f1-5bc850334cc2 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:36.636406 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed8bbf-9146-4f6c-a5f1-5bc850334cc2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:36.637931 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaed8bbf-9146-4f6c-a5f1-5bc850334cc2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:36.651243 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf17c13-81c2-4a64-9ee1-ae3ebfc8bee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:36.651885 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf17c13-81c2-4a64-9ee1-ae3ebfc8bee1 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:36.652537 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf17c13-81c2-4a64-9ee1-ae3ebfc8bee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:36.652820 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf17c13-81c2-4a64-9ee1-ae3ebfc8bee1 None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:36.653570 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf17c13-81c2-4a64-9ee1-ae3ebfc8bee1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:36.653882 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf17c13-81c2-4a64-9ee1-ae3ebfc8bee1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:36.659370 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 443/871] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Jul 27 15:12:36 2022] POST /identity/v3/services => generated 251 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:12:36.659544 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf17c13-81c2-4a64-9ee1-ae3ebfc8bee1 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:36.659636 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a38f33-5154-4802-a9d7-29afedaeafbe None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:36.659636 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a38f33-5154-4802-a9d7-29afedaeafbe None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:36.659636 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a38f33-5154-4802-a9d7-29afedaeafbe None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:36.659636 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 444/872] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:36.664606 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c564a-927a-4380-bd9f-296ab9fcc757 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:36.664895 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c564a-927a-4380-bd9f-296ab9fcc757 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:36.665176 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c564a-927a-4380-bd9f-296ab9fcc757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:36.679852 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 429/873] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jul 27 15:12:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:36.680887 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf17c13-81c2-4a64-9ee1-ae3ebfc8bee1 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:36.684766 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d05c564a-927a-4380-bd9f-296ab9fcc757 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:36.686011 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d05c564a-927a-4380-bd9f-296ab9fcc757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:36.759709 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:36.780957 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:36.808138 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 445/874] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:36 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 15:12:36.818383 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf17c13-81c2-4a64-9ee1-ae3ebfc8bee1 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:36.831858 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c564a-927a-4380-bd9f-296ab9fcc757 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:36.858627 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645f4c4-458a-4da3-9a01-348feb30daf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:36.859636 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645f4c4-458a-4da3-9a01-348feb30daf9 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:36.859636 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645f4c4-458a-4da3-9a01-348feb30daf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:36.859829 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645f4c4-458a-4da3-9a01-348feb30daf9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:36.861528 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645f4c4-458a-4da3-9a01-348feb30daf9 None admin] RBAC: Adding query filter params (role.id=6a54ab92d32843d6bc4c2dcedae4bd13, scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5, user.id=b470b4c2ca1a4d1a8a864789bf603d02) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:36.861841 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645f4c4-458a-4da3-9a01-348feb30daf9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:36.863361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645f4c4-458a-4da3-9a01-348feb30daf9 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:36.870123 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 430/875] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:12:36 2022] GET /identity/v3/role_assignments?user.id=b470b4c2ca1a4d1a8a864789bf603d02&scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5&role.id=6a54ab92d32843d6bc4c2dcedae4bd13 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:36.955483 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c564a-927a-4380-bd9f-296ab9fcc757 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:36.998507 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c321c3e-4393-425a-b379-757777cb020d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:36.999420 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c321c3e-4393-425a-b379-757777cb020d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:36.999849 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c321c3e-4393-425a-b379-757777cb020d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:37.000288 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c321c3e-4393-425a-b379-757777cb020d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:37.001115 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c321c3e-4393-425a-b379-757777cb020d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:37.002664 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c321c3e-4393-425a-b379-757777cb020d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:37.013858 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-9c321c3e-4393-425a-b379-757777cb020d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 15:12:37.013858 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:37.013858 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 15:12:37.013858 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 15:12:37.013858 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 15:12:37.013858 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 15:12:37.013858 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 15:12:37.013858 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:37.013858 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 15:12:37.013858 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:37.013858 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 15:12:37.013858 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:37.013858 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:37.013858 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:37.013858 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:37.013858 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:37.013858 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:37.015159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:37.015159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:37.015159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:37.015159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:37.015159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:37.015159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:37.015159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 15:12:37.015159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 15:12:37.015159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 15:12:37.015159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 15:12:37.015159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:37.015159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:37.015159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:37.015159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:37.015159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:37.015159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:37.016235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:37.016235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:37.016235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:37.016235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:37.016235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:37.016235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:37.016235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:37.016235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:37.016235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:37.016235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:37.016235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 15:12:37.016235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:37.016235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 15:12:37.016235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:37.018797 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 446/876] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Jul 27 15:12:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:12:37.025580 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645f4c4-458a-4da3-9a01-348feb30daf9 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:37.132300 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645f4c4-458a-4da3-9a01-348feb30daf9 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:37.168012 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ed932-7f4c-451c-b2fb-72cb8b21e884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:37.168918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ed932-7f4c-451c-b2fb-72cb8b21e884 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:37.169353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ed932-7f4c-451c-b2fb-72cb8b21e884 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:37.169773 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ed932-7f4c-451c-b2fb-72cb8b21e884 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:37.170592 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ed932-7f4c-451c-b2fb-72cb8b21e884 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:37.171045 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ed932-7f4c-451c-b2fb-72cb8b21e884 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:37.172582 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ed932-7f4c-451c-b2fb-72cb8b21e884 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:37.178269 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 431/877] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Jul 27 15:12:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:37.184167 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c321c3e-4393-425a-b379-757777cb020d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:37.230523 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:37.246814 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab39a4-7ad2-4d2e-a9b2-6b77d107a0b2 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:37.247098 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab39a4-7ad2-4d2e-a9b2-6b77d107a0b2 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:37.247509 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cab39a4-7ad2-4d2e-a9b2-6b77d107a0b2 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:37.249578 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 432/878] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:37.258001 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284f121-4f52-4354-b804-afaad23ba656 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:37.258396 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284f121-4f52-4354-b804-afaad23ba656 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:37.258773 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284f121-4f52-4354-b804-afaad23ba656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:37.275964 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:37.284135 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-8284f121-4f52-4354-b804-afaad23ba656 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:37.285738 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8284f121-4f52-4354-b804-afaad23ba656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:37.301280 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c321c3e-4393-425a-b379-757777cb020d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:37.337930 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335cf5d0-47c7-45db-80d1-917e41c8630f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:37.338549 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335cf5d0-47c7-45db-80d1-917e41c8630f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:37.338832 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335cf5d0-47c7-45db-80d1-917e41c8630f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:37.339108 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335cf5d0-47c7-45db-80d1-917e41c8630f None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:37.339793 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335cf5d0-47c7-45db-80d1-917e41c8630f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:37.340129 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335cf5d0-47c7-45db-80d1-917e41c8630f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:37.341499 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335cf5d0-47c7-45db-80d1-917e41c8630f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:37.347923 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 447/879] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Jul 27 15:12:37 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:37.377585 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 433/880] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:37 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 15:12:37.399826 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335cf5d0-47c7-45db-80d1-917e41c8630f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:37.512811 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335cf5d0-47c7-45db-80d1-917e41c8630f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:37.520587 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:37.553481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15a0c03-b5a3-4f7d-b874-658d16b0b08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:37.554100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a0c03-b5a3-4f7d-b874-658d16b0b08a None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:37.554380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a0c03-b5a3-4f7d-b874-658d16b0b08a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:37.554657 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15a0c03-b5a3-4f7d-b874-658d16b0b08a None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:37.555368 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a0c03-b5a3-4f7d-b874-658d16b0b08a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:37.556748 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15a0c03-b5a3-4f7d-b874-658d16b0b08a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:37.574449 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 448/881] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Jul 27 15:12:37 2022] POST /identity/v3/services => generated 269 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:12:38.767582 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02eaf27-0cf8-4cb4-ad28-83cbd55b73e9 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:38.768171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02eaf27-0cf8-4cb4-ad28-83cbd55b73e9 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:38.768171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02eaf27-0cf8-4cb4-ad28-83cbd55b73e9 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:38.769788 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 434/882] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:38.775459 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40976b-2de0-45b7-9669-d93d13184640 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:38.775899 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40976b-2de0-45b7-9669-d93d13184640 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:38.776107 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40976b-2de0-45b7-9669-d93d13184640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:38.796393 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-1d40976b-2de0-45b7-9669-d93d13184640 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:38.797578 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1d40976b-2de0-45b7-9669-d93d13184640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:38.874997 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 449/883] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:12:38.897482 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02eaf27-0cf8-4cb4-ad28-83cbd55b73e9 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:39.005694 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02eaf27-0cf8-4cb4-ad28-83cbd55b73e9 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:39.042995 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadc83d-fb3c-4342-9eb7-b94fce0656e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:39.043700 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadc83d-fb3c-4342-9eb7-b94fce0656e6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:39.044004 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadc83d-fb3c-4342-9eb7-b94fce0656e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:39.044293 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadc83d-fb3c-4342-9eb7-b94fce0656e6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:39.044929 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eadc83d-fb3c-4342-9eb7-b94fce0656e6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:39.046302 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eadc83d-fb3c-4342-9eb7-b94fce0656e6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:39.048196 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:39.056176 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-8eadc83d-fb3c-4342-9eb7-b94fce0656e6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 15:12:39.056176 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:39.056176 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 15:12:39.056176 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 15:12:39.056176 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 15:12:39.056176 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 15:12:39.056176 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 15:12:39.056176 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:39.056176 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 15:12:39.056176 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:39.056176 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 15:12:39.056176 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:39.056176 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:39.056176 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:39.056176 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:39.056176 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:39.056176 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:39.057255 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:39.057255 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:39.057255 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:39.057255 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:39.057255 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:39.057255 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:39.057255 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 15:12:39.057255 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 15:12:39.057255 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 15:12:39.057255 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 15:12:39.057255 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:39.057255 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:39.057255 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:39.057255 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:39.057255 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:39.057255 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:39.058363 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:39.058363 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:39.058363 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:39.058363 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:39.058363 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:39.058363 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:39.058363 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:39.058363 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:39.058363 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:39.058363 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:39.058363 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 15:12:39.058363 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:39.058363 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 15:12:39.058363 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:39.058363 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 435/884] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jul 27 15:12:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:39.065643 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40976b-2de0-45b7-9669-d93d13184640 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:39.114407 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddeda2-f979-484b-af35-e518d8b6fc25 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:39.114786 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddeda2-f979-484b-af35-e518d8b6fc25 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:39.115002 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eddeda2-f979-484b-af35-e518d8b6fc25 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:39.117302 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 436/885] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:12:39.123866 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744e981-6560-444b-a60a-eb8a22c6141e None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:39.124200 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744e981-6560-444b-a60a-eb8a22c6141e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:39.124485 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e744e981-6560-444b-a60a-eb8a22c6141e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:39.149578 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-e744e981-6560-444b-a60a-eb8a22c6141e None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:39.150726 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e744e981-6560-444b-a60a-eb8a22c6141e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:39.169298 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:39.180390 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40976b-2de0-45b7-9669-d93d13184640 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:39.218794 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a162bcc-c503-4d13-bf8b-8894314808f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:39.219781 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a162bcc-c503-4d13-bf8b-8894314808f6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:39.220341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a162bcc-c503-4d13-bf8b-8894314808f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:39.220843 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a162bcc-c503-4d13-bf8b-8894314808f6 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:39.222032 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a162bcc-c503-4d13-bf8b-8894314808f6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:39.222552 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a162bcc-c503-4d13-bf8b-8894314808f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:39.224173 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a162bcc-c503-4d13-bf8b-8894314808f6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:39.234538 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 450/886] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jul 27 15:12:39 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:39.236230 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a162bcc-c503-4d13-bf8b-8894314808f6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:39.241606 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 437/887] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:39 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 15:12:39.265498 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744e981-6560-444b-a60a-eb8a22c6141e None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:39.351393 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a162bcc-c503-4d13-bf8b-8894314808f6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:39.370066 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e744e981-6560-444b-a60a-eb8a22c6141e None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:39.393984 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef81aa0-395c-4c4a-a8c4-2ae7223ed479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:39.395060 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef81aa0-395c-4c4a-a8c4-2ae7223ed479 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:39.395549 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef81aa0-395c-4c4a-a8c4-2ae7223ed479 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:39.396617 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef81aa0-395c-4c4a-a8c4-2ae7223ed479 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:39.397670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef81aa0-395c-4c4a-a8c4-2ae7223ed479 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:39.398443 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:39.399436 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef81aa0-395c-4c4a-a8c4-2ae7223ed479 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:39.401157 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef81aa0-395c-4c4a-a8c4-2ae7223ed479 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:39.407083 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2595c-d6d3-4f9c-b55b-60ec53bd838c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:39.407729 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2595c-d6d3-4f9c-b55b-60ec53bd838c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:39.408029 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2595c-d6d3-4f9c-b55b-60ec53bd838c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:39.408307 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2595c-d6d3-4f9c-b55b-60ec53bd838c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:39.412477 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 451/888] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jul 27 15:12:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:39.415537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd4f01-6b2a-42bd-a0c5-8874b7a74466 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:39.415829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd4f01-6b2a-42bd-a0c5-8874b7a74466 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:39.416184 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd4f01-6b2a-42bd-a0c5-8874b7a74466 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:39.417732 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 452/889] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:39.418685 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd4f01-6b2a-42bd-a0c5-8874b7a74466 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:39.420945 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2595c-d6d3-4f9c-b55b-60ec53bd838c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:12:39.426137 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-a9c2595c-d6d3-4f9c-b55b-60ec53bd838c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 15:12:39.426137 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:39.426137 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:39.426137 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:39.426137 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:39.426137 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:39.426137 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:39.426137 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:39.426137 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:39.426137 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:39.426137 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:39.426137 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:39.426137 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:12:39.426137 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:12:39.426137 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:12:39.426137 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:12:39.427115 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:12:39.427115 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:12:39.427115 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:12:39.427115 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:12:39.427115 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:39.427115 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:39.427115 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:39.427115 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:39.427115 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:39.427115 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:39.427115 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:39.427115 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:39.427115 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:39.427115 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:39.427115 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:39.427115 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:39.427968 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:39.427968 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:39.427968 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:39.427968 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:39.427968 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:12:39.427968 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:12:39.427968 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:12:39.427968 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:12:39.427968 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:12:39.427968 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:12:39.427968 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 15:12:39.427968 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:39.429261 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 438/890] 10.222.0.40 () {56 vars in 1120 bytes} [Wed Jul 27 15:12:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:12:39.430857 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df97a7-28c3-4a6e-9533-5c03c002ee26 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:39.431348 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df97a7-28c3-4a6e-9533-5c03c002ee26 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:39.431822 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68df97a7-28c3-4a6e-9533-5c03c002ee26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:39.440853 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:39.451650 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-68df97a7-28c3-4a6e-9533-5c03c002ee26 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:39.453174 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-68df97a7-28c3-4a6e-9533-5c03c002ee26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:39.523321 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd4f01-6b2a-42bd-a0c5-8874b7a74466 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:39.540012 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 439/891] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:39 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:12:39.540012 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df97a7-28c3-4a6e-9533-5c03c002ee26 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:39.562567 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da217f-e5f5-4b9c-8067-4de59fb60439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:39.563186 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da217f-e5f5-4b9c-8067-4de59fb60439 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:39.563466 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da217f-e5f5-4b9c-8067-4de59fb60439 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:39.563744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da217f-e5f5-4b9c-8067-4de59fb60439 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:39.564546 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da217f-e5f5-4b9c-8067-4de59fb60439 None admin] RBAC: Adding query filter params (interface=public, service_id=5c6be1a5535d47e48449c1c1bafd0895, region_id=RegionOne) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:39.564859 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da217f-e5f5-4b9c-8067-4de59fb60439 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:39.566211 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da217f-e5f5-4b9c-8067-4de59fb60439 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:39.572131 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 453/892] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Jul 27 15:12:39 2022] GET /identity/v3/endpoints?service_id=5c6be1a5535d47e48449c1c1bafd0895&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:39.572897 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da217f-e5f5-4b9c-8067-4de59fb60439 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:39.645213 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68df97a7-28c3-4a6e-9533-5c03c002ee26 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:39.661114 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:39.663210 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:39.677994 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da217f-e5f5-4b9c-8067-4de59fb60439 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:39.681075 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad0314-77d0-43ec-bc81-19c9925e0eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:39.681687 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad0314-77d0-43ec-bc81-19c9925e0eff None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:39.681971 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad0314-77d0-43ec-bc81-19c9925e0eff None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:39.682248 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ad0314-77d0-43ec-bc81-19c9925e0eff None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:39.682965 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad0314-77d0-43ec-bc81-19c9925e0eff None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:39.683272 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad0314-77d0-43ec-bc81-19c9925e0eff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:39.684739 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ad0314-77d0-43ec-bc81-19c9925e0eff None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:39.692475 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 440/893] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Jul 27 15:12:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:39.693877 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad0314-77d0-43ec-bc81-19c9925e0eff None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:39.712286 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d845e2-c041-472c-97a0-ee240c52a81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:39.712890 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d845e2-c041-472c-97a0-ee240c52a81b None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:39.713167 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d845e2-c041-472c-97a0-ee240c52a81b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:39.713439 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d845e2-c041-472c-97a0-ee240c52a81b None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:39.714156 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d845e2-c041-472c-97a0-ee240c52a81b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:39.715498 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d845e2-c041-472c-97a0-ee240c52a81b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:39.729551 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 454/894] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Jul 27 15:12:39 2022] POST /identity/v3/services => generated 241 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:12:39.730823 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e861afd-63df-4ad9-ba14-7f49b8f59333 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:39.731116 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e861afd-63df-4ad9-ba14-7f49b8f59333 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:39.731383 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e861afd-63df-4ad9-ba14-7f49b8f59333 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:39.736051 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 455/895] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:39.736051 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e861afd-63df-4ad9-ba14-7f49b8f59333 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:39.813429 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ad0314-77d0-43ec-bc81-19c9925e0eff None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:39.856168 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d401092-1cd1-41ef-a6ad-a375e312b1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:39.856801 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d401092-1cd1-41ef-a6ad-a375e312b1c1 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:39.857088 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d401092-1cd1-41ef-a6ad-a375e312b1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:39.857370 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d401092-1cd1-41ef-a6ad-a375e312b1c1 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:39.858014 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d401092-1cd1-41ef-a6ad-a375e312b1c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:39.859416 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d401092-1cd1-41ef-a6ad-a375e312b1c1 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:39.860272 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e861afd-63df-4ad9-ba14-7f49b8f59333 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:39.872037 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 441/896] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Jul 27 15:12:39 2022] GET /identity/v3/services => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:12:39.872037 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278a93b-862a-4a00-b549-e5859a15285c None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:39.872037 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278a93b-862a-4a00-b549-e5859a15285c None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:39.872037 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278a93b-862a-4a00-b549-e5859a15285c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:39.892541 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-9278a93b-862a-4a00-b549-e5859a15285c None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:39.893774 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9278a93b-862a-4a00-b549-e5859a15285c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:39.921683 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d808e20-eeee-486a-add4-517bdbce274b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:39.922259 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d808e20-eeee-486a-add4-517bdbce274b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:39.922546 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d808e20-eeee-486a-add4-517bdbce274b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:39.922816 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d808e20-eeee-486a-add4-517bdbce274b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:39.936097 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:39.940411 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d808e20-eeee-486a-add4-517bdbce274b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:39.940809 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:39.942799 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d808e20-eeee-486a-add4-517bdbce274b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:39.961810 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-7d808e20-eeee-486a-add4-517bdbce274b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:39.961810 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:39.961810 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:39.961810 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:39.961810 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:39.961810 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:39.961810 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:39.961810 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:39.961810 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:39.961810 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:39.961810 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:39.961810 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:39.961810 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:39.961810 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:39.961810 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:39.962796 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:39.962796 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:39.962796 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:39.962796 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:39.962796 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:39.962796 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:39.962796 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:39.962796 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:39.962796 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:39.962796 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:39.962796 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:39.962796 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:39.962796 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:39.962796 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:39.962796 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:39.962796 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:39.962796 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:39.963873 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:39.963873 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:39.963873 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:39.963873 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:39.963873 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 456/897] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:39.969119 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d808e20-eeee-486a-add4-517bdbce274b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:39.991908 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 442/898] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:12:40.013965 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278a93b-862a-4a00-b549-e5859a15285c None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:40.094888 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d808e20-eeee-486a-add4-517bdbce274b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:40.135146 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278a93b-862a-4a00-b549-e5859a15285c None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:40.136449 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9faf9f4-d9ba-4cf8-a92e-957475eef05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:40.137126 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9faf9f4-d9ba-4cf8-a92e-957475eef05d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:40.137420 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9faf9f4-d9ba-4cf8-a92e-957475eef05d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:40.137716 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9faf9f4-d9ba-4cf8-a92e-957475eef05d None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:40.138386 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9faf9f4-d9ba-4cf8-a92e-957475eef05d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:40.138687 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9faf9f4-d9ba-4cf8-a92e-957475eef05d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:40.140069 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9faf9f4-d9ba-4cf8-a92e-957475eef05d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:40.152756 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 457/899] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:40.158101 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9faf9f4-d9ba-4cf8-a92e-957475eef05d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:40.175720 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f370ec2-e205-4975-ba96-9a80cb62513e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:40.176768 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f370ec2-e205-4975-ba96-9a80cb62513e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:40.177797 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f370ec2-e205-4975-ba96-9a80cb62513e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:40.178365 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f370ec2-e205-4975-ba96-9a80cb62513e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:40.179178 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f370ec2-e205-4975-ba96-9a80cb62513e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:40.180785 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f370ec2-e205-4975-ba96-9a80cb62513e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:40.190989 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-4f370ec2-e205-4975-ba96-9a80cb62513e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 15:12:40.190989 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:40.190989 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 15:12:40.190989 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 15:12:40.190989 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 15:12:40.190989 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 15:12:40.190989 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 15:12:40.190989 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:40.190989 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 15:12:40.190989 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:40.190989 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 15:12:40.190989 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:40.190989 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:40.190989 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:40.190989 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:40.190989 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:40.191926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:40.191926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:40.191926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:40.191926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:40.191926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:40.191926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:40.191926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:40.191926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 15:12:40.191926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 15:12:40.191926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 15:12:40.191926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 15:12:40.191926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:40.191926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:40.191926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:40.191926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:40.191926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:40.192842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:40.192842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:40.192842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:40.192842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:40.192842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:40.192842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:40.192842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:40.192842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:40.192842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:40.192842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:40.192842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:40.192842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 15:12:40.192842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:40.192842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 15:12:40.192842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:40.195691 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 443/900] 10.222.0.40 () {56 vars in 1132 bytes} [Wed Jul 27 15:12:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:40.206000 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f370ec2-e205-4975-ba96-9a80cb62513e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:40.218751 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:40.254185 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:40.275180 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9faf9f4-d9ba-4cf8-a92e-957475eef05d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:40.311784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1884e47-0994-4176-8892-61fba5c7ae41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:40.312512 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1884e47-0994-4176-8892-61fba5c7ae41 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:40.312796 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1884e47-0994-4176-8892-61fba5c7ae41 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:40.313069 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1884e47-0994-4176-8892-61fba5c7ae41 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:40.321059 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1884e47-0994-4176-8892-61fba5c7ae41 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:40.322497 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1884e47-0994-4176-8892-61fba5c7ae41 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:40.324829 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f370ec2-e205-4975-ba96-9a80cb62513e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:40.335234 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-b1884e47-0994-4176-8892-61fba5c7ae41 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 15:12:40.335234 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:40.335234 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:40.335234 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:40.335234 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:40.335234 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:40.335234 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:40.335234 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:40.335234 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:40.335234 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:40.335234 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:40.335234 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:40.335234 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:12:40.335234 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:12:40.335234 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:12:40.335234 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:12:40.336296 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:40.336296 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:40.336296 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:12:40.336296 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:40.336296 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:12:40.336296 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:40.336296 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:40.336296 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:40.336296 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:40.336296 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:40.336296 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:40.336296 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:40.336296 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:40.336296 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:40.336296 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:40.336296 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:40.336296 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:40.336296 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:40.337862 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:40.337862 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:40.337862 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:12:40.337862 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:12:40.337862 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:12:40.337862 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:12:40.337862 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:12:40.337862 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:12:40.337862 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 15:12:40.337862 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:40.337862 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 458/901] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Jul 27 15:12:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:12:40.342529 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1884e47-0994-4176-8892-61fba5c7ae41 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:40.366724 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed48aba-fdfa-4d0a-bc16-eefb66ce6339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:40.367340 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed48aba-fdfa-4d0a-bc16-eefb66ce6339 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:40.367618 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed48aba-fdfa-4d0a-bc16-eefb66ce6339 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:40.367890 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed48aba-fdfa-4d0a-bc16-eefb66ce6339 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:40.368617 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed48aba-fdfa-4d0a-bc16-eefb66ce6339 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:40.368920 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed48aba-fdfa-4d0a-bc16-eefb66ce6339 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:40.370280 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed48aba-fdfa-4d0a-bc16-eefb66ce6339 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:40.375695 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 444/902] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Jul 27 15:12:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:40.385292 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed48aba-fdfa-4d0a-bc16-eefb66ce6339 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:40.464775 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1884e47-0994-4176-8892-61fba5c7ae41 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:40.482108 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:40.505998 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:40.509329 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80618857-d176-4a01-a8d9-3e32bea49dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:40.509953 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80618857-d176-4a01-a8d9-3e32bea49dfe None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:40.510233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80618857-d176-4a01-a8d9-3e32bea49dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:40.510505 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80618857-d176-4a01-a8d9-3e32bea49dfe None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:40.511301 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80618857-d176-4a01-a8d9-3e32bea49dfe None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:40.511546 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed48aba-fdfa-4d0a-bc16-eefb66ce6339 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:40.511813 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80618857-d176-4a01-a8d9-3e32bea49dfe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:40.513262 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80618857-d176-4a01-a8d9-3e32bea49dfe None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:40.541656 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 459/903] 10.222.0.40 () {56 vars in 1149 bytes} [Wed Jul 27 15:12:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:40.546870 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80618857-d176-4a01-a8d9-3e32bea49dfe None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:40.556013 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf128e-9d69-41da-8e75-50d56b4ca77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:40.556967 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf128e-9d69-41da-8e75-50d56b4ca77a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:40.557502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf128e-9d69-41da-8e75-50d56b4ca77a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:40.557978 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adf128e-9d69-41da-8e75-50d56b4ca77a None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:40.559310 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf128e-9d69-41da-8e75-50d56b4ca77a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:40.559832 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf128e-9d69-41da-8e75-50d56b4ca77a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:40.562110 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adf128e-9d69-41da-8e75-50d56b4ca77a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:40.569470 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 445/904] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Jul 27 15:12:40 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:40.579162 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf128e-9d69-41da-8e75-50d56b4ca77a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:40.680954 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80618857-d176-4a01-a8d9-3e32bea49dfe None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:40.705766 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adf128e-9d69-41da-8e75-50d56b4ca77a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:40.725827 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f9e25-030e-4273-81b2-e9817fb43a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:40.726389 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f9e25-030e-4273-81b2-e9817fb43a74 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:40.726916 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f9e25-030e-4273-81b2-e9817fb43a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:40.727200 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934f9e25-030e-4273-81b2-e9817fb43a74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:40.747667 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ffa2e-dd22-46a1-b502-da8bef7abf24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:40.748838 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ffa2e-dd22-46a1-b502-da8bef7abf24 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:40.749263 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ffa2e-dd22-46a1-b502-da8bef7abf24 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:40.749820 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ffa2e-dd22-46a1-b502-da8bef7abf24 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:40.751001 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ffa2e-dd22-46a1-b502-da8bef7abf24 None admin] RBAC: Adding query filter params (interface=public, service_id=deb7e38f45134add9d7ede256f5ac58f, region_id=RegionOne) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:40.751463 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ffa2e-dd22-46a1-b502-da8bef7abf24 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:40.753005 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ffa2e-dd22-46a1-b502-da8bef7abf24 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:40.765163 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 446/905] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Jul 27 15:12:40 2022] GET /identity/v3/endpoints?service_id=deb7e38f45134add9d7ede256f5ac58f&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:40.765868 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ffa2e-dd22-46a1-b502-da8bef7abf24 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:40.780598 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:40.801736 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:40.820995 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f9e25-030e-4273-81b2-e9817fb43a74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:40.822896 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934f9e25-030e-4273-81b2-e9817fb43a74 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:40.903794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ffa2e-dd22-46a1-b502-da8bef7abf24 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:40.943826 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 460/906] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:12:40 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 15:12:40.948975 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f9e25-030e-4273-81b2-e9817fb43a74 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:40.952584 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf913d4-1f86-4b09-93c6-f7a8186c9bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:40.953202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf913d4-1f86-4b09-93c6-f7a8186c9bfb None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:40.953477 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf913d4-1f86-4b09-93c6-f7a8186c9bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:40.953743 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf913d4-1f86-4b09-93c6-f7a8186c9bfb None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:40.954393 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf913d4-1f86-4b09-93c6-f7a8186c9bfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:40.955742 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf913d4-1f86-4b09-93c6-f7a8186c9bfb None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:40.968019 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 447/907] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Jul 27 15:12:40 2022] GET /identity/v3/services => generated 1497 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:12:41.033313 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:41.070896 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934f9e25-030e-4273-81b2-e9817fb43a74 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:41.107061 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c2d80-fabd-42e3-880e-87533033a7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:41.107756 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c2d80-fabd-42e3-880e-87533033a7b6 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:41.108059 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c2d80-fabd-42e3-880e-87533033a7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:41.108333 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c2d80-fabd-42e3-880e-87533033a7b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:41.119892 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c2d80-fabd-42e3-880e-87533033a7b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:41.121391 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c2d80-fabd-42e3-880e-87533033a7b6 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:41.137759 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-442c2d80-fabd-42e3-880e-87533033a7b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:41.137759 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:41.137759 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:41.137759 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:41.137759 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:41.137759 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:41.137759 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:41.137759 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:41.137759 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:41.137759 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:41.137759 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:41.137759 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:41.137759 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:41.137759 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:41.137759 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:41.138719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:41.138719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:41.138719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:41.138719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:41.138719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:41.138719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:41.138719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:41.138719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:41.138719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:41.138719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:41.138719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:41.138719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:41.138719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:41.138719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:41.138719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:41.138719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:41.138719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:41.139605 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:41.139605 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:41.139605 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:41.139605 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:41.139605 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 461/908] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:41.144810 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf913d4-1f86-4b09-93c6-f7a8186c9bfb None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:41.238307 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:41.248714 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf913d4-1f86-4b09-93c6-f7a8186c9bfb None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:41.285581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccebf5c-02c0-4f23-bc70-cdabfabc0c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:41.286134 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccebf5c-02c0-4f23-bc70-cdabfabc0c95 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:41.286445 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccebf5c-02c0-4f23-bc70-cdabfabc0c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:41.286725 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccebf5c-02c0-4f23-bc70-cdabfabc0c95 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:41.287423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccebf5c-02c0-4f23-bc70-cdabfabc0c95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:41.287734 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccebf5c-02c0-4f23-bc70-cdabfabc0c95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:41.292182 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccebf5c-02c0-4f23-bc70-cdabfabc0c95 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:41.304111 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 448/909] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:41.309375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c2d80-fabd-42e3-880e-87533033a7b6 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:41.415965 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c2d80-fabd-42e3-880e-87533033a7b6 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:41.441426 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:41.455065 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07d48c-df7e-4ff2-876f-3487b19d8f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:41.455705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07d48c-df7e-4ff2-876f-3487b19d8f7d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:41.456004 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07d48c-df7e-4ff2-876f-3487b19d8f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:41.456289 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07d48c-df7e-4ff2-876f-3487b19d8f7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:41.463372 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07d48c-df7e-4ff2-876f-3487b19d8f7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:41.464844 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07d48c-df7e-4ff2-876f-3487b19d8f7d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:41.477105 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-3f07d48c-df7e-4ff2-876f-3487b19d8f7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:41.477105 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:41.477105 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:41.477105 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:41.477105 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:41.477105 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:41.477105 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:41.477105 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:41.477105 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:41.477105 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:41.477105 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:41.477105 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:41.477105 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:12:41.477105 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:12:41.477105 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:12:41.478031 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:12:41.478031 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:41.478031 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:41.478031 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:41.478031 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:41.478031 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:41.478031 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:41.478031 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:41.478031 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:41.478031 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:41.478031 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:41.478031 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:41.478031 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:41.478031 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:41.478031 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:41.478031 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:41.478031 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:41.478912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:12:41.478912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:12:41.478912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:12:41.478912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:12:41.478912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:12:41.478912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:12:41.478912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:41.478912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:41.478912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 462/910] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:12:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:41.484335 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccebf5c-02c0-4f23-bc70-cdabfabc0c95 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:41.596084 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccebf5c-02c0-4f23-bc70-cdabfabc0c95 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:41.632999 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c83c76-a562-4d62-a046-181735be94b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:41.633616 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c83c76-a562-4d62-a046-181735be94b1 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:41.633897 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c83c76-a562-4d62-a046-181735be94b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:41.634173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c83c76-a562-4d62-a046-181735be94b1 None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:41.634974 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c83c76-a562-4d62-a046-181735be94b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:41.635293 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c83c76-a562-4d62-a046-181735be94b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:41.636755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c83c76-a562-4d62-a046-181735be94b1 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:41.649275 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 449/911] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jul 27 15:12:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:41.655187 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07d48c-df7e-4ff2-876f-3487b19d8f7d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:41.761444 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07d48c-df7e-4ff2-876f-3487b19d8f7d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:41.801010 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fc93f-631e-491a-8eaa-3d21c60a11c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:41.801999 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fc93f-631e-491a-8eaa-3d21c60a11c8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:41.802287 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fc93f-631e-491a-8eaa-3d21c60a11c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:41.802557 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fc93f-631e-491a-8eaa-3d21c60a11c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:41.803354 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fc93f-631e-491a-8eaa-3d21c60a11c8 None admin] RBAC: Adding query filter params (role.id=c0bb546247e847f1a87281d2a3bb21e7, scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5, user.id=b470b4c2ca1a4d1a8a864789bf603d02) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:41.803660 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fc93f-631e-491a-8eaa-3d21c60a11c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:41.805147 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fc93f-631e-491a-8eaa-3d21c60a11c8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:41.811337 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 463/912] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:12:41 2022] GET /identity/v3/role_assignments?user.id=b470b4c2ca1a4d1a8a864789bf603d02&scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5&role.id=c0bb546247e847f1a87281d2a3bb21e7 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:41.886171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e621b0-b993-4cb6-a118-83c8f51d1dd4 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:41.886484 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e621b0-b993-4cb6-a118-83c8f51d1dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:41.886648 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e621b0-b993-4cb6-a118-83c8f51d1dd4 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:41.888154 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 450/913] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:41.893757 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36093697-f3d7-4a32-8134-66fc85ef7bff None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:41.894080 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36093697-f3d7-4a32-8134-66fc85ef7bff None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:41.894301 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36093697-f3d7-4a32-8134-66fc85ef7bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:41.914944 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-36093697-f3d7-4a32-8134-66fc85ef7bff None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:41.916534 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-36093697-f3d7-4a32-8134-66fc85ef7bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:41.963895 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:41.981059 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02136c8-617a-4eae-b0dc-9090419c703b None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:41.981992 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02136c8-617a-4eae-b0dc-9090419c703b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:41.982545 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02136c8-617a-4eae-b0dc-9090419c703b None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:41.984410 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 451/914] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:41.990019 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d80dd-b5d5-45af-be0e-862956177a38 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:41.990161 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 464/915] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:12:41.990358 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d80dd-b5d5-45af-be0e-862956177a38 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:41.990639 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2d80dd-b5d5-45af-be0e-862956177a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:42.009662 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-4b2d80dd-b5d5-45af-be0e-862956177a38 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:42.010917 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-4b2d80dd-b5d5-45af-be0e-862956177a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:42.012090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36093697-f3d7-4a32-8134-66fc85ef7bff None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:42.020267 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:42.098384 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 452/916] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 15:12:42.120692 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d80dd-b5d5-45af-be0e-862956177a38 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:42.122356 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36093697-f3d7-4a32-8134-66fc85ef7bff None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:42.159012 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc75407-aa86-455f-8b4a-88f25d39399f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:42.160042 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc75407-aa86-455f-8b4a-88f25d39399f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:42.160514 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc75407-aa86-455f-8b4a-88f25d39399f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:42.160849 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc75407-aa86-455f-8b4a-88f25d39399f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:42.161581 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc75407-aa86-455f-8b4a-88f25d39399f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:42.163001 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc75407-aa86-455f-8b4a-88f25d39399f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:42.172461 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-9cc75407-aa86-455f-8b4a-88f25d39399f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 15:12:42.172461 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:42.172461 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 15:12:42.172461 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 15:12:42.172461 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 15:12:42.172461 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 15:12:42.172461 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 15:12:42.172461 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:42.172461 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 15:12:42.172461 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:42.172461 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 15:12:42.172461 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:42.172461 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:42.172461 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:42.172461 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:42.172461 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:42.172461 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:42.173471 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:42.173471 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:42.173471 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:42.173471 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:42.173471 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:42.173471 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:42.173471 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 15:12:42.173471 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 15:12:42.173471 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 15:12:42.173471 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 15:12:42.173471 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:42.173471 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:42.173471 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:42.173471 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:42.173471 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:42.173471 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:42.174585 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:42.174585 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:42.174585 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:42.174585 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:42.174585 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:42.174585 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:42.174585 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:42.174585 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:42.174585 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:42.174585 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:42.174585 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 15:12:42.174585 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:42.174585 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 15:12:42.174585 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:42.174585 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 465/917] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Jul 27 15:12:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:42.179819 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc75407-aa86-455f-8b4a-88f25d39399f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:42.234418 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:42.238509 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2d80dd-b5d5-45af-be0e-862956177a38 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:42.276377 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8db113-3111-47bd-b605-30f373a4096c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:42.277019 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8db113-3111-47bd-b605-30f373a4096c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:42.277296 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8db113-3111-47bd-b605-30f373a4096c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:42.277839 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8db113-3111-47bd-b605-30f373a4096c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:42.278461 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8db113-3111-47bd-b605-30f373a4096c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:42.279902 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8db113-3111-47bd-b605-30f373a4096c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:42.290344 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-5c8db113-3111-47bd-b605-30f373a4096c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 15:12:42.290344 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:42.290344 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 15:12:42.290344 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 15:12:42.290344 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 15:12:42.290344 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 15:12:42.290344 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 15:12:42.290344 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:42.290344 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 15:12:42.290344 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:42.290344 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 15:12:42.290344 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:42.290344 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:42.290344 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:42.290344 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:42.290344 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:42.290344 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:42.291372 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:42.291372 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:42.291372 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:42.291372 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:42.291372 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:42.291372 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:42.291372 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 15:12:42.291372 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 15:12:42.291372 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 15:12:42.291372 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 15:12:42.291372 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:42.291372 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:42.291372 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:42.291372 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:42.291372 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:42.291372 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:42.296851 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:42.296851 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:42.296851 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:42.296851 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:42.296851 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:42.296851 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:42.296851 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:42.296851 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:42.296851 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:42.296851 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:42.296851 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 15:12:42.296851 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:42.296851 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 15:12:42.296851 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:42.296851 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 453/918] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jul 27 15:12:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:12:42.299696 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8db113-3111-47bd-b605-30f373a4096c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:42.304417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:42.312799 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc75407-aa86-455f-8b4a-88f25d39399f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:42.354430 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5e054-c1c2-473d-a39d-48d4e63aa1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:42.355037 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5e054-c1c2-473d-a39d-48d4e63aa1fe None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:42.355312 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5e054-c1c2-473d-a39d-48d4e63aa1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:42.355580 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5e054-c1c2-473d-a39d-48d4e63aa1fe None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:42.356301 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff5e054-c1c2-473d-a39d-48d4e63aa1fe None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:42.356602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff5e054-c1c2-473d-a39d-48d4e63aa1fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:42.358400 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff5e054-c1c2-473d-a39d-48d4e63aa1fe None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:42.364696 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 466/919] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Jul 27 15:12:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:42.370060 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5e054-c1c2-473d-a39d-48d4e63aa1fe None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:42.431228 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8db113-3111-47bd-b605-30f373a4096c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:42.474015 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420c370-3716-47ad-8f03-45d1d15a2a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:42.474977 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420c370-3716-47ad-8f03-45d1d15a2a78 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:42.475455 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420c370-3716-47ad-8f03-45d1d15a2a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:42.477264 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c420c370-3716-47ad-8f03-45d1d15a2a78 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:42.477955 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c420c370-3716-47ad-8f03-45d1d15a2a78 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:42.478262 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c420c370-3716-47ad-8f03-45d1d15a2a78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:42.479633 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c420c370-3716-47ad-8f03-45d1d15a2a78 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:42.489688 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 454/920] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jul 27 15:12:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:42.490520 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420c370-3716-47ad-8f03-45d1d15a2a78 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:42.492172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5e054-c1c2-473d-a39d-48d4e63aa1fe None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:42.495085 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:42.531690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e56b1-3863-4577-96be-da175b2d97fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:42.532620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e56b1-3863-4577-96be-da175b2d97fc None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:42.532999 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e56b1-3863-4577-96be-da175b2d97fc None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:42.533366 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e56b1-3863-4577-96be-da175b2d97fc None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:42.534197 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e56b1-3863-4577-96be-da175b2d97fc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:42.534600 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e56b1-3863-4577-96be-da175b2d97fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:42.536238 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e56b1-3863-4577-96be-da175b2d97fc None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:42.542494 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 467/921] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Jul 27 15:12:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:42.547885 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e56b1-3863-4577-96be-da175b2d97fc None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:42.569454 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:42.619530 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c420c370-3716-47ad-8f03-45d1d15a2a78 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:42.656230 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f09aa-dcbd-4a48-b883-ff9e886512b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:42.657253 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f09aa-dcbd-4a48-b883-ff9e886512b5 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:42.657779 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f09aa-dcbd-4a48-b883-ff9e886512b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:42.658280 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073f09aa-dcbd-4a48-b883-ff9e886512b5 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:42.659145 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f09aa-dcbd-4a48-b883-ff9e886512b5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:42.659738 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f09aa-dcbd-4a48-b883-ff9e886512b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:42.661440 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073f09aa-dcbd-4a48-b883-ff9e886512b5 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:42.663234 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e56b1-3863-4577-96be-da175b2d97fc None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:42.672198 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 455/922] 10.222.0.40 () {56 vars in 1114 bytes} [Wed Jul 27 15:12:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:42.673371 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f09aa-dcbd-4a48-b883-ff9e886512b5 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:42.699018 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed4d0e-37f3-4b7d-886f-c276d819a1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:42.699584 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed4d0e-37f3-4b7d-886f-c276d819a1e0 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:42.699864 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed4d0e-37f3-4b7d-886f-c276d819a1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:42.700167 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ed4d0e-37f3-4b7d-886f-c276d819a1e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:42.700920 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed4d0e-37f3-4b7d-886f-c276d819a1e0 None admin] RBAC: Adding query filter params (interface=public, service_id=ddf36a97770149aeb05e7cf4bc9bb68f, region_id=RegionOne) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:42.701223 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed4d0e-37f3-4b7d-886f-c276d819a1e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:42.702567 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ed4d0e-37f3-4b7d-886f-c276d819a1e0 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:42.708007 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 468/923] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Jul 27 15:12:42 2022] GET /identity/v3/endpoints?service_id=ddf36a97770149aeb05e7cf4bc9bb68f&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:42.713399 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed4d0e-37f3-4b7d-886f-c276d819a1e0 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:42.750937 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:42.793099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073f09aa-dcbd-4a48-b883-ff9e886512b5 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:42.824630 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ed4d0e-37f3-4b7d-886f-c276d819a1e0 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:42.824880 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:42.831539 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de8642f-32df-497d-af7d-73e8ca8bcf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:42.832415 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8642f-32df-497d-af7d-73e8ca8bcf3f None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:42.832835 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8642f-32df-497d-af7d-73e8ca8bcf3f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:42.833839 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de8642f-32df-497d-af7d-73e8ca8bcf3f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:42.835056 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de8642f-32df-497d-af7d-73e8ca8bcf3f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:42.836737 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de8642f-32df-497d-af7d-73e8ca8bcf3f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:42.858615 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 456/924] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:12:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:12:42.875345 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52004421-28de-426f-93ad-62170b2cf3af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:42.876424 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52004421-28de-426f-93ad-62170b2cf3af None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:42.876918 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52004421-28de-426f-93ad-62170b2cf3af None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:42.877404 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52004421-28de-426f-93ad-62170b2cf3af None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:42.878307 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52004421-28de-426f-93ad-62170b2cf3af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:42.880018 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52004421-28de-426f-93ad-62170b2cf3af None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:42.888912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 469/925] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Jul 27 15:12:42 2022] GET /identity/v3/services => generated 1497 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 15:12:43.174739 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bffa0-57f1-48f9-8fac-e6b68b3a9b07 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:43.175259 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bffa0-57f1-48f9-8fac-e6b68b3a9b07 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:43.175259 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bffa0-57f1-48f9-8fac-e6b68b3a9b07 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:43.177156 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 457/926] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:12:43.183418 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e796b1-919f-4e3f-bb80-a16ad4f124e4 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:43.183898 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e796b1-919f-4e3f-bb80-a16ad4f124e4 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:43.183974 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e796b1-919f-4e3f-bb80-a16ad4f124e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:43.202683 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-72e796b1-919f-4e3f-bb80-a16ad4f124e4 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:43.204000 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-72e796b1-919f-4e3f-bb80-a16ad4f124e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:43.276348 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 470/927] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:12:43.300285 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3bffa0-57f1-48f9-8fac-e6b68b3a9b07 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:43.415157 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3bffa0-57f1-48f9-8fac-e6b68b3a9b07 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:43.451929 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3429a1-ffe0-4f4b-b908-b74375fa39b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:43.452528 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3429a1-ffe0-4f4b-b908-b74375fa39b5 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:43.452807 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3429a1-ffe0-4f4b-b908-b74375fa39b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:43.453080 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3429a1-ffe0-4f4b-b908-b74375fa39b5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:43.453706 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3429a1-ffe0-4f4b-b908-b74375fa39b5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:43.455072 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3429a1-ffe0-4f4b-b908-b74375fa39b5 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:43.464937 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-1b3429a1-ffe0-4f4b-b908-b74375fa39b5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 15:12:43.464937 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:43.464937 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 15:12:43.464937 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 15:12:43.464937 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 15:12:43.464937 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 15:12:43.464937 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 15:12:43.464937 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:43.464937 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 15:12:43.464937 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:43.464937 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 15:12:43.464937 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:43.464937 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:43.464937 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:43.464937 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:43.464937 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:43.465887 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:43.465887 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:43.465887 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:43.465887 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:43.465887 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:43.465887 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:43.465887 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:43.465887 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 15:12:43.465887 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 15:12:43.465887 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 15:12:43.465887 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 15:12:43.465887 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:43.465887 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:43.465887 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:43.465887 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:43.465887 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:43.466949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:43.466949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:43.466949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:43.466949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:43.466949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:43.466949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:43.466949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:43.466949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:43.466949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:43.466949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:43.466949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:43.466949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 15:12:43.466949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:43.466949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 15:12:43.466949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:43.466949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 458/928] 10.222.0.40 () {56 vars in 1132 bytes} [Wed Jul 27 15:12:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:43.475092 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e796b1-919f-4e3f-bb80-a16ad4f124e4 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:43.504471 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:43.596015 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e796b1-919f-4e3f-bb80-a16ad4f124e4 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:43.626103 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160b261-8985-4020-b18b-78a4d19bfe9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:43.626769 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160b261-8985-4020-b18b-78a4d19bfe9a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:43.627050 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160b261-8985-4020-b18b-78a4d19bfe9a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:43.627318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160b261-8985-4020-b18b-78a4d19bfe9a None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:43.628003 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160b261-8985-4020-b18b-78a4d19bfe9a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:43.628312 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160b261-8985-4020-b18b-78a4d19bfe9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:43.629657 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160b261-8985-4020-b18b-78a4d19bfe9a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:43.634748 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 471/929] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Jul 27 15:12:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:43.640674 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3429a1-ffe0-4f4b-b908-b74375fa39b5 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:43.699161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:43.753556 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3429a1-ffe0-4f4b-b908-b74375fa39b5 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:43.792171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc71ed5-72b0-4edc-b5af-dc60a8f24e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:43.792797 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc71ed5-72b0-4edc-b5af-dc60a8f24e9c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:43.793081 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc71ed5-72b0-4edc-b5af-dc60a8f24e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:43.793355 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc71ed5-72b0-4edc-b5af-dc60a8f24e9c None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:43.794040 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc71ed5-72b0-4edc-b5af-dc60a8f24e9c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:43.794347 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc71ed5-72b0-4edc-b5af-dc60a8f24e9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:43.795711 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc71ed5-72b0-4edc-b5af-dc60a8f24e9c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:43.800976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 459/930] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Jul 27 15:12:43 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:43.806691 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160b261-8985-4020-b18b-78a4d19bfe9a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:43.912541 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:43.927759 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8308996-6c75-4036-af84-5398edc7ee11 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:43.928078 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160b261-8985-4020-b18b-78a4d19bfe9a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:43.928565 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8308996-6c75-4036-af84-5398edc7ee11 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:43.929073 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8308996-6c75-4036-af84-5398edc7ee11 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:43.934348 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 460/931] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:12:43.936026 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67dd7f-3c16-4b7c-8b7a-86ca6b457861 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:43.936553 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67dd7f-3c16-4b7c-8b7a-86ca6b457861 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:43.937033 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c67dd7f-3c16-4b7c-8b7a-86ca6b457861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:43.955906 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-7c67dd7f-3c16-4b7c-8b7a-86ca6b457861 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:43.957545 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-7c67dd7f-3c16-4b7c-8b7a-86ca6b457861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:43.963741 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b01b9-3c18-4c19-9f09-983511cf0fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:43.964389 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b01b9-3c18-4c19-9f09-983511cf0fc1 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:43.964669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b01b9-3c18-4c19-9f09-983511cf0fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:43.964940 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3b01b9-3c18-4c19-9f09-983511cf0fc1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:43.965659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b01b9-3c18-4c19-9f09-983511cf0fc1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:43.967005 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3b01b9-3c18-4c19-9f09-983511cf0fc1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:43.996024 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 472/932] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:12:43 2022] POST /identity/v3/endpoints => generated 347 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:12:44.050867 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 461/933] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 15:12:44.074327 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b01b9-3c18-4c19-9f09-983511cf0fc1 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:44.199604 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3b01b9-3c18-4c19-9f09-983511cf0fc1 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:44.238405 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018eaa2-5692-4e9c-bd9a-77a349013805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:44.239043 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018eaa2-5692-4e9c-bd9a-77a349013805 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:44.239371 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018eaa2-5692-4e9c-bd9a-77a349013805 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:44.239677 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018eaa2-5692-4e9c-bd9a-77a349013805 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:44.250456 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2018eaa2-5692-4e9c-bd9a-77a349013805 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:12:44.256535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-2018eaa2-5692-4e9c-bd9a-77a349013805 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 15:12:44.256535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:44.256535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:44.256535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:44.256535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:44.256535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:44.256535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:44.256535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:44.256535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:44.256535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:44.256535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:44.256535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:44.256535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:12:44.256535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:12:44.256535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:12:44.256535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:12:44.257517 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:12:44.257517 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:12:44.257517 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:12:44.257517 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:12:44.257517 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:44.257517 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:44.257517 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:44.257517 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:44.257517 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:44.257517 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:44.257517 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:44.257517 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:44.257517 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:44.257517 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:44.257517 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:44.257517 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:44.258533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:44.258533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:44.258533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:44.258533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:44.258533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:12:44.258533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:12:44.258533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:12:44.258533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:12:44.258533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:12:44.258533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:12:44.258533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 15:12:44.258533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:44.258533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 473/934] 10.222.0.40 () {56 vars in 1120 bytes} [Wed Jul 27 15:12:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:44.265720 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67dd7f-3c16-4b7c-8b7a-86ca6b457861 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:44.311370 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:44.371396 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c67dd7f-3c16-4b7c-8b7a-86ca6b457861 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:44.406913 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0b96c-334f-4711-8acb-8868d64b2060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:44.407535 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0b96c-334f-4711-8acb-8868d64b2060 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:44.407816 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0b96c-334f-4711-8acb-8868d64b2060 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:44.408118 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0b96c-334f-4711-8acb-8868d64b2060 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:44.408840 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0b96c-334f-4711-8acb-8868d64b2060 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:44.409147 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0b96c-334f-4711-8acb-8868d64b2060 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:44.410502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0b96c-334f-4711-8acb-8868d64b2060 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:44.419325 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 462/935] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Jul 27 15:12:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:44.425044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018eaa2-5692-4e9c-bd9a-77a349013805 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:44.428996 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:44.536022 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2018eaa2-5692-4e9c-bd9a-77a349013805 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:44.596455 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b91d46-1d0c-472c-9655-ddbde95c446b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:44.597406 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b91d46-1d0c-472c-9655-ddbde95c446b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:44.597903 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b91d46-1d0c-472c-9655-ddbde95c446b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:44.598381 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b91d46-1d0c-472c-9655-ddbde95c446b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:44.611676 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b91d46-1d0c-472c-9655-ddbde95c446b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:44.613479 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b91d46-1d0c-472c-9655-ddbde95c446b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:44.633346 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-10b91d46-1d0c-472c-9655-ddbde95c446b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:44.633346 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:44.633346 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:44.633346 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:44.633346 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:44.633346 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:44.633346 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:44.633346 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:44.633346 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:44.633346 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:44.633346 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:44.633346 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:44.633346 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:44.633346 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:44.633346 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:44.634380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:44.634380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:44.634380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:44.634380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:44.634380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:44.634380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:44.634380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:44.634380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:44.634380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:44.634380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:44.634380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:44.634380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:44.634380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:44.634380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:44.634380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:44.634380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:44.634380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:44.635723 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:44.635723 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:44.635723 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:44.635723 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:44.635723 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 474/936] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:44.641961 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0b96c-334f-4711-8acb-8868d64b2060 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:44.744884 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0b96c-334f-4711-8acb-8868d64b2060 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:44.747234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:44.780455 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabcb481-5bfd-444b-97e4-73dcdcbf0fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:44.781077 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabcb481-5bfd-444b-97e4-73dcdcbf0fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:44.781359 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabcb481-5bfd-444b-97e4-73dcdcbf0fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:44.781637 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabcb481-5bfd-444b-97e4-73dcdcbf0fe4 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:44.782334 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabcb481-5bfd-444b-97e4-73dcdcbf0fe4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:44.782638 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabcb481-5bfd-444b-97e4-73dcdcbf0fe4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:44.784152 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabcb481-5bfd-444b-97e4-73dcdcbf0fe4 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:44.797012 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 463/937] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:44.803158 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b91d46-1d0c-472c-9655-ddbde95c446b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:44.865474 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:44.913114 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b91d46-1d0c-472c-9655-ddbde95c446b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:44.947782 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8642007e-dfe7-4173-b92a-bc6a1e99efef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:44.948440 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642007e-dfe7-4173-b92a-bc6a1e99efef None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:44.948716 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642007e-dfe7-4173-b92a-bc6a1e99efef None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:44.948985 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8642007e-dfe7-4173-b92a-bc6a1e99efef None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:44.956861 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642007e-dfe7-4173-b92a-bc6a1e99efef None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:44.958333 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8642007e-dfe7-4173-b92a-bc6a1e99efef None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:44.969537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-8642007e-dfe7-4173-b92a-bc6a1e99efef None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 15:12:44.969537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:44.969537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:44.969537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:44.969537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:44.969537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:44.969537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:44.969537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:44.969537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:44.969537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:44.969537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:44.969537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:44.969537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:12:44.969537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:12:44.969537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:12:44.969537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:12:44.970494 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:44.970494 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:44.970494 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:12:44.970494 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:44.970494 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:12:44.970494 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:44.970494 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:44.970494 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:44.970494 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:44.970494 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:44.970494 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:44.970494 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:44.970494 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:44.970494 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:44.970494 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:44.970494 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:44.970494 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:44.970494 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:44.971766 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:44.971766 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:44.971766 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:12:44.971766 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:12:44.971766 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:12:44.971766 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:12:44.971766 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:12:44.971766 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:12:44.971766 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 15:12:44.971766 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:44.971766 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 475/938] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Jul 27 15:12:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:44.978922 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabcb481-5bfd-444b-97e4-73dcdcbf0fe4 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:45.021213 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a7fb2-b4fa-470b-8053-1e428a5eb5cf None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:45.021553 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a7fb2-b4fa-470b-8053-1e428a5eb5cf None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:45.021763 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a7fb2-b4fa-470b-8053-1e428a5eb5cf None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:45.023241 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 476/939] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:12:45.027833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dba685-7fe6-481f-a85b-9100a13bbc7c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:45.028171 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dba685-7fe6-481f-a85b-9100a13bbc7c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:45.028464 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dba685-7fe6-481f-a85b-9100a13bbc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:45.050307 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-e0dba685-7fe6-481f-a85b-9100a13bbc7c None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:45.051814 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e0dba685-7fe6-481f-a85b-9100a13bbc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:45.093712 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabcb481-5bfd-444b-97e4-73dcdcbf0fe4 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:45.122558 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 477/940] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 15:12:45.124344 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c844b13-7ae1-49d3-b84e-259993ab3a7a None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:45.124635 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c844b13-7ae1-49d3-b84e-259993ab3a7a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:45.124912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c844b13-7ae1-49d3-b84e-259993ab3a7a None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:45.126260 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 478/941] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:45.132105 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2a1ed-e6a3-4221-98d5-87f0737fa1e6 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:45.132402 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2a1ed-e6a3-4221-98d5-87f0737fa1e6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:45.132661 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2a1ed-e6a3-4221-98d5-87f0737fa1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:45.136337 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5baf7-639c-4e4c-b827-95a8a462cca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:45.137284 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5baf7-639c-4e4c-b827-95a8a462cca8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:45.137762 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5baf7-639c-4e4c-b827-95a8a462cca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:45.138232 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5baf7-639c-4e4c-b827-95a8a462cca8 None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:45.139416 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5baf7-639c-4e4c-b827-95a8a462cca8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:45.140830 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5baf7-639c-4e4c-b827-95a8a462cca8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:45.142492 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5baf7-639c-4e4c-b827-95a8a462cca8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:45.151287 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-44e2a1ed-e6a3-4221-98d5-87f0737fa1e6 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:45.152509 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-44e2a1ed-e6a3-4221-98d5-87f0737fa1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:45.162806 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 464/942] 10.222.0.40 () {56 vars in 1149 bytes} [Wed Jul 27 15:12:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:45.163452 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5baf7-639c-4e4c-b827-95a8a462cca8 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:45.189264 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:45.203467 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:45.232074 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 479/943] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 15:12:45.233038 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2a1ed-e6a3-4221-98d5-87f0737fa1e6 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:45.291430 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5baf7-639c-4e4c-b827-95a8a462cca8 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:45.327699 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fa8b7-5d52-4d87-88e5-0e3ead0b77af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:45.328779 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fa8b7-5d52-4d87-88e5-0e3ead0b77af None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:45.329285 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fa8b7-5d52-4d87-88e5-0e3ead0b77af None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:45.329666 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fa8b7-5d52-4d87-88e5-0e3ead0b77af None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:45.330349 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0fa8b7-5d52-4d87-88e5-0e3ead0b77af None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:45.331867 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0fa8b7-5d52-4d87-88e5-0e3ead0b77af None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:45.334475 dv-cinder-841315-2-smb devstack@keystone.service[80057]: WARNING keystone.server.flask.common [None req-5e0fa8b7-5d52-4d87-88e5-0e3ead0b77af None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 27 15:12:45.341427 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2a1ed-e6a3-4221-98d5-87f0737fa1e6 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:45.352299 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.sql.core [None req-5e0fa8b7-5d52-4d87-88e5-0e3ead0b77af None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 15:12:45.352299 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 27 15:12:45.352299 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [parameters: {'id': '80b958acfe284a0f98ed899aa69780b3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 27 15:12:45.352299 dv-cinder-841315-2-smb devstack@keystone.service[80057]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80057) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 15:12:45.360828 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-5e0fa8b7-5d52-4d87-88e5-0e3ead0b77af None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 80b958acfe284a0f98ed899aa69780b3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 80b958acfe284a0f98ed899aa69780b3. Jul 27 15:12:45.360828 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:45.360828 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 15:12:45.360828 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 15:12:45.360828 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 15:12:45.360828 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 15:12:45.360828 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 15:12:45.360828 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 15:12:45.360828 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 15:12:45.360828 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application conn.query(q) Jul 27 15:12:45.360828 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 15:12:45.360828 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 15:12:45.360828 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 15:12:45.361632 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application result.read() Jul 27 15:12:45.361632 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 15:12:45.361632 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 15:12:45.361632 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 15:12:45.361632 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 15:12:45.361632 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 15:12:45.361632 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 15:12:45.361632 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 15:12:45.361632 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 15:12:45.361632 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 15:12:45.361632 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:45.361632 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 15:12:45.361632 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:45.361632 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:45.361632 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 15:12:45.361632 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 15:12:45.361632 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 27 15:12:45.361632 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 27 15:12:45.362630 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 15:12:45.362630 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application next(self.gen) Jul 27 15:12:45.362630 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 15:12:45.362630 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application yield resource Jul 27 15:12:45.362630 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 15:12:45.362630 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application next(self.gen) Jul 27 15:12:45.362630 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 15:12:45.362630 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 15:12:45.362630 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 15:12:45.362630 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 15:12:45.362630 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 15:12:45.362630 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise self.value Jul 27 15:12:45.362630 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 15:12:45.362630 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 15:12:45.362630 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 15:12:45.362630 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application session.commit() Jul 27 15:12:45.362630 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 15:12:45.363523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 15:12:45.363523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 15:12:45.363523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 15:12:45.363523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 15:12:45.363523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self.session.flush() Jul 27 15:12:45.363523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 15:12:45.363523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 15:12:45.363523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 15:12:45.363523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 15:12:45.363523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 15:12:45.363523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application compat.raise_( Jul 27 15:12:45.363523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 15:12:45.363523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception Jul 27 15:12:45.363523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 15:12:45.363523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 15:12:45.363523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 15:12:45.363523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 15:12:45.365019 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 15:12:45.365019 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 15:12:45.365019 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 15:12:45.365019 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 15:12:45.365019 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 27 15:12:45.365019 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 27 15:12:45.365019 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 15:12:45.365019 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 15:12:45.365019 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 15:12:45.365019 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 15:12:45.365019 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 15:12:45.365019 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 15:12:45.365019 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 15:12:45.365019 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 15:12:45.365019 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 15:12:45.368254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 15:12:45.368254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 15:12:45.368254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception Jul 27 15:12:45.368254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 15:12:45.368254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 15:12:45.368254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 15:12:45.368254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 15:12:45.368254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 15:12:45.368254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 15:12:45.368254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 15:12:45.368254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application conn.query(q) Jul 27 15:12:45.368254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 15:12:45.368254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 15:12:45.368254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 15:12:45.368254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application result.read() Jul 27 15:12:45.368254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 15:12:45.368254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 15:12:45.371193 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 15:12:45.371193 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 15:12:45.371193 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 15:12:45.371193 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 15:12:45.371193 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 15:12:45.371193 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 15:12:45.371193 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 15:12:45.371193 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 27 15:12:45.371193 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [parameters: {'id': '80b958acfe284a0f98ed899aa69780b3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 27 15:12:45.371193 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 15:12:45.371193 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:45.371193 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 15:12:45.371193 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:45.371193 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:45.371193 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 27 15:12:45.373234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 27 15:12:45.373234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 15:12:45.373234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 15:12:45.373234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 27 15:12:45.373234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:45.373234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 15:12:45.373234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:45.373234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:45.373234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:45.373234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:45.373234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:45.373234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:45.373234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:45.373234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:45.373234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:45.373234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:45.373234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:45.375440 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:45.375440 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 27 15:12:45.375440 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 27 15:12:45.375440 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:45.375440 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:45.375440 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 27 15:12:45.375440 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 27 15:12:45.375440 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 80b958acfe284a0f98ed899aa69780b3. Jul 27 15:12:45.375440 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:45.375440 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 465/944] 10.222.0.40 () {60 vars in 1140 bytes} [Wed Jul 27 15:12:45 2022] POST /identity/v3/projects => generated 262 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:45.375440 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fa8b7-5d52-4d87-88e5-0e3ead0b77af None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:45.382609 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71b3fe-b9cf-406b-b6f4-bad47ab14f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:45.383243 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71b3fe-b9cf-406b-b6f4-bad47ab14f3d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:45.383568 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71b3fe-b9cf-406b-b6f4-bad47ab14f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:45.383779 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da71b3fe-b9cf-406b-b6f4-bad47ab14f3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:45.394108 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71b3fe-b9cf-406b-b6f4-bad47ab14f3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:45.395520 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da71b3fe-b9cf-406b-b6f4-bad47ab14f3d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:45.410371 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-da71b3fe-b9cf-406b-b6f4-bad47ab14f3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:45.410371 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:45.410371 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:45.410371 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:45.410371 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:45.410371 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:45.410371 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:45.410371 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:45.410371 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:45.410371 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:45.410371 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:45.410371 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:45.410371 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:45.410371 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:45.410371 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:45.411328 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:45.411328 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:45.411328 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:45.411328 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:45.411328 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:45.411328 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:45.411328 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:45.411328 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:45.411328 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:45.411328 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:45.411328 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:45.411328 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:45.411328 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:45.411328 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:45.411328 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:45.411328 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:45.411328 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:45.412285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:45.412285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:45.412285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:45.412285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:45.416408 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 480/945] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:45.417060 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71b3fe-b9cf-406b-b6f4-bad47ab14f3d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:45.447020 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:45.457465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:45.483662 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fa8b7-5d52-4d87-88e5-0e3ead0b77af None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:45.520938 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf32690-4b0d-4b83-bbaa-4df09d826398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:45.521574 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf32690-4b0d-4b83-bbaa-4df09d826398 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:45.521853 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf32690-4b0d-4b83-bbaa-4df09d826398 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:45.522134 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf32690-4b0d-4b83-bbaa-4df09d826398 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:45.522741 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf32690-4b0d-4b83-bbaa-4df09d826398 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:45.524317 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf32690-4b0d-4b83-bbaa-4df09d826398 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:45.528853 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da71b3fe-b9cf-406b-b6f4-bad47ab14f3d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:45.533699 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-faf32690-4b0d-4b83-bbaa-4df09d826398 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 15:12:45.533699 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:45.533699 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 15:12:45.533699 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 15:12:45.533699 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 15:12:45.533699 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 15:12:45.533699 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 15:12:45.533699 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:45.533699 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 15:12:45.533699 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:45.533699 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 15:12:45.533699 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:45.533699 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:45.533699 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:45.533699 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:45.533699 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:45.533699 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:45.534710 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:45.534710 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:45.534710 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:45.534710 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:45.534710 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:45.534710 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:45.534710 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 15:12:45.534710 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 15:12:45.534710 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 15:12:45.534710 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 15:12:45.534710 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:45.534710 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:45.534710 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:45.534710 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:45.534710 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:45.534710 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:45.535550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:45.535550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:45.535550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:45.535550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:45.535550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:45.535550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:45.535550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:45.535550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:45.535550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:45.535550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:45.535550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 15:12:45.535550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:45.535550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 15:12:45.535550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:45.540172 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 466/946] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Jul 27 15:12:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:45.541020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf32690-4b0d-4b83-bbaa-4df09d826398 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:45.566125 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254f312-5827-4f69-bf3c-c96e3c1927e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:45.566759 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254f312-5827-4f69-bf3c-c96e3c1927e4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:45.567040 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254f312-5827-4f69-bf3c-c96e3c1927e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:45.567310 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a254f312-5827-4f69-bf3c-c96e3c1927e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:45.575050 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a254f312-5827-4f69-bf3c-c96e3c1927e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:45.580828 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a254f312-5827-4f69-bf3c-c96e3c1927e4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:45.594372 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-a254f312-5827-4f69-bf3c-c96e3c1927e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:45.594372 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:45.594372 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:45.594372 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:45.594372 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:45.594372 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:45.594372 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:45.594372 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:45.594372 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:45.594372 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:45.594372 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:45.594372 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:45.594372 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:12:45.594372 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:12:45.594372 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:12:45.595318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:12:45.595318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:45.595318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:45.595318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:45.595318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:45.595318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:45.595318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:45.595318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:45.595318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:45.595318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:45.595318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:45.595318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:45.595318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:45.595318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:45.595318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:45.595318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:45.595318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:45.596300 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:12:45.596300 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:12:45.596300 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:12:45.596300 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:12:45.596300 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:12:45.596300 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:12:45.596300 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:45.596300 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:45.596300 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 481/947] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:12:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:45.597475 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254f312-5827-4f69-bf3c-c96e3c1927e4 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:45.655821 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf32690-4b0d-4b83-bbaa-4df09d826398 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:45.692568 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:45.692753 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1edcee-1c1c-45d4-84ff-f740451001d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:45.693365 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1edcee-1c1c-45d4-84ff-f740451001d5 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:45.693647 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1edcee-1c1c-45d4-84ff-f740451001d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:45.693922 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1edcee-1c1c-45d4-84ff-f740451001d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:45.694610 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1edcee-1c1c-45d4-84ff-f740451001d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:45.694913 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1edcee-1c1c-45d4-84ff-f740451001d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:45.696387 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1edcee-1c1c-45d4-84ff-f740451001d5 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:45.709818 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a254f312-5827-4f69-bf3c-c96e3c1927e4 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:45.711323 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 467/948] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:45.711938 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1edcee-1c1c-45d4-84ff-f740451001d5 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:45.714664 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:45.750421 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7657fa-575d-4ce5-b6a0-646d511caf4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:45.751040 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7657fa-575d-4ce5-b6a0-646d511caf4e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:45.751322 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7657fa-575d-4ce5-b6a0-646d511caf4e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:45.751595 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7657fa-575d-4ce5-b6a0-646d511caf4e None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:45.752297 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7657fa-575d-4ce5-b6a0-646d511caf4e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:45.752605 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7657fa-575d-4ce5-b6a0-646d511caf4e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:45.753961 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7657fa-575d-4ce5-b6a0-646d511caf4e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:45.763316 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 482/949] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Jul 27 15:12:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:45.763316 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7657fa-575d-4ce5-b6a0-646d511caf4e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:45.824203 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1edcee-1c1c-45d4-84ff-f740451001d5 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:45.859362 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dff5af-3f64-4120-a6c1-2d84fa821b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:45.859979 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dff5af-3f64-4120-a6c1-2d84fa821b5e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:45.860282 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dff5af-3f64-4120-a6c1-2d84fa821b5e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:45.860557 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dff5af-3f64-4120-a6c1-2d84fa821b5e None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:45.861270 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dff5af-3f64-4120-a6c1-2d84fa821b5e None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:45.861577 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dff5af-3f64-4120-a6c1-2d84fa821b5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:45.862991 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dff5af-3f64-4120-a6c1-2d84fa821b5e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:45.870931 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7657fa-575d-4ce5-b6a0-646d511caf4e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:45.892028 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 468/950] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Jul 27 15:12:45 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:45.892028 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dff5af-3f64-4120-a6c1-2d84fa821b5e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:45.921587 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1168c-fe6e-4651-81f6-c7b1793503f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:45.922255 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1168c-fe6e-4651-81f6-c7b1793503f0 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:45.922611 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1168c-fe6e-4651-81f6-c7b1793503f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:45.922885 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f1168c-fe6e-4651-81f6-c7b1793503f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:45.931707 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1168c-fe6e-4651-81f6-c7b1793503f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:45.933413 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f1168c-fe6e-4651-81f6-c7b1793503f0 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:45.946397 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-f2f1168c-fe6e-4651-81f6-c7b1793503f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:45.946397 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:45.946397 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:45.946397 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:45.946397 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:45.946397 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:45.946397 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:45.946397 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:45.946397 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:45.946397 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:45.946397 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:45.946397 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:45.946397 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:12:45.946397 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:12:45.946397 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:12:45.947485 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:12:45.947485 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:45.947485 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:45.947485 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:45.947485 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:45.947485 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:45.947485 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:45.947485 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:45.947485 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:45.947485 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:45.947485 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:45.947485 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:45.947485 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:45.947485 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:45.947485 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:45.947485 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:45.947485 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:45.948716 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:12:45.948716 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:12:45.948716 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:12:45.948716 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:12:45.948716 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:12:45.948716 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:12:45.948716 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:45.948716 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:45.948716 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 483/951] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:12:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:45.953524 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1168c-fe6e-4651-81f6-c7b1793503f0 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:45.976000 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:45.977390 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:46.030129 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dff5af-3f64-4120-a6c1-2d84fa821b5e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:46.069242 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c16e9d-2a21-4a07-9bb5-e7cf84382cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:46.069922 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c16e9d-2a21-4a07-9bb5-e7cf84382cfc None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:46.071588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c16e9d-2a21-4a07-9bb5-e7cf84382cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:46.071588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c16e9d-2a21-4a07-9bb5-e7cf84382cfc None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:46.071588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c16e9d-2a21-4a07-9bb5-e7cf84382cfc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:46.071588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c16e9d-2a21-4a07-9bb5-e7cf84382cfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:46.073597 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c16e9d-2a21-4a07-9bb5-e7cf84382cfc None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:46.076443 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f1168c-fe6e-4651-81f6-c7b1793503f0 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:46.084234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 469/952] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Jul 27 15:12:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:46.085209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c16e9d-2a21-4a07-9bb5-e7cf84382cfc None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:46.114987 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6505ad-7aea-45ce-9d23-a97a248187b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:46.115720 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6505ad-7aea-45ce-9d23-a97a248187b8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:46.116165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6505ad-7aea-45ce-9d23-a97a248187b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:46.116569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6505ad-7aea-45ce-9d23-a97a248187b8 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:46.117388 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6505ad-7aea-45ce-9d23-a97a248187b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:46.117805 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6505ad-7aea-45ce-9d23-a97a248187b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:46.119296 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6505ad-7aea-45ce-9d23-a97a248187b8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:46.141200 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 484/953] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jul 27 15:12:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:46.142071 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6505ad-7aea-45ce-9d23-a97a248187b8 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:46.204398 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c16e9d-2a21-4a07-9bb5-e7cf84382cfc None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:46.229837 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:46.234291 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:46.244407 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732de3d3-09cf-480b-88c5-f7fc90de655a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:46.245146 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732de3d3-09cf-480b-88c5-f7fc90de655a None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:46.245530 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732de3d3-09cf-480b-88c5-f7fc90de655a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:46.245918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732de3d3-09cf-480b-88c5-f7fc90de655a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:46.246722 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732de3d3-09cf-480b-88c5-f7fc90de655a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:46.248206 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732de3d3-09cf-480b-88c5-f7fc90de655a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:46.263291 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6505ad-7aea-45ce-9d23-a97a248187b8 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:46.270344 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 470/954] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:12:46 2022] POST /identity/v3/endpoints => generated 349 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:12:46.272117 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8d6f0-85f0-4ace-9f89-eb27a8b90154 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:46.272410 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8d6f0-85f0-4ace-9f89-eb27a8b90154 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:46.272690 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8d6f0-85f0-4ace-9f89-eb27a8b90154 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:46.276134 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 471/955] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:46.282066 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e628cd3-dd46-40fa-b721-781fb74f9f54 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:46.282450 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e628cd3-dd46-40fa-b721-781fb74f9f54 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:46.282618 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e628cd3-dd46-40fa-b721-781fb74f9f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:46.308750 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-7e628cd3-dd46-40fa-b721-781fb74f9f54 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:46.310857 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-7e628cd3-dd46-40fa-b721-781fb74f9f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:46.325263 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00af193-f8d9-44b3-93c3-c27e363c6bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:46.326959 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00af193-f8d9-44b3-93c3-c27e363c6bf1 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:46.327547 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00af193-f8d9-44b3-93c3-c27e363c6bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:46.328029 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00af193-f8d9-44b3-93c3-c27e363c6bf1 None admin] PATH_INFO: `/v3/projects/0b616213eaea4a22afee15d4cbe5a3c5/users/b470b4c2ca1a4d1a8a864789bf603d02/roles/c0bb546247e847f1a87281d2a3bb21e7` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:46.332036 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00af193-f8d9-44b3-93c3-c27e363c6bf1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0b616213eaea4a22afee15d4cbe5a3c5, user_id=b470b4c2ca1a4d1a8a864789bf603d02, role_id=c0bb546247e847f1a87281d2a3bb21e7)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:46.335158 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00af193-f8d9-44b3-93c3-c27e363c6bf1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:46.354464 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 485/956] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jul 27 15:12:46 2022] PUT /identity/v3/projects/0b616213eaea4a22afee15d4cbe5a3c5/users/b470b4c2ca1a4d1a8a864789bf603d02/roles/c0bb546247e847f1a87281d2a3bb21e7 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:12:46.402513 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 472/957] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:12:46.425818 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00af193-f8d9-44b3-93c3-c27e363c6bf1 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:46.544707 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00af193-f8d9-44b3-93c3-c27e363c6bf1 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:46.572307 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:46.587793 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea4d18-9826-487c-867b-01fe20c9d5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:46.588574 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea4d18-9826-487c-867b-01fe20c9d5c1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:46.588927 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea4d18-9826-487c-867b-01fe20c9d5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:46.589346 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecea4d18-9826-487c-867b-01fe20c9d5c1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:46.590101 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea4d18-9826-487c-867b-01fe20c9d5c1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:46.592067 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecea4d18-9826-487c-867b-01fe20c9d5c1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:46.604392 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-ecea4d18-9826-487c-867b-01fe20c9d5c1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 15:12:46.604392 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:46.604392 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 15:12:46.604392 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 15:12:46.604392 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 15:12:46.604392 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 15:12:46.604392 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 15:12:46.604392 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:46.604392 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 15:12:46.604392 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:46.604392 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 15:12:46.604392 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:46.604392 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:46.604392 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:46.604392 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:46.604392 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:46.604392 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:46.605654 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:46.605654 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:46.605654 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:46.605654 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:46.605654 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:46.605654 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:46.605654 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 15:12:46.605654 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 15:12:46.605654 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 15:12:46.605654 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 15:12:46.605654 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:46.605654 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:46.605654 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:46.605654 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:46.605654 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:46.605654 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:46.606712 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:46.606712 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:46.606712 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:46.606712 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:46.606712 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:46.606712 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:46.606712 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:46.606712 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:46.606712 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:46.606712 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:46.606712 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 15:12:46.606712 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:46.606712 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 15:12:46.606712 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:46.608949 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 486/958] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:12:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:46.614084 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e628cd3-dd46-40fa-b721-781fb74f9f54 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:46.724708 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e628cd3-dd46-40fa-b721-781fb74f9f54 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:46.738543 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:46.761226 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc83662-8b70-48c0-9f8a-6d5972d99718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:46.761847 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc83662-8b70-48c0-9f8a-6d5972d99718 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:46.762127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc83662-8b70-48c0-9f8a-6d5972d99718 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:46.762401 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc83662-8b70-48c0-9f8a-6d5972d99718 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:46.763076 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc83662-8b70-48c0-9f8a-6d5972d99718 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:46.763381 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc83662-8b70-48c0-9f8a-6d5972d99718 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:46.764773 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc83662-8b70-48c0-9f8a-6d5972d99718 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:46.769996 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 473/959] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Jul 27 15:12:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:46.777094 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea4d18-9826-487c-867b-01fe20c9d5c1 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:46.886670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecea4d18-9826-487c-867b-01fe20c9d5c1 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:46.925129 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da9ad7-643c-4153-aa10-156447dfb04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:46.925740 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da9ad7-643c-4153-aa10-156447dfb04a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:46.926017 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da9ad7-643c-4153-aa10-156447dfb04a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:46.926285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da9ad7-643c-4153-aa10-156447dfb04a None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:46.926980 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da9ad7-643c-4153-aa10-156447dfb04a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:46.927281 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da9ad7-643c-4153-aa10-156447dfb04a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:46.928671 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da9ad7-643c-4153-aa10-156447dfb04a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:46.933480 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 487/960] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Jul 27 15:12:46 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:48.047591 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3753ed-4cee-4df1-b954-38a505c2bae9 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:48.048203 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3753ed-4cee-4df1-b954-38a505c2bae9 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:48.048305 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3753ed-4cee-4df1-b954-38a505c2bae9 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:48.050079 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 474/961] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:48.055403 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48eebf-08dc-4a3d-84c8-efce6914a870 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:48.055825 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48eebf-08dc-4a3d-84c8-efce6914a870 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:48.056034 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48eebf-08dc-4a3d-84c8-efce6914a870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:48.075706 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4a48eebf-08dc-4a3d-84c8-efce6914a870 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:48.076928 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4a48eebf-08dc-4a3d-84c8-efce6914a870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:48.138433 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:48.159900 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 488/962] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:12:48.185438 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3753ed-4cee-4df1-b954-38a505c2bae9 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:48.298189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3753ed-4cee-4df1-b954-38a505c2bae9 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:48.334781 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a4095c-7aae-48c8-9ede-e9308f57559a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:48.335400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4095c-7aae-48c8-9ede-e9308f57559a None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:48.335681 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4095c-7aae-48c8-9ede-e9308f57559a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:48.335977 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a4095c-7aae-48c8-9ede-e9308f57559a None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:48.336727 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a4095c-7aae-48c8-9ede-e9308f57559a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:48.338150 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a4095c-7aae-48c8-9ede-e9308f57559a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:48.354176 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.sql.core [None req-e1a4095c-7aae-48c8-9ede-e9308f57559a None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 15:12:48.354176 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 27 15:12:48.354176 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [parameters: {'user_id': '003e76240bc44a808e7adef375900e44', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 27 15:12:48.354176 dv-cinder-841315-2-smb devstack@keystone.service[80057]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80057) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 15:12:48.361618 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-e1a4095c-7aae-48c8-9ede-e9308f57559a None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 27 15:12:48.361618 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:48.361618 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 15:12:48.361618 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 15:12:48.361618 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 15:12:48.361618 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 15:12:48.361618 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 15:12:48.361618 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 15:12:48.361618 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 15:12:48.361618 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application conn.query(q) Jul 27 15:12:48.361618 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 15:12:48.361618 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 15:12:48.361618 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 15:12:48.361618 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application result.read() Jul 27 15:12:48.361618 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 15:12:48.362514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 15:12:48.362514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 15:12:48.362514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 15:12:48.362514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 15:12:48.362514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 15:12:48.362514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 15:12:48.362514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 15:12:48.362514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 15:12:48.362514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:48.362514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 15:12:48.362514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:48.362514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:48.362514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 15:12:48.362514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 15:12:48.362514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 27 15:12:48.362514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 27 15:12:48.362514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 15:12:48.362514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application next(self.gen) Jul 27 15:12:48.363552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 15:12:48.363552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application yield resource Jul 27 15:12:48.363552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 15:12:48.363552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application next(self.gen) Jul 27 15:12:48.363552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 15:12:48.363552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 15:12:48.363552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 15:12:48.363552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 15:12:48.363552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 15:12:48.363552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise self.value Jul 27 15:12:48.363552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 15:12:48.363552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 15:12:48.363552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 15:12:48.363552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application session.commit() Jul 27 15:12:48.363552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 15:12:48.363552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 15:12:48.363552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 15:12:48.365046 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 15:12:48.365046 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 15:12:48.365046 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self.session.flush() Jul 27 15:12:48.365046 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 15:12:48.365046 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 15:12:48.365046 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 15:12:48.365046 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 15:12:48.365046 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 15:12:48.365046 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application compat.raise_( Jul 27 15:12:48.365046 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 15:12:48.365046 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception Jul 27 15:12:48.365046 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 15:12:48.365046 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 15:12:48.365046 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 15:12:48.365046 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 15:12:48.365046 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 15:12:48.365046 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 15:12:48.365975 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 15:12:48.365975 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 15:12:48.365975 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 27 15:12:48.365975 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 27 15:12:48.365975 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 15:12:48.365975 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 15:12:48.365975 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 15:12:48.365975 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 15:12:48.365975 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 15:12:48.365975 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 15:12:48.365975 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 15:12:48.365975 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 15:12:48.365975 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 15:12:48.365975 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 15:12:48.365975 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 15:12:48.365975 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception Jul 27 15:12:48.367035 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 15:12:48.367035 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 15:12:48.367035 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 15:12:48.367035 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 15:12:48.367035 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 15:12:48.367035 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 15:12:48.367035 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 15:12:48.367035 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application conn.query(q) Jul 27 15:12:48.367035 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 15:12:48.367035 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 15:12:48.367035 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 15:12:48.367035 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application result.read() Jul 27 15:12:48.367035 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 15:12:48.367035 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 15:12:48.367035 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 15:12:48.367035 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 15:12:48.368349 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 15:12:48.368349 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 15:12:48.368349 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 15:12:48.368349 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 15:12:48.368349 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 15:12:48.368349 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 27 15:12:48.368349 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [parameters: {'user_id': '003e76240bc44a808e7adef375900e44', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 27 15:12:48.368349 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 15:12:48.368349 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:48.368349 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 15:12:48.368349 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:48.368349 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:48.368349 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:48.368349 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:48.368349 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:48.369730 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:48.369730 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:48.369730 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:48.369730 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:48.369730 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:48.369730 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:48.369730 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:48.369730 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 27 15:12:48.369730 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 27 15:12:48.369730 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:48.369730 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:48.369730 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:12:48.369730 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:48.369730 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:12:48.369730 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:48.369730 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 27 15:12:48.369730 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 27 15:12:48.371202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 27 15:12:48.371202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 27 15:12:48.371202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 15:12:48.371202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 15:12:48.371202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 27 15:12:48.371202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:48.371202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 475/963] 10.222.0.40 () {60 vars in 1131 bytes} [Wed Jul 27 15:12:48 2022] POST /identity/v3/users => generated 160 bytes in 178 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:48.371706 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48eebf-08dc-4a3d-84c8-efce6914a870 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:48.421204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8eae97-f531-4734-a7cc-0960058fbc09 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:48.421489 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8eae97-f531-4734-a7cc-0960058fbc09 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:48.421770 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8eae97-f531-4734-a7cc-0960058fbc09 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:48.430396 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 476/964] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:12:48.432053 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c341f-8295-4bad-afc6-23714d57b082 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:48.432368 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c341f-8295-4bad-afc6-23714d57b082 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:48.432682 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c341f-8295-4bad-afc6-23714d57b082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:48.451871 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-245c341f-8295-4bad-afc6-23714d57b082 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:48.453558 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-245c341f-8295-4bad-afc6-23714d57b082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:48.475968 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48eebf-08dc-4a3d-84c8-efce6914a870 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:48.492356 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:48.512917 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463818e8-cd58-4b83-90c6-0e37b318371a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:48.513558 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463818e8-cd58-4b83-90c6-0e37b318371a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:48.513999 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463818e8-cd58-4b83-90c6-0e37b318371a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:48.514281 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463818e8-cd58-4b83-90c6-0e37b318371a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:48.521749 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463818e8-cd58-4b83-90c6-0e37b318371a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:48.523188 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463818e8-cd58-4b83-90c6-0e37b318371a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:48.536546 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-463818e8-cd58-4b83-90c6-0e37b318371a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 15:12:48.536546 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:48.536546 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:48.536546 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:48.536546 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:48.536546 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:48.536546 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:48.536546 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:48.536546 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:48.536546 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:48.536546 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:48.536546 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:48.536546 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:12:48.536546 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:12:48.536546 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:12:48.536546 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:12:48.537852 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:48.537852 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:48.537852 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:12:48.537852 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:48.537852 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:12:48.537852 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:48.537852 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:48.537852 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:48.537852 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:48.537852 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:48.537852 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:48.537852 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:48.537852 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:48.537852 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:48.537852 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:48.537852 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:48.537852 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:48.537852 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:48.539297 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:48.539297 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:48.539297 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:12:48.539297 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:12:48.539297 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:12:48.539297 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:12:48.539297 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:12:48.539297 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:12:48.539297 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 15:12:48.539297 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:48.539297 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 489/966] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:12:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:48.540075 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 477/966] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 15:12:48.542059 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463818e8-cd58-4b83-90c6-0e37b318371a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:48.547358 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6786a-9287-47d0-ae2a-319c2659eb70 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:48.547712 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6786a-9287-47d0-ae2a-319c2659eb70 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:48.548112 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6786a-9287-47d0-ae2a-319c2659eb70 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:48.549806 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 478/967] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:12:48.555012 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eaa298-d339-4c28-af4e-7270b42c4189 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:48.555298 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eaa298-d339-4c28-af4e-7270b42c4189 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:48.555576 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44eaa298-d339-4c28-af4e-7270b42c4189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:48.574426 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-44eaa298-d339-4c28-af4e-7270b42c4189 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:48.575785 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-44eaa298-d339-4c28-af4e-7270b42c4189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:48.599294 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:48.647824 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 479/968] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 15:12:48.649013 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eaa298-d339-4c28-af4e-7270b42c4189 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:48.663179 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463818e8-cd58-4b83-90c6-0e37b318371a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:48.702878 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30ccdb-ec5c-4f83-8946-f66a5938b890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:48.703495 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30ccdb-ec5c-4f83-8946-f66a5938b890 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:48.703809 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30ccdb-ec5c-4f83-8946-f66a5938b890 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:48.704161 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30ccdb-ec5c-4f83-8946-f66a5938b890 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:48.705240 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30ccdb-ec5c-4f83-8946-f66a5938b890 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:48.705554 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30ccdb-ec5c-4f83-8946-f66a5938b890 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:48.706984 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30ccdb-ec5c-4f83-8946-f66a5938b890 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:48.756028 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 490/969] 10.222.0.40 () {56 vars in 1101 bytes} [Wed Jul 27 15:12:48 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:48.756028 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30ccdb-ec5c-4f83-8946-f66a5938b890 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:48.764494 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:48.768432 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44eaa298-d339-4c28-af4e-7270b42c4189 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:48.807655 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731ae60-21e3-4049-89b9-0987d364f0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:48.808347 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731ae60-21e3-4049-89b9-0987d364f0a7 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:48.808632 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731ae60-21e3-4049-89b9-0987d364f0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:48.808936 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731ae60-21e3-4049-89b9-0987d364f0a7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:48.809656 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731ae60-21e3-4049-89b9-0987d364f0a7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:48.811320 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731ae60-21e3-4049-89b9-0987d364f0a7 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:48.822224 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-5731ae60-21e3-4049-89b9-0987d364f0a7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 15:12:48.822224 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:48.822224 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 15:12:48.822224 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 15:12:48.822224 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 15:12:48.822224 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 15:12:48.822224 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 15:12:48.822224 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:48.822224 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 15:12:48.822224 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:48.822224 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 15:12:48.822224 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:48.822224 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:48.822224 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:48.822224 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:48.822224 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:48.822224 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:48.823312 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:48.823312 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:48.823312 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:48.823312 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:48.823312 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:48.823312 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:48.823312 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 15:12:48.823312 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 15:12:48.823312 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 15:12:48.823312 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 15:12:48.823312 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:48.823312 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:48.823312 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:48.823312 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:48.823312 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:48.823312 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:48.824198 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:48.824198 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:48.824198 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:48.824198 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:48.824198 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:48.824198 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:48.824198 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:48.824198 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:48.824198 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:48.824198 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:48.824198 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 15:12:48.824198 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:48.824198 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 15:12:48.824198 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:48.824198 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 480/970] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Jul 27 15:12:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:48.830104 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731ae60-21e3-4049-89b9-0987d364f0a7 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:48.883746 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30ccdb-ec5c-4f83-8946-f66a5938b890 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:48.885402 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:48.927924 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad899647-1227-4fc4-90d3-4528c21b3659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:48.928510 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad899647-1227-4fc4-90d3-4528c21b3659 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:48.928803 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad899647-1227-4fc4-90d3-4528c21b3659 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:48.929047 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad899647-1227-4fc4-90d3-4528c21b3659 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:48.948137 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad899647-1227-4fc4-90d3-4528c21b3659 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:12:48.953239 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-ad899647-1227-4fc4-90d3-4528c21b3659 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 15:12:48.953239 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:48.953239 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:48.953239 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:48.953239 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:48.953239 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:48.953239 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:48.953239 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:48.953239 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:48.953239 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:48.953239 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:48.953239 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:48.953239 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:12:48.953239 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:12:48.953239 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:12:48.953239 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:12:48.954214 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:12:48.954214 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:12:48.954214 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:12:48.954214 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:12:48.954214 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:48.954214 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:48.954214 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:48.954214 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:48.954214 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:48.954214 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:48.954214 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:48.954214 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:48.954214 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:48.954214 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:48.954214 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:48.954214 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:48.956347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:48.956347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:48.956347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:48.956347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:48.956347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:12:48.956347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:12:48.956347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:12:48.956347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:12:48.956347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:12:48.956347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:12:48.956347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 15:12:48.956347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:48.956347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 491/971] 10.222.0.40 () {56 vars in 1120 bytes} [Wed Jul 27 15:12:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:48.961411 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad899647-1227-4fc4-90d3-4528c21b3659 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:48.965344 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731ae60-21e3-4049-89b9-0987d364f0a7 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:49.005617 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae06338-b1a0-4000-934f-e953d48c10d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:49.006306 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae06338-b1a0-4000-934f-e953d48c10d7 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:49.006616 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae06338-b1a0-4000-934f-e953d48c10d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:49.006925 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae06338-b1a0-4000-934f-e953d48c10d7 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:49.007632 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae06338-b1a0-4000-934f-e953d48c10d7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:49.007938 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae06338-b1a0-4000-934f-e953d48c10d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:49.009369 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae06338-b1a0-4000-934f-e953d48c10d7 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:49.015901 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 481/972] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Jul 27 15:12:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:49.023647 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae06338-b1a0-4000-934f-e953d48c10d7 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:49.055338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:49.088460 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad899647-1227-4fc4-90d3-4528c21b3659 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:49.124201 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ae9f34-0f7f-4b2c-9b6f-cb8300a8fd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:49.124807 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae9f34-0f7f-4b2c-9b6f-cb8300a8fd07 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:49.125082 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae9f34-0f7f-4b2c-9b6f-cb8300a8fd07 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:49.125348 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ae9f34-0f7f-4b2c-9b6f-cb8300a8fd07 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:49.126044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae9f34-0f7f-4b2c-9b6f-cb8300a8fd07 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:49.126342 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae9f34-0f7f-4b2c-9b6f-cb8300a8fd07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:49.127693 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ae9f34-0f7f-4b2c-9b6f-cb8300a8fd07 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:49.135336 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 492/973] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Jul 27 15:12:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:49.136573 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4e198-10d0-4aed-b411-a7f89a9c3bc1 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:49.136856 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4e198-10d0-4aed-b411-a7f89a9c3bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:49.137131 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d4e198-10d0-4aed-b411-a7f89a9c3bc1 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:49.138304 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 493/974] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:49.140813 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4e198-10d0-4aed-b411-a7f89a9c3bc1 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:49.146380 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae06338-b1a0-4000-934f-e953d48c10d7 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:49.168014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:49.181131 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdae77e-99fa-4819-9767-dd6d667bcc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:49.181740 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdae77e-99fa-4819-9767-dd6d667bcc62 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:49.182020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdae77e-99fa-4819-9767-dd6d667bcc62 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:49.182291 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdae77e-99fa-4819-9767-dd6d667bcc62 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:49.182959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdae77e-99fa-4819-9767-dd6d667bcc62 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:49.183260 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdae77e-99fa-4819-9767-dd6d667bcc62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:49.184642 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdae77e-99fa-4819-9767-dd6d667bcc62 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:49.189331 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 482/975] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Jul 27 15:12:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:49.190582 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54826d85-4244-4da7-aef1-bb4a5980cd03 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:49.190869 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54826d85-4244-4da7-aef1-bb4a5980cd03 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:49.191139 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54826d85-4244-4da7-aef1-bb4a5980cd03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:49.208975 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-54826d85-4244-4da7-aef1-bb4a5980cd03 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:49.210146 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-54826d85-4244-4da7-aef1-bb4a5980cd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:49.251196 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d4e198-10d0-4aed-b411-a7f89a9c3bc1 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:49.275179 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 483/976] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:12:49.276091 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54826d85-4244-4da7-aef1-bb4a5980cd03 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:49.287288 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d7441-2b9f-4a24-9bd7-6920fb83eee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:49.288263 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d7441-2b9f-4a24-9bd7-6920fb83eee8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:49.288728 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d7441-2b9f-4a24-9bd7-6920fb83eee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:49.289432 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5d7441-2b9f-4a24-9bd7-6920fb83eee8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:49.298582 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:49.301483 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d7441-2b9f-4a24-9bd7-6920fb83eee8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:49.303149 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5d7441-2b9f-4a24-9bd7-6920fb83eee8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:49.317131 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-ca5d7441-2b9f-4a24-9bd7-6920fb83eee8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:49.317131 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:49.317131 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:49.317131 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:49.317131 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:49.317131 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:49.317131 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:49.317131 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:49.317131 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:49.317131 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:49.317131 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:49.317131 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:49.317131 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:49.317131 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:49.317131 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:49.318592 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:49.318592 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:49.318592 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:49.318592 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:49.318592 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:49.318592 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:49.318592 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:49.318592 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:49.318592 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:49.318592 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:49.318592 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:49.318592 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:49.318592 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:49.318592 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:49.318592 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:49.318592 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:49.318592 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:49.319483 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:49.319483 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:49.319483 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:49.319483 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:49.319903 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 494/977] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:49.321351 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d7441-2b9f-4a24-9bd7-6920fb83eee8 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:49.384045 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54826d85-4244-4da7-aef1-bb4a5980cd03 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:49.401295 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:49.419820 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cf77f-359f-460a-9a89-cf8e997f05e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:49.420463 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cf77f-359f-460a-9a89-cf8e997f05e2 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:49.420744 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cf77f-359f-460a-9a89-cf8e997f05e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:49.421026 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40cf77f-359f-460a-9a89-cf8e997f05e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:49.421784 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40cf77f-359f-460a-9a89-cf8e997f05e2 None admin] RBAC: Adding query filter params (interface=admin, service_id=ddf36a97770149aeb05e7cf4bc9bb68f, region_id=RegionOne) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:49.422101 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40cf77f-359f-460a-9a89-cf8e997f05e2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:49.423455 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40cf77f-359f-460a-9a89-cf8e997f05e2 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:49.424087 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5d7441-2b9f-4a24-9bd7-6920fb83eee8 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:49.428466 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 484/978] 10.222.0.40 () {56 vars in 1249 bytes} [Wed Jul 27 15:12:49 2022] GET /identity/v3/endpoints?service_id=ddf36a97770149aeb05e7cf4bc9bb68f&interface=admin®ion_id=RegionOne => generated 193 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:49.429243 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cf77f-359f-460a-9a89-cf8e997f05e2 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:49.458738 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b4fbc-a9d4-470c-aaf5-13b8615bf9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:49.459375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b4fbc-a9d4-470c-aaf5-13b8615bf9a3 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:49.459658 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b4fbc-a9d4-470c-aaf5-13b8615bf9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:49.459929 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b4fbc-a9d4-470c-aaf5-13b8615bf9a3 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:49.460641 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b4fbc-a9d4-470c-aaf5-13b8615bf9a3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:49.462014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b4fbc-a9d4-470c-aaf5-13b8615bf9a3 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:49.475740 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 495/979] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Jul 27 15:12:49 2022] POST /identity/v3/services => generated 242 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:12:49.476563 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b4fbc-a9d4-470c-aaf5-13b8615bf9a3 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:49.524473 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:49.542793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40cf77f-359f-460a-9a89-cf8e997f05e2 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:49.587531 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976abb7-0218-4997-980c-2506a3a6f6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:49.588198 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976abb7-0218-4997-980c-2506a3a6f6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:49.588485 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976abb7-0218-4997-980c-2506a3a6f6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:49.588761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a976abb7-0218-4997-980c-2506a3a6f6a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:49.589479 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976abb7-0218-4997-980c-2506a3a6f6a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:49.589788 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976abb7-0218-4997-980c-2506a3a6f6a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:49.591188 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a976abb7-0218-4997-980c-2506a3a6f6a9 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:49.608049 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 485/980] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:49.610804 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976abb7-0218-4997-980c-2506a3a6f6a9 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:49.610946 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b4fbc-a9d4-470c-aaf5-13b8615bf9a3 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:49.652458 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6c741-93bc-4ab1-a53d-bdde48fd6eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:49.653370 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6c741-93bc-4ab1-a53d-bdde48fd6eae None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:49.653654 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6c741-93bc-4ab1-a53d-bdde48fd6eae None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:49.653927 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6c741-93bc-4ab1-a53d-bdde48fd6eae None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:49.654794 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6c741-93bc-4ab1-a53d-bdde48fd6eae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:49.656057 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6c741-93bc-4ab1-a53d-bdde48fd6eae None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:49.657898 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:49.665664 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 496/981] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Jul 27 15:12:49 2022] GET /identity/v3/services => generated 1727 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:12:49.729698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a976abb7-0218-4997-980c-2506a3a6f6a9 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:49.767801 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efdaef-6d29-42f8-92dc-686c798a86b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:49.768507 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efdaef-6d29-42f8-92dc-686c798a86b8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:49.768789 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efdaef-6d29-42f8-92dc-686c798a86b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:49.769063 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88efdaef-6d29-42f8-92dc-686c798a86b8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:49.777675 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88efdaef-6d29-42f8-92dc-686c798a86b8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:49.779132 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88efdaef-6d29-42f8-92dc-686c798a86b8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:49.782165 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:49.793236 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-88efdaef-6d29-42f8-92dc-686c798a86b8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 15:12:49.793236 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:49.793236 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:49.793236 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:49.793236 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:49.793236 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:49.793236 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:49.793236 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:49.793236 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:49.793236 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:49.793236 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:49.793236 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:49.793236 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:12:49.793236 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:12:49.793236 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:12:49.793236 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:12:49.794464 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:49.794464 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:49.794464 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:12:49.794464 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:49.794464 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:12:49.794464 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:49.794464 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:49.794464 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:49.794464 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:49.794464 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:49.794464 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:49.794464 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:49.794464 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:49.794464 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:49.794464 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:49.794464 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:49.794464 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:49.794464 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:49.795728 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:49.795728 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:49.795728 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:12:49.795728 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:12:49.795728 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:12:49.795728 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:12:49.795728 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:12:49.795728 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:12:49.795728 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 15:12:49.795728 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:49.798522 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 486/982] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Jul 27 15:12:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:12:49.804758 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6c741-93bc-4ab1-a53d-bdde48fd6eae None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:49.911789 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6c741-93bc-4ab1-a53d-bdde48fd6eae None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:49.949157 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e32755-8a99-4675-b174-a3ce6282116c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:49.950705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e32755-8a99-4675-b174-a3ce6282116c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:49.951023 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e32755-8a99-4675-b174-a3ce6282116c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:49.951308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e32755-8a99-4675-b174-a3ce6282116c None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:49.952155 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e32755-8a99-4675-b174-a3ce6282116c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:49.952471 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e32755-8a99-4675-b174-a3ce6282116c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:49.953892 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e32755-8a99-4675-b174-a3ce6282116c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:49.973683 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 497/983] 10.222.0.40 () {56 vars in 1149 bytes} [Wed Jul 27 15:12:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:49.979043 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efdaef-6d29-42f8-92dc-686c798a86b8 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:50.081975 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88efdaef-6d29-42f8-92dc-686c798a86b8 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:50.116346 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5908e8f-2354-45e7-9f8c-299beca5c686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:50.116963 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5908e8f-2354-45e7-9f8c-299beca5c686 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:50.117247 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5908e8f-2354-45e7-9f8c-299beca5c686 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:50.117524 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5908e8f-2354-45e7-9f8c-299beca5c686 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:50.184738 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:50.187863 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5908e8f-2354-45e7-9f8c-299beca5c686 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:50.190279 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5908e8f-2354-45e7-9f8c-299beca5c686 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:50.295412 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 487/984] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:12:49 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 15:12:50.296856 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e32755-8a99-4675-b174-a3ce6282116c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:50.356066 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:50.399418 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e32755-8a99-4675-b174-a3ce6282116c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:50.433732 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ae339-dd53-4859-b47a-c79232c2a915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:50.434367 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ae339-dd53-4859-b47a-c79232c2a915 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:50.434650 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ae339-dd53-4859-b47a-c79232c2a915 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:50.434975 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ae339-dd53-4859-b47a-c79232c2a915 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:50.445460 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ae339-dd53-4859-b47a-c79232c2a915 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:50.446893 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ae339-dd53-4859-b47a-c79232c2a915 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:50.461522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-f00ae339-dd53-4859-b47a-c79232c2a915 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:50.461522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:50.461522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:50.461522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:50.461522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:50.461522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:50.461522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:50.461522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:50.461522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:50.461522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:50.461522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:50.461522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:50.461522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:50.461522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:50.461522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:50.462394 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:50.462394 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:50.462394 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:50.462394 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:50.462394 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:50.462394 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:50.462394 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:50.462394 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:50.462394 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:50.462394 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:50.462394 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:50.462394 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:50.462394 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:50.462394 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:50.462394 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:50.462394 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:50.462394 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:50.468887 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:50.468887 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:50.468887 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:50.468887 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:50.468887 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 498/985] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:12:50.469812 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5908e8f-2354-45e7-9f8c-299beca5c686 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:50.565705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:50.570553 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5908e8f-2354-45e7-9f8c-299beca5c686 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:50.610591 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91296ab4-b5a1-41ed-9940-37fb10889065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:50.611223 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91296ab4-b5a1-41ed-9940-37fb10889065 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:50.611500 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91296ab4-b5a1-41ed-9940-37fb10889065 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:50.611786 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91296ab4-b5a1-41ed-9940-37fb10889065 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:50.612543 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91296ab4-b5a1-41ed-9940-37fb10889065 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:50.612853 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91296ab4-b5a1-41ed-9940-37fb10889065 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:50.618640 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91296ab4-b5a1-41ed-9940-37fb10889065 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:50.634366 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 488/986] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:50.642653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ae339-dd53-4859-b47a-c79232c2a915 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:50.809585 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ae339-dd53-4859-b47a-c79232c2a915 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:50.827598 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:50.865557 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de4bd3-31cb-4601-9df8-55bd1911bdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:50.866514 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de4bd3-31cb-4601-9df8-55bd1911bdc7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:50.866941 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de4bd3-31cb-4601-9df8-55bd1911bdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:50.867364 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de4bd3-31cb-4601-9df8-55bd1911bdc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:50.878990 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de4bd3-31cb-4601-9df8-55bd1911bdc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:50.881699 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de4bd3-31cb-4601-9df8-55bd1911bdc7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:50.901849 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-38de4bd3-31cb-4601-9df8-55bd1911bdc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:50.901849 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:50.901849 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:50.901849 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:50.901849 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:50.901849 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:50.901849 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:50.901849 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:50.901849 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:50.901849 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:50.901849 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:50.901849 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:50.901849 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:12:50.901849 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:12:50.901849 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:12:50.902744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:12:50.902744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:50.902744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:50.902744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:50.902744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:50.902744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:50.902744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:50.902744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:50.902744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:50.902744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:50.902744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:50.902744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:50.902744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:50.902744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:50.902744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:50.902744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:50.902744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:50.903632 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:12:50.903632 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:12:50.903632 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:12:50.903632 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:12:50.903632 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:12:50.903632 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:12:50.903632 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:50.903632 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:50.904120 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 499/987] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:12:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:50.909622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91296ab4-b5a1-41ed-9940-37fb10889065 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:51.011186 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91296ab4-b5a1-41ed-9940-37fb10889065 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:51.044104 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e741eb7b-803d-432a-97c8-7b140ecdb2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:51.044712 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741eb7b-803d-432a-97c8-7b140ecdb2c1 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:51.044990 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741eb7b-803d-432a-97c8-7b140ecdb2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:51.045257 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e741eb7b-803d-432a-97c8-7b140ecdb2c1 None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:51.045994 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741eb7b-803d-432a-97c8-7b140ecdb2c1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:51.046295 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741eb7b-803d-432a-97c8-7b140ecdb2c1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:51.047699 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e741eb7b-803d-432a-97c8-7b140ecdb2c1 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:51.061091 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 489/988] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jul 27 15:12:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:51.066010 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de4bd3-31cb-4601-9df8-55bd1911bdc7 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:51.164190 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de4bd3-31cb-4601-9df8-55bd1911bdc7 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:51.197075 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4319a0-bd2f-4680-8e83-be0329436571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:51.197681 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4319a0-bd2f-4680-8e83-be0329436571 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:51.197958 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4319a0-bd2f-4680-8e83-be0329436571 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:51.198227 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4319a0-bd2f-4680-8e83-be0329436571 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:51.199012 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4319a0-bd2f-4680-8e83-be0329436571 None admin] RBAC: Adding query filter params (role.id=c0bb546247e847f1a87281d2a3bb21e7, scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5, user.id=b470b4c2ca1a4d1a8a864789bf603d02) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:51.199318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4319a0-bd2f-4680-8e83-be0329436571 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:51.200778 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4319a0-bd2f-4680-8e83-be0329436571 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:51.206986 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 500/989] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:12:51 2022] GET /identity/v3/role_assignments?user.id=b470b4c2ca1a4d1a8a864789bf603d02&scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5&role.id=c0bb546247e847f1a87281d2a3bb21e7 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:51.518324 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80d2d8-1f08-4adf-b3ca-daea33f36dbb None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:51.518839 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80d2d8-1f08-4adf-b3ca-daea33f36dbb None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:51.518839 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80d2d8-1f08-4adf-b3ca-daea33f36dbb None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:51.520950 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 490/990] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:51.526348 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20141025-bbce-44e6-a225-bc09a4c8b110 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:51.526769 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20141025-bbce-44e6-a225-bc09a4c8b110 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:51.526967 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20141025-bbce-44e6-a225-bc09a4c8b110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:51.546530 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-20141025-bbce-44e6-a225-bc09a4c8b110 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:51.547718 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-20141025-bbce-44e6-a225-bc09a4c8b110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:51.575076 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:51.626177 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 501/991] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:12:51.650866 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80d2d8-1f08-4adf-b3ca-daea33f36dbb None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:51.677052 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:51.760558 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80d2d8-1f08-4adf-b3ca-daea33f36dbb None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:51.790628 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b310982-7dea-4943-8e9e-0aee622117c6 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:51.790836 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b310982-7dea-4943-8e9e-0aee622117c6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:51.791118 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b310982-7dea-4943-8e9e-0aee622117c6 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:51.792501 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 502/992] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:51.796108 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583efee8-0eb6-419e-b276-852ed288af4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:51.796921 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583efee8-0eb6-419e-b276-852ed288af4f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:51.797162 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9ef19-73d9-4438-8f4f-2fabfeb9aced None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:51.797281 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583efee8-0eb6-419e-b276-852ed288af4f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:51.797440 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9ef19-73d9-4438-8f4f-2fabfeb9aced None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:51.797546 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583efee8-0eb6-419e-b276-852ed288af4f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:51.797729 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9ef19-73d9-4438-8f4f-2fabfeb9aced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:51.798090 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583efee8-0eb6-419e-b276-852ed288af4f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:51.799454 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583efee8-0eb6-419e-b276-852ed288af4f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:51.810009 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-583efee8-0eb6-419e-b276-852ed288af4f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 15:12:51.810009 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:51.810009 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 15:12:51.810009 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 15:12:51.810009 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 15:12:51.810009 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 15:12:51.810009 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 15:12:51.810009 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:51.810009 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 15:12:51.810009 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:51.810009 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 15:12:51.810009 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:51.810009 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:51.810009 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:51.810009 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:51.810009 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:51.810009 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:51.810987 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:51.810987 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:51.810987 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:51.810987 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:51.810987 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:51.810987 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:51.810987 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 15:12:51.810987 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 15:12:51.810987 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 15:12:51.810987 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 15:12:51.810987 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:51.810987 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:51.810987 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:51.810987 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:51.810987 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:51.810987 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:51.811841 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:51.811841 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:51.811841 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:51.811841 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:51.811841 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:51.811841 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:51.811841 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:51.811841 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:51.811841 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:51.811841 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:51.811841 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 15:12:51.811841 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:51.811841 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 15:12:51.811841 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:51.811841 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 491/993] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:12:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:51.815440 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-89c9ef19-73d9-4438-8f4f-2fabfeb9aced None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:51.816653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-89c9ef19-73d9-4438-8f4f-2fabfeb9aced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:51.816943 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583efee8-0eb6-419e-b276-852ed288af4f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:51.890605 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 503/994] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:12:51.910864 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:51.913422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9ef19-73d9-4438-8f4f-2fabfeb9aced None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:51.930680 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583efee8-0eb6-419e-b276-852ed288af4f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:51.965030 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3acbc-9187-4916-981d-fc9bcde8c7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:51.966016 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3acbc-9187-4916-981d-fc9bcde8c7e2 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:51.966302 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3acbc-9187-4916-981d-fc9bcde8c7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:51.966719 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3acbc-9187-4916-981d-fc9bcde8c7e2 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:51.967403 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3acbc-9187-4916-981d-fc9bcde8c7e2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:51.967821 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3acbc-9187-4916-981d-fc9bcde8c7e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:51.969128 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3acbc-9187-4916-981d-fc9bcde8c7e2 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:51.974368 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 492/995] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Jul 27 15:12:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:51.984871 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3acbc-9187-4916-981d-fc9bcde8c7e2 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:52.016609 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:52.025604 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9ef19-73d9-4438-8f4f-2fabfeb9aced None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:52.065668 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b440aaa-9fd8-44b9-b11e-93e30be42850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:52.066301 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b440aaa-9fd8-44b9-b11e-93e30be42850 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:52.066583 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b440aaa-9fd8-44b9-b11e-93e30be42850 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:52.066857 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b440aaa-9fd8-44b9-b11e-93e30be42850 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:52.068525 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b440aaa-9fd8-44b9-b11e-93e30be42850 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:52.069546 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b440aaa-9fd8-44b9-b11e-93e30be42850 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:52.078781 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-5b440aaa-9fd8-44b9-b11e-93e30be42850 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 15:12:52.078781 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:52.078781 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 15:12:52.078781 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 15:12:52.078781 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 15:12:52.078781 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 15:12:52.078781 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 15:12:52.078781 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:52.078781 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 15:12:52.078781 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:52.078781 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 15:12:52.078781 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:52.078781 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:52.078781 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:52.078781 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:52.078781 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:52.078781 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:52.079777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:52.079777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:52.079777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:52.079777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:52.079777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:52.079777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:52.079777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 15:12:52.079777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 15:12:52.079777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 15:12:52.079777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 15:12:52.079777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:52.079777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:52.079777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:52.079777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:52.079777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:52.079777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:52.080657 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:52.080657 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:52.080657 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:52.080657 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:52.080657 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:52.080657 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:52.080657 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:52.080657 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:52.080657 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:52.080657 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:52.080657 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 15:12:52.080657 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:52.080657 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 15:12:52.080657 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:52.085351 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 504/996] 10.222.0.40 () {56 vars in 1126 bytes} [Wed Jul 27 15:12:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:12:52.086106 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b440aaa-9fd8-44b9-b11e-93e30be42850 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:52.094135 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3acbc-9187-4916-981d-fc9bcde8c7e2 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:52.128885 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa384a-7aa0-477b-a290-553fb27981d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:52.129500 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa384a-7aa0-477b-a290-553fb27981d1 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:52.130396 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa384a-7aa0-477b-a290-553fb27981d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:52.130689 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afa384a-7aa0-477b-a290-553fb27981d1 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:52.131365 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa384a-7aa0-477b-a290-553fb27981d1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:52.131670 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa384a-7aa0-477b-a290-553fb27981d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:52.133077 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afa384a-7aa0-477b-a290-553fb27981d1 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:52.137958 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 493/997] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Jul 27 15:12:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:52.143575 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa384a-7aa0-477b-a290-553fb27981d1 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:52.160321 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:52.197537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b440aaa-9fd8-44b9-b11e-93e30be42850 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:52.232666 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d137d-4cf4-44ae-b3d9-369addbbcc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:52.233273 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d137d-4cf4-44ae-b3d9-369addbbcc1f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:52.233547 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d137d-4cf4-44ae-b3d9-369addbbcc1f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:52.233817 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04d137d-4cf4-44ae-b3d9-369addbbcc1f None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:52.234603 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d137d-4cf4-44ae-b3d9-369addbbcc1f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:52.235015 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d137d-4cf4-44ae-b3d9-369addbbcc1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:52.236393 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04d137d-4cf4-44ae-b3d9-369addbbcc1f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:52.242350 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 505/998] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Jul 27 15:12:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:52.249126 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d137d-4cf4-44ae-b3d9-369addbbcc1f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:52.252119 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afa384a-7aa0-477b-a290-553fb27981d1 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:52.274540 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:52.289808 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fdd9a4-2018-4484-8b6b-8ebe04e8f74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:52.290433 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fdd9a4-2018-4484-8b6b-8ebe04e8f74d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:52.290715 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fdd9a4-2018-4484-8b6b-8ebe04e8f74d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:52.291045 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fdd9a4-2018-4484-8b6b-8ebe04e8f74d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:52.291740 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fdd9a4-2018-4484-8b6b-8ebe04e8f74d None admin] RBAC: Adding query filter params (interface=public, service_id=9b5bbb6c23f14e81bfc529230d01f853, region_id=RegionOne) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:52.292330 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fdd9a4-2018-4484-8b6b-8ebe04e8f74d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:52.293454 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fdd9a4-2018-4484-8b6b-8ebe04e8f74d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:52.304532 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 494/999] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Jul 27 15:12:52 2022] GET /identity/v3/endpoints?service_id=9b5bbb6c23f14e81bfc529230d01f853&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:52.308849 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fdd9a4-2018-4484-8b6b-8ebe04e8f74d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:52.357944 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04d137d-4cf4-44ae-b3d9-369addbbcc1f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:52.393536 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22d358-0ea1-4d6c-a8f4-ef529f6c89c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:52.394148 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22d358-0ea1-4d6c-a8f4-ef529f6c89c0 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:52.394431 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22d358-0ea1-4d6c-a8f4-ef529f6c89c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:52.394710 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de22d358-0ea1-4d6c-a8f4-ef529f6c89c0 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:52.395386 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22d358-0ea1-4d6c-a8f4-ef529f6c89c0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:52.395691 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22d358-0ea1-4d6c-a8f4-ef529f6c89c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:52.397072 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de22d358-0ea1-4d6c-a8f4-ef529f6c89c0 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:52.397180 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:52.401956 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 506/1000] 10.222.0.40 () {56 vars in 1122 bytes} [Wed Jul 27 15:12:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:52.407457 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22d358-0ea1-4d6c-a8f4-ef529f6c89c0 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:52.427895 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fdd9a4-2018-4484-8b6b-8ebe04e8f74d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:52.461408 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d4efc-89e0-4ad2-a651-9dc7b543bc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:52.462020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d4efc-89e0-4ad2-a651-9dc7b543bc85 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:52.462302 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d4efc-89e0-4ad2-a651-9dc7b543bc85 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:52.462574 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d4efc-89e0-4ad2-a651-9dc7b543bc85 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:52.463693 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d4efc-89e0-4ad2-a651-9dc7b543bc85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:52.465085 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d4efc-89e0-4ad2-a651-9dc7b543bc85 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:52.471290 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 495/1001] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Jul 27 15:12:52 2022] GET /identity/v3/services => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 15:12:52.499175 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:52.516548 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de22d358-0ea1-4d6c-a8f4-ef529f6c89c0 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:52.554548 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1378e4a-70cd-47f0-a5a0-6742ebc660cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:52.555209 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1378e4a-70cd-47f0-a5a0-6742ebc660cb None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:52.555466 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1378e4a-70cd-47f0-a5a0-6742ebc660cb None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:52.555701 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1378e4a-70cd-47f0-a5a0-6742ebc660cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:52.556447 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1378e4a-70cd-47f0-a5a0-6742ebc660cb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:52.557813 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1378e4a-70cd-47f0-a5a0-6742ebc660cb None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:52.584038 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 507/1002] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:12:52 2022] POST /identity/v3/endpoints => generated 325 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:12:53.248331 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c70c5d-9540-4cf9-955a-bb70d1161481 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:53.248852 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c70c5d-9540-4cf9-955a-bb70d1161481 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:53.248960 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c70c5d-9540-4cf9-955a-bb70d1161481 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:53.250377 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 496/1003] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:53.255977 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce114d-d681-4176-934d-7cdc4ad68ab6 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:53.256329 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce114d-d681-4176-934d-7cdc4ad68ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:53.256608 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce114d-d681-4176-934d-7cdc4ad68ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:53.275704 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a2ce114d-d681-4176-934d-7cdc4ad68ab6 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:53.276928 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a2ce114d-d681-4176-934d-7cdc4ad68ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:53.353154 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 508/1004] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:53 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:12:53.374805 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c70c5d-9540-4cf9-955a-bb70d1161481 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:53.474459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c70c5d-9540-4cf9-955a-bb70d1161481 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:53.507489 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61affa-09f7-4998-9905-571cc7f9477a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:53.508082 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61affa-09f7-4998-9905-571cc7f9477a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:53.508367 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61affa-09f7-4998-9905-571cc7f9477a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:53.508644 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f61affa-09f7-4998-9905-571cc7f9477a None admin] PATH_INFO: `/v3/services/image` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:53.509266 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61affa-09f7-4998-9905-571cc7f9477a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:53.510615 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f61affa-09f7-4998-9905-571cc7f9477a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:53.519406 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-0f61affa-09f7-4998-9905-571cc7f9477a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 15:12:53.519406 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:53.519406 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 15:12:53.519406 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 15:12:53.519406 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 15:12:53.519406 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 15:12:53.519406 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 15:12:53.519406 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:53.519406 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 15:12:53.519406 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:53.519406 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 15:12:53.519406 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:53.519406 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:53.519406 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:53.519406 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:53.519406 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:53.519406 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:53.520948 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:53.520948 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:53.520948 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:53.520948 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:53.520948 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:53.520948 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:53.520948 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 15:12:53.520948 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 15:12:53.520948 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 15:12:53.520948 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 15:12:53.520948 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:53.520948 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:53.520948 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:53.520948 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:53.520948 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:53.520948 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:53.521798 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:53.521798 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:53.521798 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:53.521798 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:53.521798 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:53.521798 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:53.521798 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:53.521798 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:53.521798 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:53.521798 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:53.521798 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 15:12:53.521798 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:53.521798 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 15:12:53.521798 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:53.524073 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 497/1005] 10.222.0.40 () {56 vars in 1105 bytes} [Wed Jul 27 15:12:53 2022] GET /identity/v3/services/image => generated 86 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:53.527301 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce114d-d681-4176-934d-7cdc4ad68ab6 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:53.607881 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:53.639958 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce114d-d681-4176-934d-7cdc4ad68ab6 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:53.675315 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b7c72-f593-4f7d-9fbe-26dee28c2e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:53.675928 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b7c72-f593-4f7d-9fbe-26dee28c2e2b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:53.676359 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b7c72-f593-4f7d-9fbe-26dee28c2e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:53.676673 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b7c72-f593-4f7d-9fbe-26dee28c2e2b None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:53.677352 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b7c72-f593-4f7d-9fbe-26dee28c2e2b None admin] RBAC: Adding query filter params (name=image) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:53.677659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b7c72-f593-4f7d-9fbe-26dee28c2e2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:53.679016 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3b7c72-f593-4f7d-9fbe-26dee28c2e2b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:53.683885 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 509/1006] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:53.689493 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61affa-09f7-4998-9905-571cc7f9477a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:53.693234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:53.790195 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f61affa-09f7-4998-9905-571cc7f9477a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:53.822688 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb88622-ca66-4f44-abc4-662232b7a9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:53.823299 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb88622-ca66-4f44-abc4-662232b7a9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:53.823584 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb88622-ca66-4f44-abc4-662232b7a9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:53.823863 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb88622-ca66-4f44-abc4-662232b7a9d7 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:53.824578 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb88622-ca66-4f44-abc4-662232b7a9d7 None admin] RBAC: Adding query filter params (type=image) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:53.824884 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb88622-ca66-4f44-abc4-662232b7a9d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:53.826273 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb88622-ca66-4f44-abc4-662232b7a9d7 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:53.830615 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 498/1007] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:53 2022] GET /identity/v3/services?type=image => generated 122 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:54.475020 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c61641-e94a-43c0-989a-ca615f07f397 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:54.475414 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c61641-e94a-43c0-989a-ca615f07f397 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:54.475611 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c61641-e94a-43c0-989a-ca615f07f397 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:54.477125 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 510/1008] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:12:54.482028 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdec895-62a3-4d45-8a97-5a6bf738970f None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:54.482478 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdec895-62a3-4d45-8a97-5a6bf738970f None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:54.482641 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdec895-62a3-4d45-8a97-5a6bf738970f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:54.500600 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-6bdec895-62a3-4d45-8a97-5a6bf738970f None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:54.501788 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6bdec895-62a3-4d45-8a97-5a6bf738970f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:54.564862 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:54.572432 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 499/1009] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:54 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:12:54.594436 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c61641-e94a-43c0-989a-ca615f07f397 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:54.628060 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf36c7c-8b13-4d8e-b72e-e5077fd4a55b None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:54.628464 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf36c7c-8b13-4d8e-b72e-e5077fd4a55b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:54.628750 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf36c7c-8b13-4d8e-b72e-e5077fd4a55b None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:54.630867 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 500/1010] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:12:54.635651 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e378f21-8863-4d15-9b39-dd5cc7d3cb86 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:54.635937 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e378f21-8863-4d15-9b39-dd5cc7d3cb86 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:54.636237 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e378f21-8863-4d15-9b39-dd5cc7d3cb86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:54.656024 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-0e378f21-8863-4d15-9b39-dd5cc7d3cb86 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:54.657209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-0e378f21-8863-4d15-9b39-dd5cc7d3cb86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:54.702836 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c61641-e94a-43c0-989a-ca615f07f397 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:54.724616 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 501/1011] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:54 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:12:54.742224 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234df3a7-ade4-4a0e-9a6d-882b61c3e99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:54.742791 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234df3a7-ade4-4a0e-9a6d-882b61c3e99e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:54.743073 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234df3a7-ade4-4a0e-9a6d-882b61c3e99e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:54.743348 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234df3a7-ade4-4a0e-9a6d-882b61c3e99e None admin] PATH_INFO: `/v3/services/compute` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:54.743966 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234df3a7-ade4-4a0e-9a6d-882b61c3e99e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:54.745346 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234df3a7-ade4-4a0e-9a6d-882b61c3e99e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:54.747297 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e378f21-8863-4d15-9b39-dd5cc7d3cb86 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:54.748399 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:54.756569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-234df3a7-ade4-4a0e-9a6d-882b61c3e99e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 15:12:54.756569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:54.756569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 15:12:54.756569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 15:12:54.756569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 15:12:54.756569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 15:12:54.756569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 15:12:54.756569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:54.756569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 15:12:54.756569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:54.756569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 15:12:54.756569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:54.756569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:54.756569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:54.756569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:54.756569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:54.756569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:54.757602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:54.757602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:54.757602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:54.757602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:54.757602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:54.757602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:54.757602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 15:12:54.757602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 15:12:54.757602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 15:12:54.757602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 15:12:54.757602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:54.757602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:54.757602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:54.757602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:54.757602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:54.757602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:54.758456 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:54.758456 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:54.758456 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:54.758456 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:54.758456 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:54.758456 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:54.758456 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:54.758456 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:54.758456 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:54.758456 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:54.758456 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 15:12:54.758456 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:54.758456 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 15:12:54.758456 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:54.758456 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 511/1012] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:12:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:54.763378 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234df3a7-ade4-4a0e-9a6d-882b61c3e99e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:54.856999 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e378f21-8863-4d15-9b39-dd5cc7d3cb86 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:54.867082 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234df3a7-ade4-4a0e-9a6d-882b61c3e99e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:54.885818 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:54.897375 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b41505-74d9-42ba-a62a-414c6dea5f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:54.898173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b41505-74d9-42ba-a62a-414c6dea5f77 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:54.898459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b41505-74d9-42ba-a62a-414c6dea5f77 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:54.899039 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b41505-74d9-42ba-a62a-414c6dea5f77 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:54.900481 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b41505-74d9-42ba-a62a-414c6dea5f77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:54.901903 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b41505-74d9-42ba-a62a-414c6dea5f77 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:54.903324 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc4c20-2c99-4365-adfb-b798ebaef0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:54.903801 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 502/1013] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:54.904041 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc4c20-2c99-4365-adfb-b798ebaef0f5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:54.904332 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc4c20-2c99-4365-adfb-b798ebaef0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:54.904730 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcc4c20-2c99-4365-adfb-b798ebaef0f5 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:54.905415 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc4c20-2c99-4365-adfb-b798ebaef0f5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:54.905723 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc4c20-2c99-4365-adfb-b798ebaef0f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:54.907063 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcc4c20-2c99-4365-adfb-b798ebaef0f5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:54.909014 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b41505-74d9-42ba-a62a-414c6dea5f77 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:54.914094 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 512/1014] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Jul 27 15:12:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:54.919624 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc4c20-2c99-4365-adfb-b798ebaef0f5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:54.986871 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:55.025800 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcc4c20-2c99-4365-adfb-b798ebaef0f5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:55.026966 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b41505-74d9-42ba-a62a-414c6dea5f77 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:55.062063 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c61186d-0ed0-4a52-9a0c-0f13a8116839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:55.062335 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d9555-b74a-4754-b97d-67379e5a4e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:55.062673 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61186d-0ed0-4a52-9a0c-0f13a8116839 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:55.062881 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d9555-b74a-4754-b97d-67379e5a4e34 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:55.062981 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61186d-0ed0-4a52-9a0c-0f13a8116839 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:55.063160 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d9555-b74a-4754-b97d-67379e5a4e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:55.063255 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c61186d-0ed0-4a52-9a0c-0f13a8116839 None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:55.063421 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d9555-b74a-4754-b97d-67379e5a4e34 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:55.063876 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61186d-0ed0-4a52-9a0c-0f13a8116839 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:55.064120 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d9555-b74a-4754-b97d-67379e5a4e34 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:55.064425 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d9555-b74a-4754-b97d-67379e5a4e34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:55.065327 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c61186d-0ed0-4a52-9a0c-0f13a8116839 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:55.065787 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d9555-b74a-4754-b97d-67379e5a4e34 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:55.071436 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 513/1015] 10.222.0.40 () {56 vars in 1112 bytes} [Wed Jul 27 15:12:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:55.076852 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d9555-b74a-4754-b97d-67379e5a4e34 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:55.098435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 503/1016] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Jul 27 15:12:54 2022] POST /identity/v3/projects => generated 311 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:12:55.195722 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d9555-b74a-4754-b97d-67379e5a4e34 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:55.223249 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:55.232471 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414a869-8d21-49a5-bb0a-16bac9eac544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:55.233100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414a869-8d21-49a5-bb0a-16bac9eac544 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:55.233382 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414a869-8d21-49a5-bb0a-16bac9eac544 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:55.233653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414a869-8d21-49a5-bb0a-16bac9eac544 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:55.234373 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414a869-8d21-49a5-bb0a-16bac9eac544 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:55.235778 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414a869-8d21-49a5-bb0a-16bac9eac544 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:55.258378 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 514/1017] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:12:55 2022] POST /identity/v3/endpoints => generated 334 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:12:55.841677 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc7002-430d-4217-8107-9933b5dae6ff None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:55.842168 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc7002-430d-4217-8107-9933b5dae6ff None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:55.842168 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc7002-430d-4217-8107-9933b5dae6ff None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:55.843619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 504/1018] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:55.849195 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee16163-a4d5-4eb6-ab9b-26ca4053aedb None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:55.849617 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee16163-a4d5-4eb6-ab9b-26ca4053aedb None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:55.849801 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee16163-a4d5-4eb6-ab9b-26ca4053aedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:55.868389 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-2ee16163-a4d5-4eb6-ab9b-26ca4053aedb None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:55.869649 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2ee16163-a4d5-4eb6-ab9b-26ca4053aedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:55.947053 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 515/1019] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:55 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:12:55.968777 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc7002-430d-4217-8107-9933b5dae6ff None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:56.018288 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:56.071198 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dc7002-430d-4217-8107-9933b5dae6ff None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:56.104240 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585d3b2d-be46-4f80-863a-920853b33c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:56.104772 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d3b2d-be46-4f80-863a-920853b33c86 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:56.105051 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d3b2d-be46-4f80-863a-920853b33c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:56.105321 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585d3b2d-be46-4f80-863a-920853b33c86 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:56.106008 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d3b2d-be46-4f80-863a-920853b33c86 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:56.107351 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585d3b2d-be46-4f80-863a-920853b33c86 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:56.132094 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 505/1020] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Jul 27 15:12:55 2022] POST /identity/v3/services => generated 242 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:12:57.185485 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db34e3c-2f5f-4832-97e2-b0599643e7b5 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:57.186028 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db34e3c-2f5f-4832-97e2-b0599643e7b5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:57.186028 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db34e3c-2f5f-4832-97e2-b0599643e7b5 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:57.187754 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 516/1021] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:12:57.192835 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402aeab4-526d-4789-8ff4-245b3636e106 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:57.193217 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402aeab4-526d-4789-8ff4-245b3636e106 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:57.193438 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402aeab4-526d-4789-8ff4-245b3636e106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:57.211611 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-402aeab4-526d-4789-8ff4-245b3636e106 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:57.212819 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-402aeab4-526d-4789-8ff4-245b3636e106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:57.290740 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 506/1022] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:12:57.315277 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db34e3c-2f5f-4832-97e2-b0599643e7b5 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:57.372002 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d3791-2dc3-4c99-808c-8fb4992ea940 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:57.372328 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d3791-2dc3-4c99-808c-8fb4992ea940 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:57.372593 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d3791-2dc3-4c99-808c-8fb4992ea940 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:57.374054 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 507/1023] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:12:57.378698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcf41b-2b99-418f-9ea7-9da90ca7bbdc None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:57.379000 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcf41b-2b99-418f-9ea7-9da90ca7bbdc None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:57.379263 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bcf41b-2b99-418f-9ea7-9da90ca7bbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:57.397424 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-42bcf41b-2b99-418f-9ea7-9da90ca7bbdc None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:57.398608 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-42bcf41b-2b99-418f-9ea7-9da90ca7bbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:57.420883 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db34e3c-2f5f-4832-97e2-b0599643e7b5 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:57.429620 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:57.432118 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:57.456545 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29472310-42e8-4a9e-ace3-4e612391ef5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:57.457110 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29472310-42e8-4a9e-ace3-4e612391ef5e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:57.457399 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29472310-42e8-4a9e-ace3-4e612391ef5e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:57.458194 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29472310-42e8-4a9e-ace3-4e612391ef5e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:57.459349 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29472310-42e8-4a9e-ace3-4e612391ef5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:57.460832 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29472310-42e8-4a9e-ace3-4e612391ef5e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:57.462414 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 517/1024] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:57.467962 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29472310-42e8-4a9e-ace3-4e612391ef5e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:57.483499 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 508/1025] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 15:12:57.505489 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bcf41b-2b99-418f-9ea7-9da90ca7bbdc None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:57.575047 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29472310-42e8-4a9e-ace3-4e612391ef5e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:57.615673 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bcf41b-2b99-418f-9ea7-9da90ca7bbdc None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:57.616325 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343f523-2aa3-4c49-b9de-86ff7d71b298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:57.616992 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343f523-2aa3-4c49-b9de-86ff7d71b298 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:57.617282 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343f523-2aa3-4c49-b9de-86ff7d71b298 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:57.617545 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343f523-2aa3-4c49-b9de-86ff7d71b298 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:57.618273 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343f523-2aa3-4c49-b9de-86ff7d71b298 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:57.619679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343f523-2aa3-4c49-b9de-86ff7d71b298 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:57.652042 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 518/1026] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Jul 27 15:12:57 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:12:57.662355 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c0606-dc7b-4bd7-8841-4be3be2cd56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:57.663030 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c0606-dc7b-4bd7-8841-4be3be2cd56a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:57.663315 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c0606-dc7b-4bd7-8841-4be3be2cd56a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:57.663590 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7c0606-dc7b-4bd7-8841-4be3be2cd56a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:57.676359 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7c0606-dc7b-4bd7-8841-4be3be2cd56a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:12:57.681793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-0b7c0606-dc7b-4bd7-8841-4be3be2cd56a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 15:12:57.681793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:57.681793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:57.681793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:57.681793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:57.681793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:57.681793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:57.681793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:57.681793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:57.681793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:57.681793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:57.681793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:57.681793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:12:57.681793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:12:57.681793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:12:57.681793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:12:57.682794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:12:57.682794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:12:57.682794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:12:57.682794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:12:57.682794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:57.682794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:57.682794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:57.682794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:57.682794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:57.682794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:57.682794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:57.682794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:57.682794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:57.682794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:57.682794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:57.682794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:57.683622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:57.683622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:57.683622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:57.683622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:57.683622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:12:57.683622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:12:57.683622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:12:57.683622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:12:57.683622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:12:57.683622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:12:57.683622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 15:12:57.683622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:57.688200 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 509/1027] 10.222.0.40 () {56 vars in 1120 bytes} [Wed Jul 27 15:12:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:12:57.689399 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343f523-2aa3-4c49-b9de-86ff7d71b298 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:57.727009 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:57.797103 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343f523-2aa3-4c49-b9de-86ff7d71b298 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:57.834858 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221336a-0871-4e23-bbe5-6179a4c44f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:57.835482 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221336a-0871-4e23-bbe5-6179a4c44f49 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:57.835762 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221336a-0871-4e23-bbe5-6179a4c44f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:57.836068 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6221336a-0871-4e23-bbe5-6179a4c44f49 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:57.836796 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6221336a-0871-4e23-bbe5-6179a4c44f49 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:57.837102 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6221336a-0871-4e23-bbe5-6179a4c44f49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:57.838465 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6221336a-0871-4e23-bbe5-6179a4c44f49 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:57.847252 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 519/1028] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Jul 27 15:12:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:57.852853 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c0606-dc7b-4bd7-8841-4be3be2cd56a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:57.882867 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:57.962883 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7c0606-dc7b-4bd7-8841-4be3be2cd56a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:57.997949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f07a7a-3932-4be3-9c35-454c703c5918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:57.998830 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f07a7a-3932-4be3-9c35-454c703c5918 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:57.999255 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f07a7a-3932-4be3-9c35-454c703c5918 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:57.999671 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f07a7a-3932-4be3-9c35-454c703c5918 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:58.010488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f07a7a-3932-4be3-9c35-454c703c5918 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:58.012141 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f07a7a-3932-4be3-9c35-454c703c5918 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:58.026956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-e2f07a7a-3932-4be3-9c35-454c703c5918 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:58.026956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:58.026956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:58.026956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:58.026956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:58.026956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:58.026956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:58.026956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:58.026956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:58.026956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:58.026956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:58.026956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:58.026956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:58.026956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:58.026956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:58.028022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:58.028022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:58.028022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:58.028022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:58.028022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:58.028022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:58.028022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:58.028022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:58.028022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:58.028022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:58.028022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:58.028022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:58.028022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:58.028022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:58.028022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:58.028022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:58.028022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:58.029120 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:58.029120 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:58.029120 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:58.029120 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:58.030609 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 510/1029] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:58.036813 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221336a-0871-4e23-bbe5-6179a4c44f49 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:58.137907 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:58.145085 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6221336a-0871-4e23-bbe5-6179a4c44f49 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:58.158290 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a345d3-f82f-4283-9c1d-a6aec4c43305 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:58.158790 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a345d3-f82f-4283-9c1d-a6aec4c43305 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:58.159074 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a345d3-f82f-4283-9c1d-a6aec4c43305 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:58.160988 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 511/1030] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:12:58.167132 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c887952-5a9a-46d9-8fe2-bd9d28eec72b None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:58.167675 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c887952-5a9a-46d9-8fe2-bd9d28eec72b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:58.168239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c887952-5a9a-46d9-8fe2-bd9d28eec72b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:58.180649 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31499d-d824-49a9-a48e-b25af0c99d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:58.181291 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31499d-d824-49a9-a48e-b25af0c99d36 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:58.181577 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31499d-d824-49a9-a48e-b25af0c99d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:58.181855 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31499d-d824-49a9-a48e-b25af0c99d36 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:58.182566 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31499d-d824-49a9-a48e-b25af0c99d36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:58.183296 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31499d-d824-49a9-a48e-b25af0c99d36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:58.184683 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31499d-d824-49a9-a48e-b25af0c99d36 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:58.188315 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-7c887952-5a9a-46d9-8fe2-bd9d28eec72b None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:58.189743 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-7c887952-5a9a-46d9-8fe2-bd9d28eec72b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:58.198842 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 520/1031] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:58.204326 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31499d-d824-49a9-a48e-b25af0c99d36 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:58.260774 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 512/1032] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 15:12:58.283091 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c887952-5a9a-46d9-8fe2-bd9d28eec72b None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:58.292515 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:58.311000 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31499d-d824-49a9-a48e-b25af0c99d36 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:58.346878 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465a20e-de3e-43f7-b808-cccf1b5c4284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:58.347515 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465a20e-de3e-43f7-b808-cccf1b5c4284 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:58.347797 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465a20e-de3e-43f7-b808-cccf1b5c4284 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:58.348118 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465a20e-de3e-43f7-b808-cccf1b5c4284 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:58.355433 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d465a20e-de3e-43f7-b808-cccf1b5c4284 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:58.356889 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d465a20e-de3e-43f7-b808-cccf1b5c4284 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:58.368669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-d465a20e-de3e-43f7-b808-cccf1b5c4284 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 15:12:58.368669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:58.368669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:58.368669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:58.368669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:58.368669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:58.368669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:58.368669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:58.368669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:58.368669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:58.368669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:58.368669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:58.368669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:12:58.368669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:12:58.368669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:12:58.368669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:12:58.369860 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:58.369860 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:58.369860 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:12:58.369860 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:58.369860 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:12:58.369860 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:12:58.369860 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:58.369860 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:58.369860 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:58.369860 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:58.369860 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:58.369860 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:58.369860 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:58.369860 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:58.369860 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:58.369860 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:58.369860 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:58.369860 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:58.371046 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:58.371046 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:58.371046 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:12:58.371046 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:12:58.371046 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:12:58.371046 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:12:58.371046 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:12:58.371046 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:12:58.371046 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 15:12:58.371046 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:58.374600 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 521/1033] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Jul 27 15:12:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:12:58.375437 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465a20e-de3e-43f7-b808-cccf1b5c4284 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:58.394360 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c887952-5a9a-46d9-8fe2-bd9d28eec72b None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:58.395163 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:58.430742 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b94a1-c4db-4d6c-bd93-3f6af48596c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:58.431394 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b94a1-c4db-4d6c-bd93-3f6af48596c3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:58.431683 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b94a1-c4db-4d6c-bd93-3f6af48596c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:58.431956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b94a1-c4db-4d6c-bd93-3f6af48596c3 None admin] PATH_INFO: `/v3/services/image` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:58.432615 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b94a1-c4db-4d6c-bd93-3f6af48596c3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:58.434019 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b94a1-c4db-4d6c-bd93-3f6af48596c3 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:58.443322 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-3d5b94a1-c4db-4d6c-bd93-3f6af48596c3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 15:12:58.443322 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:58.443322 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 15:12:58.443322 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 15:12:58.443322 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 15:12:58.443322 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 15:12:58.443322 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 15:12:58.443322 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:58.443322 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 15:12:58.443322 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:58.443322 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 15:12:58.443322 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:58.443322 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:58.443322 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:58.443322 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:58.443322 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:58.443322 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:58.444554 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:58.444554 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:58.444554 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:58.444554 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:58.444554 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:58.444554 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:58.444554 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 15:12:58.444554 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 15:12:58.444554 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 15:12:58.444554 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 15:12:58.444554 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:58.444554 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:58.444554 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:58.444554 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:58.444554 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:58.444554 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:58.445856 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:58.445856 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:58.445856 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:58.445856 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:58.445856 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:58.445856 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:58.445856 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:58.445856 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:58.445856 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:58.445856 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:58.445856 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 15:12:58.445856 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:12:58.445856 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 15:12:58.445856 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:58.445856 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 513/1034] 10.222.0.40 () {56 vars in 1105 bytes} [Wed Jul 27 15:12:58 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:12:58.450397 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b94a1-c4db-4d6c-bd93-3f6af48596c3 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:58.492185 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465a20e-de3e-43f7-b808-cccf1b5c4284 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:58.527484 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:58.527773 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d8879-4016-4fa0-9c0b-f7e7441ef93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:58.528346 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d8879-4016-4fa0-9c0b-f7e7441ef93e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:58.528637 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d8879-4016-4fa0-9c0b-f7e7441ef93e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:58.528901 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d8879-4016-4fa0-9c0b-f7e7441ef93e None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:58.529695 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d8879-4016-4fa0-9c0b-f7e7441ef93e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:58.530042 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d8879-4016-4fa0-9c0b-f7e7441ef93e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:58.531428 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8d8879-4016-4fa0-9c0b-f7e7441ef93e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:58.549728 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 522/1035] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Jul 27 15:12:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:58.555507 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d8879-4016-4fa0-9c0b-f7e7441ef93e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:58.564284 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b94a1-c4db-4d6c-bd93-3f6af48596c3 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:58.605125 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b498e-9e96-40db-bd83-17b3fe7e7b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:58.605726 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b498e-9e96-40db-bd83-17b3fe7e7b0c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:58.606006 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b498e-9e96-40db-bd83-17b3fe7e7b0c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:58.606281 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b498e-9e96-40db-bd83-17b3fe7e7b0c None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:58.606959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b498e-9e96-40db-bd83-17b3fe7e7b0c None admin] RBAC: Adding query filter params (name=image) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:58.607263 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b498e-9e96-40db-bd83-17b3fe7e7b0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:58.608729 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b498e-9e96-40db-bd83-17b3fe7e7b0c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:58.614154 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 514/1036] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:58.620140 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b498e-9e96-40db-bd83-17b3fe7e7b0c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:58.650469 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:58.679328 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8d8879-4016-4fa0-9c0b-f7e7441ef93e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:58.715539 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203ba3b-0a00-4e08-88b0-601580189a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:58.716180 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203ba3b-0a00-4e08-88b0-601580189a9e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:58.716475 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203ba3b-0a00-4e08-88b0-601580189a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:58.716751 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d203ba3b-0a00-4e08-88b0-601580189a9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:58.726471 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b498e-9e96-40db-bd83-17b3fe7e7b0c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:58.761065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04f88c-2645-4ad5-8595-6f6944304916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:58.761690 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04f88c-2645-4ad5-8595-6f6944304916 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:58.761969 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04f88c-2645-4ad5-8595-6f6944304916 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:58.762246 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04f88c-2645-4ad5-8595-6f6944304916 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:58.762918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04f88c-2645-4ad5-8595-6f6944304916 None admin] RBAC: Adding query filter params (type=image) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:58.763288 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04f88c-2645-4ad5-8595-6f6944304916 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:58.764683 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f04f88c-2645-4ad5-8595-6f6944304916 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:58.766147 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:58.775437 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 515/1037] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:58.776318 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04f88c-2645-4ad5-8595-6f6944304916 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:58.790591 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d203ba3b-0a00-4e08-88b0-601580189a9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:58.792019 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d203ba3b-0a00-4e08-88b0-601580189a9e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:58.872171 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:58.882374 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04f88c-2645-4ad5-8595-6f6944304916 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:58.901253 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 523/1038] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:12:58 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 15:12:58.906912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203ba3b-0a00-4e08-88b0-601580189a9e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:58.917975 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e77899-480c-4bf6-8f0b-e3a61630b478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:58.918786 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e77899-480c-4bf6-8f0b-e3a61630b478 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:58.918921 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e77899-480c-4bf6-8f0b-e3a61630b478 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:58.919122 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e77899-480c-4bf6-8f0b-e3a61630b478 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:58.919874 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e77899-480c-4bf6-8f0b-e3a61630b478 None admin] RBAC: Adding query filter params (interface=public, service_id=6d631d116f5942caa8219978187b1588, region_id=RegionOne) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:58.920205 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e77899-480c-4bf6-8f0b-e3a61630b478 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:58.921629 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e77899-480c-4bf6-8f0b-e3a61630b478 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:58.933495 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 516/1039] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Jul 27 15:12:58 2022] GET /identity/v3/endpoints?service_id=6d631d116f5942caa8219978187b1588&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:58.935524 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e77899-480c-4bf6-8f0b-e3a61630b478 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:59.017414 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:59.026588 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d203ba3b-0a00-4e08-88b0-601580189a9e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:59.056173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e77899-480c-4bf6-8f0b-e3a61630b478 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:59.062112 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79841d13-0fb9-4ad0-a881-9049a6f76eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:59.062731 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79841d13-0fb9-4ad0-a881-9049a6f76eaf None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:59.063007 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79841d13-0fb9-4ad0-a881-9049a6f76eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:59.063276 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79841d13-0fb9-4ad0-a881-9049a6f76eaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:59.074538 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79841d13-0fb9-4ad0-a881-9049a6f76eaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:59.075951 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79841d13-0fb9-4ad0-a881-9049a6f76eaf None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:59.090335 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec4c35-e165-4524-b5df-f2f5a5f641df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:59.091061 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec4c35-e165-4524-b5df-f2f5a5f641df None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:59.091445 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec4c35-e165-4524-b5df-f2f5a5f641df None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:59.091762 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-79841d13-0fb9-4ad0-a881-9049a6f76eaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:59.091762 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:59.091762 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:59.091762 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:59.091762 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:59.091762 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:59.091762 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:59.091762 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:59.091762 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:59.091762 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:59.091762 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:59.091762 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:59.091762 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:12:59.091762 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:12:59.091762 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:12:59.092812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:12:59.092812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:59.092812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:59.092812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:59.092812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:59.092812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:59.092812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:59.092812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:59.092812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:59.092812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:59.092812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:59.092812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:59.092812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:59.092812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:59.092812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:59.092812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:59.092812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:59.099166 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:12:59.099166 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:12:59.099166 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:12:59.099166 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:12:59.099439 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec4c35-e165-4524-b5df-f2f5a5f641df None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:59.099513 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 524/1040] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:12:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:12:59.099615 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec4c35-e165-4524-b5df-f2f5a5f641df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:59.099615 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec4c35-e165-4524-b5df-f2f5a5f641df None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:59.099768 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79841d13-0fb9-4ad0-a881-9049a6f76eaf None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:59.114609 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 517/1041] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Jul 27 15:12:58 2022] GET /identity/v3/services => generated 1957 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 15:12:59.136694 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:59.216482 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79841d13-0fb9-4ad0-a881-9049a6f76eaf None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:59.252249 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfb838-0a49-4544-a8b2-90f658882564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:59.252871 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfb838-0a49-4544-a8b2-90f658882564 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:59.253150 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfb838-0a49-4544-a8b2-90f658882564 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:59.253419 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfb838-0a49-4544-a8b2-90f658882564 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:59.254140 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdfb838-0a49-4544-a8b2-90f658882564 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:59.254443 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdfb838-0a49-4544-a8b2-90f658882564 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:59.255859 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdfb838-0a49-4544-a8b2-90f658882564 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:59.271094 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 525/1042] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:12:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:59.277531 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec4c35-e165-4524-b5df-f2f5a5f641df None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:59.389731 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec4c35-e165-4524-b5df-f2f5a5f641df None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:59.416254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:59.426082 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7834b-9b62-44fb-ba14-bdd99ae3ebce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:59.427268 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7834b-9b62-44fb-ba14-bdd99ae3ebce None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:59.427610 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7834b-9b62-44fb-ba14-bdd99ae3ebce None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:59.427894 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e7834b-9b62-44fb-ba14-bdd99ae3ebce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:59.434834 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7834b-9b62-44fb-ba14-bdd99ae3ebce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:59.436312 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e7834b-9b62-44fb-ba14-bdd99ae3ebce None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:59.448015 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-70e7834b-9b62-44fb-ba14-bdd99ae3ebce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:59.448015 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:12:59.448015 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:12:59.448015 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:12:59.448015 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:12:59.448015 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:12:59.448015 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:12:59.448015 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:12:59.448015 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:12:59.448015 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:12:59.448015 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:12:59.448015 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:12:59.448015 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:12:59.448015 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:12:59.448015 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:12:59.448939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:12:59.448939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:12:59.448939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:12:59.448939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:12:59.448939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:12:59.448939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:12:59.448939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:12:59.448939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:12:59.448939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:12:59.448939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:12:59.448939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:12:59.448939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:12:59.448939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:12:59.448939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:12:59.448939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:12:59.448939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:12:59.448939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:12:59.449848 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:12:59.449848 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:12:59.449848 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:12:59.449848 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:12:59.449848 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:12:59.449848 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:12:59.449848 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:12:59.449848 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:12:59.453991 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 518/1043] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:12:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:12:59.455410 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfb838-0a49-4544-a8b2-90f658882564 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:59.543510 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:59.559635 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfb838-0a49-4544-a8b2-90f658882564 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:59.600255 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bb743b-ab0f-44f2-9e2c-3f768774ac81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:59.601088 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb743b-ab0f-44f2-9e2c-3f768774ac81 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:59.601523 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb743b-ab0f-44f2-9e2c-3f768774ac81 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:59.601941 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bb743b-ab0f-44f2-9e2c-3f768774ac81 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:59.602921 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb743b-ab0f-44f2-9e2c-3f768774ac81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:59.603382 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb743b-ab0f-44f2-9e2c-3f768774ac81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:59.605041 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bb743b-ab0f-44f2-9e2c-3f768774ac81 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:59.618309 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 526/1044] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jul 27 15:12:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:12:59.624463 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7834b-9b62-44fb-ba14-bdd99ae3ebce None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:59.736182 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e7834b-9b62-44fb-ba14-bdd99ae3ebce None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:12:59.749785 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd64fe-8246-4af9-a196-4b9113a4059f None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:59.750079 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd64fe-8246-4af9-a196-4b9113a4059f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:59.750358 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd64fe-8246-4af9-a196-4b9113a4059f None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:59.751891 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 527/1045] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:12:59.756510 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629aecf-c7d5-4483-92b7-68385bf761ba None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:59.756798 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629aecf-c7d5-4483-92b7-68385bf761ba None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:59.757074 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629aecf-c7d5-4483-92b7-68385bf761ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:59.770746 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454290f7-ec21-41bd-9916-b2fdbd7a338e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:12:59.771351 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454290f7-ec21-41bd-9916-b2fdbd7a338e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:12:59.771630 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454290f7-ec21-41bd-9916-b2fdbd7a338e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:12:59.771903 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454290f7-ec21-41bd-9916-b2fdbd7a338e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:12:59.772711 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454290f7-ec21-41bd-9916-b2fdbd7a338e None admin] RBAC: Adding query filter params (role.id=c0bb546247e847f1a87281d2a3bb21e7, scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5, user.id=d3e01aa0ef1340cbba7170bac4a82783) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:12:59.773071 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454290f7-ec21-41bd-9916-b2fdbd7a338e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:12:59.774538 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454290f7-ec21-41bd-9916-b2fdbd7a338e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:12:59.775739 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-8629aecf-c7d5-4483-92b7-68385bf761ba None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:12:59.777017 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8629aecf-c7d5-4483-92b7-68385bf761ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:12:59.780169 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 519/1046] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:12:59 2022] GET /identity/v3/role_assignments?user.id=d3e01aa0ef1340cbba7170bac4a82783&scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5&role.id=c0bb546247e847f1a87281d2a3bb21e7 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:12:59.851565 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 528/1047] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:12:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 15:12:59.874724 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454290f7-ec21-41bd-9916-b2fdbd7a338e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:12:59.930863 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:12:59.987404 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454290f7-ec21-41bd-9916-b2fdbd7a338e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:00.024762 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573762f-329a-4ca8-b4e1-8dd4db96ed2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:00.025781 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573762f-329a-4ca8-b4e1-8dd4db96ed2c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:00.026261 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573762f-329a-4ca8-b4e1-8dd4db96ed2c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:00.026751 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573762f-329a-4ca8-b4e1-8dd4db96ed2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:00.038133 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573762f-329a-4ca8-b4e1-8dd4db96ed2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:13:00.043427 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-8573762f-329a-4ca8-b4e1-8dd4db96ed2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:13:00.043427 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:13:00.043427 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:13:00.043427 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:13:00.043427 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:13:00.043427 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:13:00.043427 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:13:00.043427 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:13:00.043427 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:13:00.043427 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:13:00.043427 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:13:00.043427 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:13:00.043427 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:13:00.043427 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:13:00.043427 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:13:00.043427 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:13:00.044422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:13:00.044422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:13:00.044422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:13:00.044422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:13:00.044422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:13:00.044422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:13:00.044422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:13:00.044422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:13:00.044422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:13:00.044422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:13:00.044422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:13:00.044422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:13:00.044422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:13:00.044422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:13:00.044422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:13:00.044422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:13:00.045264 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:13:00.045264 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:13:00.045264 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:13:00.045264 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:13:00.045264 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:13:00.045264 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:13:00.045264 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:13:00.045264 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:13:00.045264 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:13:00.045264 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:13:00.045264 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:13:00.045264 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:13:00.046045 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 520/1048] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jul 27 15:12:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:13:00.051252 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629aecf-c7d5-4483-92b7-68385bf761ba None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:00.131907 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:00.156889 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629aecf-c7d5-4483-92b7-68385bf761ba None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:00.191908 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194af48d-606f-4c92-9936-d6f3716305bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:00.193086 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194af48d-606f-4c92-9936-d6f3716305bd None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:00.193367 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194af48d-606f-4c92-9936-d6f3716305bd None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:00.193639 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194af48d-606f-4c92-9936-d6f3716305bd None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:00.194349 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194af48d-606f-4c92-9936-d6f3716305bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:13:00.194652 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194af48d-606f-4c92-9936-d6f3716305bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:00.196079 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194af48d-606f-4c92-9936-d6f3716305bd None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:00.209128 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 529/1049] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:13:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:13:00.210740 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573762f-329a-4ca8-b4e1-8dd4db96ed2c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:00.316720 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573762f-329a-4ca8-b4e1-8dd4db96ed2c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:00.327741 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:00.351848 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91d8bc-60a7-4347-a4b7-5cc55816ca8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:00.352511 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91d8bc-60a7-4347-a4b7-5cc55816ca8c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:00.352792 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91d8bc-60a7-4347-a4b7-5cc55816ca8c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:00.353068 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e91d8bc-60a7-4347-a4b7-5cc55816ca8c None admin] PATH_INFO: `/v3/users/6bdc061ac88b4219b368a21cda69bf8d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:00.366641 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e91d8bc-60a7-4347-a4b7-5cc55816ca8c None admin] RBAC: Authorizing `identity:get_user(user_id=6bdc061ac88b4219b368a21cda69bf8d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:00.368103 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e91d8bc-60a7-4347-a4b7-5cc55816ca8c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:00.369756 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 521/1050] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:13:00 2022] GET /identity/v3/users/6bdc061ac88b4219b368a21cda69bf8d => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:13:00.375607 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194af48d-606f-4c92-9936-d6f3716305bd None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:00.476080 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194af48d-606f-4c92-9936-d6f3716305bd None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:00.510008 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de5801-d5f3-4ec5-b711-5d7433725a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:00.510617 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de5801-d5f3-4ec5-b711-5d7433725a8a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:00.510897 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de5801-d5f3-4ec5-b711-5d7433725a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:00.511228 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de5801-d5f3-4ec5-b711-5d7433725a8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:00.520466 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:00.583490 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de5801-d5f3-4ec5-b711-5d7433725a8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:00.587231 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de5801-d5f3-4ec5-b711-5d7433725a8a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:00.694070 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 530/1051] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:13:00 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 15:13:00.695785 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91d8bc-60a7-4347-a4b7-5cc55816ca8c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:00.793929 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e91d8bc-60a7-4347-a4b7-5cc55816ca8c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:00.827633 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abca53e-f65d-4bef-9580-b66dea313512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:00.828297 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abca53e-f65d-4bef-9580-b66dea313512 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:00.828577 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abca53e-f65d-4bef-9580-b66dea313512 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:00.828849 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abca53e-f65d-4bef-9580-b66dea313512 None admin] PATH_INFO: `/v3/projects/24a6ee5bdd3d45a6ba534edc46c08365` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:00.829984 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abca53e-f65d-4bef-9580-b66dea313512 None admin] RBAC: Authorizing `identity:get_project(project_id=24a6ee5bdd3d45a6ba534edc46c08365)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:00.831524 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abca53e-f65d-4bef-9580-b66dea313512 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:00.838387 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 522/1052] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:13:00 2022] GET /identity/v3/projects/24a6ee5bdd3d45a6ba534edc46c08365 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:00.839731 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de5801-d5f3-4ec5-b711-5d7433725a8a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:00.881737 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:00.944906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de5801-d5f3-4ec5-b711-5d7433725a8a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:00.979043 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49cbdcd-4775-448f-9454-e5d8a795a86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:00.979653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cbdcd-4775-448f-9454-e5d8a795a86f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:00.979937 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cbdcd-4775-448f-9454-e5d8a795a86f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:00.980241 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49cbdcd-4775-448f-9454-e5d8a795a86f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:00.981030 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49cbdcd-4775-448f-9454-e5d8a795a86f None admin] RBAC: Adding query filter params (role.id=6535f8b98008471dba33e89bd460880d, scope.project.id=24a6ee5bdd3d45a6ba534edc46c08365, user.id=6bdc061ac88b4219b368a21cda69bf8d) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:13:00.981343 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49cbdcd-4775-448f-9454-e5d8a795a86f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:00.982759 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49cbdcd-4775-448f-9454-e5d8a795a86f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:00.988493 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 531/1053] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:13:00 2022] GET /identity/v3/role_assignments?user.id=6bdc061ac88b4219b368a21cda69bf8d&scope.project.id=24a6ee5bdd3d45a6ba534edc46c08365&role.id=6535f8b98008471dba33e89bd460880d => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:01.133459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405e0c3-85f8-4cb7-b67d-50cddb1a2ede None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:01.133700 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405e0c3-85f8-4cb7-b67d-50cddb1a2ede None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:01.133939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405e0c3-85f8-4cb7-b67d-50cddb1a2ede None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:01.135282 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 523/1054] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:13:01.140419 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cab4dd-9537-42ca-8513-e9847f170a17 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:01.140956 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cab4dd-9537-42ca-8513-e9847f170a17 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:01.141449 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cab4dd-9537-42ca-8513-e9847f170a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:01.159510 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-05cab4dd-9537-42ca-8513-e9847f170a17 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:13:01.161088 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-05cab4dd-9537-42ca-8513-e9847f170a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:13:01.231211 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 532/1055] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:13:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:13:01.254245 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405e0c3-85f8-4cb7-b67d-50cddb1a2ede None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:01.294171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:01.363844 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405e0c3-85f8-4cb7-b67d-50cddb1a2ede None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:01.399303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35429d4b-6853-4a2b-949f-b39e379e610f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:01.399855 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35429d4b-6853-4a2b-949f-b39e379e610f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:01.400173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35429d4b-6853-4a2b-949f-b39e379e610f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:01.400452 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35429d4b-6853-4a2b-949f-b39e379e610f None admin] PATH_INFO: `/v3/services/image` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:01.401081 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35429d4b-6853-4a2b-949f-b39e379e610f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:01.402484 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35429d4b-6853-4a2b-949f-b39e379e610f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:01.411551 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-35429d4b-6853-4a2b-949f-b39e379e610f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 15:13:01.411551 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:13:01.411551 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 15:13:01.411551 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 15:13:01.411551 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 15:13:01.411551 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 15:13:01.411551 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 15:13:01.411551 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:13:01.411551 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 15:13:01.411551 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:13:01.411551 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 15:13:01.411551 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:13:01.411551 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:13:01.411551 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:13:01.411551 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:13:01.411551 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:13:01.411551 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:13:01.412721 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:13:01.412721 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:13:01.412721 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:13:01.412721 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:13:01.412721 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:13:01.412721 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:13:01.412721 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 15:13:01.412721 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 15:13:01.412721 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 15:13:01.412721 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 15:13:01.412721 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:13:01.412721 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:13:01.412721 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:13:01.412721 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:13:01.412721 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:13:01.412721 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:13:01.413564 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:13:01.413564 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:13:01.413564 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:13:01.413564 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:13:01.413564 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:13:01.413564 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:13:01.413564 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:13:01.413564 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:13:01.413564 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:13:01.413564 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:13:01.413564 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 15:13:01.413564 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:13:01.413564 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 15:13:01.413564 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:13:01.413564 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 524/1056] 10.222.0.40 () {56 vars in 1105 bytes} [Wed Jul 27 15:13:01 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:13:01.420856 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cab4dd-9537-42ca-8513-e9847f170a17 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:01.450927 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:01.522149 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cab4dd-9537-42ca-8513-e9847f170a17 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:01.555798 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fabb8d-52b3-4bbb-b43f-b8d049705ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:01.556555 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fabb8d-52b3-4bbb-b43f-b8d049705ca1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:01.556845 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fabb8d-52b3-4bbb-b43f-b8d049705ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:01.557123 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fabb8d-52b3-4bbb-b43f-b8d049705ca1 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:01.557859 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fabb8d-52b3-4bbb-b43f-b8d049705ca1 None admin] RBAC: Adding query filter params (name=image) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:13:01.558170 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fabb8d-52b3-4bbb-b43f-b8d049705ca1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:01.559533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fabb8d-52b3-4bbb-b43f-b8d049705ca1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:01.569478 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 533/1057] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:13:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:13:01.573050 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35429d4b-6853-4a2b-949f-b39e379e610f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:01.678526 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:01.682362 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35429d4b-6853-4a2b-949f-b39e379e610f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:01.716385 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f41ec5-7364-4689-85e2-243df18e1390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:01.716990 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f41ec5-7364-4689-85e2-243df18e1390 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:01.717268 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f41ec5-7364-4689-85e2-243df18e1390 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:01.717537 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f41ec5-7364-4689-85e2-243df18e1390 None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:01.718199 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f41ec5-7364-4689-85e2-243df18e1390 None admin] RBAC: Adding query filter params (type=image) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:13:01.718500 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f41ec5-7364-4689-85e2-243df18e1390 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:01.719843 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f41ec5-7364-4689-85e2-243df18e1390 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:01.724856 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 525/1058] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:13:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:01.730240 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fabb8d-52b3-4bbb-b43f-b8d049705ca1 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:01.794019 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7e3fe-6c8d-486f-b5f6-f03200b13b82 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:01.794299 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7e3fe-6c8d-486f-b5f6-f03200b13b82 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:01.794574 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7e3fe-6c8d-486f-b5f6-f03200b13b82 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:01.795891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 526/1059] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:13:01.800558 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c422b6-6034-4564-a412-8884af21327b None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:01.800829 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c422b6-6034-4564-a412-8884af21327b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:01.801103 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c422b6-6034-4564-a412-8884af21327b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:01.819684 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-56c422b6-6034-4564-a412-8884af21327b None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:13:01.820893 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-56c422b6-6034-4564-a412-8884af21327b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:13:01.830310 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:01.836858 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fabb8d-52b3-4bbb-b43f-b8d049705ca1 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:01.874174 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5473e-c867-469d-a786-60763aa9c0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:01.874772 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5473e-c867-469d-a786-60763aa9c0f5 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:01.875187 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5473e-c867-469d-a786-60763aa9c0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:01.875323 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e5473e-c867-469d-a786-60763aa9c0f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:01.876032 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5473e-c867-469d-a786-60763aa9c0f5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:01.877375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e5473e-c867-469d-a786-60763aa9c0f5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:01.899665 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 527/1060] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:13:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 15:13:01.905842 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 534/1061] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:13:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:13:01.916489 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c422b6-6034-4564-a412-8884af21327b None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:02.025213 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:02.033390 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c422b6-6034-4564-a412-8884af21327b None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:02.079296 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec4a8e-1206-4da4-b3aa-ae5f57e811c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:02.079960 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec4a8e-1206-4da4-b3aa-ae5f57e811c8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:02.080280 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec4a8e-1206-4da4-b3aa-ae5f57e811c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:02.080548 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec4a8e-1206-4da4-b3aa-ae5f57e811c8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:02.092987 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec4a8e-1206-4da4-b3aa-ae5f57e811c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:13:02.098926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-4fec4a8e-1206-4da4-b3aa-ae5f57e811c8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 15:13:02.098926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:13:02.098926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:13:02.098926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:13:02.098926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:13:02.098926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:13:02.098926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:13:02.098926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:13:02.098926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:13:02.098926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:13:02.098926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:13:02.098926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:13:02.098926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:13:02.098926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:13:02.098926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:13:02.098926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:13:02.099891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:13:02.099891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:13:02.099891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:13:02.099891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:13:02.099891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:13:02.099891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:13:02.099891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:13:02.099891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:13:02.099891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:13:02.099891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:13:02.099891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:13:02.099891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:13:02.099891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:13:02.099891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:13:02.099891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:13:02.099891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:13:02.100794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:13:02.100794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:13:02.100794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:13:02.100794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:13:02.100794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:13:02.100794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:13:02.100794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:13:02.100794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:13:02.100794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:13:02.100794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:13:02.100794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 15:13:02.100794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:13:02.100794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 528/1062] 10.222.0.40 () {56 vars in 1120 bytes} [Wed Jul 27 15:13:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:13:02.106476 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5473e-c867-469d-a786-60763aa9c0f5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:02.210512 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e5473e-c867-469d-a786-60763aa9c0f5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:02.244678 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf2494-1d4e-4f0c-9e26-eeec06d13e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:02.245290 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf2494-1d4e-4f0c-9e26-eeec06d13e2e None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:02.245569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf2494-1d4e-4f0c-9e26-eeec06d13e2e None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:02.245840 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cf2494-1d4e-4f0c-9e26-eeec06d13e2e None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:02.246551 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf2494-1d4e-4f0c-9e26-eeec06d13e2e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:13:02.246855 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf2494-1d4e-4f0c-9e26-eeec06d13e2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:02.248225 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cf2494-1d4e-4f0c-9e26-eeec06d13e2e None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:02.256361 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 535/1063] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Jul 27 15:13:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:02.261747 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec4a8e-1206-4da4-b3aa-ae5f57e811c8 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:02.362786 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec4a8e-1206-4da4-b3aa-ae5f57e811c8 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:02.397897 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daefc3d-0da5-4b02-8339-e0511ef59523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:02.398666 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daefc3d-0da5-4b02-8339-e0511ef59523 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:02.398883 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daefc3d-0da5-4b02-8339-e0511ef59523 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:02.399162 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daefc3d-0da5-4b02-8339-e0511ef59523 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:02.409524 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daefc3d-0da5-4b02-8339-e0511ef59523 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:02.410997 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daefc3d-0da5-4b02-8339-e0511ef59523 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:02.425706 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-7daefc3d-0da5-4b02-8339-e0511ef59523 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:13:02.425706 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:13:02.425706 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:13:02.425706 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:13:02.425706 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:13:02.425706 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:13:02.425706 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:13:02.425706 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:13:02.425706 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:13:02.425706 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:13:02.425706 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:13:02.425706 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:13:02.425706 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:13:02.425706 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:13:02.425706 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:13:02.427127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:13:02.427127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:13:02.427127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:13:02.427127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:13:02.427127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:13:02.427127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:13:02.427127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:13:02.427127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:13:02.427127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:13:02.427127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:13:02.427127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:13:02.427127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:13:02.427127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:13:02.427127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:13:02.427127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:13:02.427127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:13:02.427127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:13:02.428070 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:13:02.428070 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:13:02.428070 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:13:02.428070 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:13:02.433449 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 529/1064] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:13:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:13:02.433573 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf2494-1d4e-4f0c-9e26-eeec06d13e2e None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:02.451066 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:02.539202 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cf2494-1d4e-4f0c-9e26-eeec06d13e2e None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:02.573541 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3f770-cce2-4a9b-8bb0-f6026bf303f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:02.574420 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3f770-cce2-4a9b-8bb0-f6026bf303f0 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:02.574850 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3f770-cce2-4a9b-8bb0-f6026bf303f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:02.575271 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa3f770-cce2-4a9b-8bb0-f6026bf303f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:02.576153 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa3f770-cce2-4a9b-8bb0-f6026bf303f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:13:02.576617 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa3f770-cce2-4a9b-8bb0-f6026bf303f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:02.578117 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa3f770-cce2-4a9b-8bb0-f6026bf303f0 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:02.597373 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 536/1065] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:13:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:02.598752 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daefc3d-0da5-4b02-8339-e0511ef59523 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:02.601894 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:02.704234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daefc3d-0da5-4b02-8339-e0511ef59523 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:02.737061 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df9222-7ba7-446b-8589-1b871722040a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:02.737689 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df9222-7ba7-446b-8589-1b871722040a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:02.737969 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df9222-7ba7-446b-8589-1b871722040a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:02.738240 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df9222-7ba7-446b-8589-1b871722040a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:02.746242 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df9222-7ba7-446b-8589-1b871722040a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:02.747671 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df9222-7ba7-446b-8589-1b871722040a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:02.759378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-58df9222-7ba7-446b-8589-1b871722040a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 15:13:02.759378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:13:02.759378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:13:02.759378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:13:02.759378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:13:02.759378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:13:02.759378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:13:02.759378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:13:02.759378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:13:02.759378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:13:02.759378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:13:02.759378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:13:02.759378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:13:02.759378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:13:02.759378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:13:02.759378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:13:02.760375 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:13:02.760375 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:13:02.760375 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:13:02.760375 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:13:02.760375 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:13:02.760375 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:13:02.760375 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:13:02.760375 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:13:02.760375 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:13:02.760375 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:13:02.760375 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:13:02.760375 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:13:02.760375 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:13:02.760375 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:13:02.760375 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:13:02.760375 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:13:02.760375 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:13:02.760375 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:13:02.761338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:13:02.761338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:13:02.761338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:13:02.761338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:13:02.761338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:13:02.761338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:13:02.761338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:13:02.761338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:13:02.761338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 15:13:02.761338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:13:02.762482 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 530/1066] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Jul 27 15:13:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:13:02.766234 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3f770-cce2-4a9b-8bb0-f6026bf303f0 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:02.842334 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:02.869097 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa3f770-cce2-4a9b-8bb0-f6026bf303f0 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:02.902187 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430cca5c-ce7a-435d-94ce-2ac1a7f74963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:02.902799 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cca5c-ce7a-435d-94ce-2ac1a7f74963 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:02.903080 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cca5c-ce7a-435d-94ce-2ac1a7f74963 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:02.903353 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430cca5c-ce7a-435d-94ce-2ac1a7f74963 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:02.904166 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430cca5c-ce7a-435d-94ce-2ac1a7f74963 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:13:02.904475 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430cca5c-ce7a-435d-94ce-2ac1a7f74963 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:02.905887 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430cca5c-ce7a-435d-94ce-2ac1a7f74963 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:02.928601 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 537/1067] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Jul 27 15:13:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:13:02.929879 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df9222-7ba7-446b-8589-1b871722040a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:02.980653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe548e-af13-4b5f-b90d-9bbb9a7b8e9e None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:02.980945 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe548e-af13-4b5f-b90d-9bbb9a7b8e9e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:02.981139 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe548e-af13-4b5f-b90d-9bbb9a7b8e9e None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:02.982605 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 538/1068] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:13:02.987405 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3410dd-9cab-4927-b219-6e9eec42feb4 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:02.987691 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3410dd-9cab-4927-b219-6e9eec42feb4 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:02.987967 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3410dd-9cab-4927-b219-6e9eec42feb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:02.999718 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:03.007783 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4d3410dd-9cab-4927-b219-6e9eec42feb4 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:13:03.009425 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4d3410dd-9cab-4927-b219-6e9eec42feb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:13:03.033653 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df9222-7ba7-446b-8589-1b871722040a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:03.073049 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8982bb-cdd0-4653-84a8-a3d32e899530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:03.073694 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8982bb-cdd0-4653-84a8-a3d32e899530 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:03.073956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8982bb-cdd0-4653-84a8-a3d32e899530 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:03.074227 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8982bb-cdd0-4653-84a8-a3d32e899530 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:03.084840 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8982bb-cdd0-4653-84a8-a3d32e899530 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:03.092022 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 539/1069] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:13:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 15:13:03.092169 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8982bb-cdd0-4653-84a8-a3d32e899530 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:03.101614 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-1e8982bb-cdd0-4653-84a8-a3d32e899530 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:13:03.101614 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:13:03.101614 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:13:03.101614 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:13:03.101614 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:13:03.101614 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:13:03.101614 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:13:03.101614 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:13:03.101614 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:13:03.101614 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:13:03.101614 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:13:03.101614 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:13:03.101614 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:13:03.101614 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:13:03.101614 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:13:03.102501 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:13:03.102501 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:13:03.102501 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:13:03.102501 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:13:03.102501 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:13:03.102501 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:13:03.102501 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:13:03.102501 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:13:03.102501 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:13:03.102501 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:13:03.102501 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:13:03.102501 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:13:03.102501 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:13:03.102501 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:13:03.102501 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:13:03.102501 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:13:03.102501 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:13:03.103407 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:13:03.103407 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:13:03.103407 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:13:03.103407 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:13:03.107352 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 531/1070] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:13:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:13:03.108077 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8982bb-cdd0-4653-84a8-a3d32e899530 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:03.108437 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3410dd-9cab-4927-b219-6e9eec42feb4 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:03.173786 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:03.213245 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3410dd-9cab-4927-b219-6e9eec42feb4 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:03.217061 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8982bb-cdd0-4653-84a8-a3d32e899530 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:03.231118 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:03.250948 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d147a-477d-43c9-94a2-0b92936fb655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:03.251405 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe2d92-54f6-4465-8cb5-cf20201f776e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:03.251622 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d147a-477d-43c9-94a2-0b92936fb655 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:03.251852 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d147a-477d-43c9-94a2-0b92936fb655 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:03.252047 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe2d92-54f6-4465-8cb5-cf20201f776e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:03.252158 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2d147a-477d-43c9-94a2-0b92936fb655 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:03.252309 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe2d92-54f6-4465-8cb5-cf20201f776e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:03.252621 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fe2d92-54f6-4465-8cb5-cf20201f776e None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:03.253249 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe2d92-54f6-4465-8cb5-cf20201f776e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:13:03.253551 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe2d92-54f6-4465-8cb5-cf20201f776e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:03.254925 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fe2d92-54f6-4465-8cb5-cf20201f776e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:03.262500 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2d147a-477d-43c9-94a2-0b92936fb655 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:13:03.267399 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 532/1071] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:13:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:03.267843 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-de2d147a-477d-43c9-94a2-0b92936fb655 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:13:03.267843 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:13:03.267843 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:13:03.267843 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:13:03.267843 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:13:03.267843 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:13:03.267843 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:13:03.267843 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:13:03.267843 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:13:03.267843 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:13:03.267843 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:13:03.267843 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:13:03.267843 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:13:03.267843 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:13:03.267843 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:13:03.267843 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:13:03.274679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:13:03.274679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:13:03.274679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:13:03.274679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:13:03.274679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:13:03.274679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:13:03.274679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:13:03.274679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:13:03.274679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:13:03.274679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:13:03.274679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:13:03.274679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:13:03.274679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:13:03.274679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:13:03.274679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:13:03.274679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:13:03.275601 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:13:03.275601 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:13:03.275601 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:13:03.275601 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:13:03.275601 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:13:03.275601 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:13:03.275601 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:13:03.275601 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:13:03.275601 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:13:03.275601 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:13:03.275601 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:13:03.275601 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:13:03.275601 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 540/1072] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jul 27 15:13:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:13:03.276339 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe2d92-54f6-4465-8cb5-cf20201f776e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:03.277465 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d147a-477d-43c9-94a2-0b92936fb655 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:03.387547 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2d147a-477d-43c9-94a2-0b92936fb655 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:03.402336 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fe2d92-54f6-4465-8cb5-cf20201f776e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:03.412822 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:03.426715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3aa19b-8896-4f7b-9d89-c7bfdf3360a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:03.427335 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3aa19b-8896-4f7b-9d89-c7bfdf3360a4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:03.427618 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3aa19b-8896-4f7b-9d89-c7bfdf3360a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:03.427889 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3aa19b-8896-4f7b-9d89-c7bfdf3360a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:03.428637 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3aa19b-8896-4f7b-9d89-c7bfdf3360a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:13:03.428942 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3aa19b-8896-4f7b-9d89-c7bfdf3360a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:03.430308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3aa19b-8896-4f7b-9d89-c7bfdf3360a4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:03.443921 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 541/1073] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:13:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:13:03.444529 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec1e34-9170-4c03-850e-6e4d25977eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:03.444529 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec1e34-9170-4c03-850e-6e4d25977eec None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:03.444529 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec1e34-9170-4c03-850e-6e4d25977eec None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:03.444529 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cec1e34-9170-4c03-850e-6e4d25977eec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:03.446140 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3aa19b-8896-4f7b-9d89-c7bfdf3360a4 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:03.449876 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec1e34-9170-4c03-850e-6e4d25977eec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:03.451311 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cec1e34-9170-4c03-850e-6e4d25977eec None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:03.462543 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-0cec1e34-9170-4c03-850e-6e4d25977eec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:13:03.462543 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:13:03.462543 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:13:03.462543 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:13:03.462543 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:13:03.462543 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:13:03.462543 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:13:03.462543 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:13:03.462543 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:13:03.462543 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:13:03.462543 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:13:03.462543 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:13:03.462543 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:13:03.462543 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:13:03.462543 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:13:03.463456 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:13:03.463456 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:13:03.463456 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:13:03.463456 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:13:03.463456 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:13:03.463456 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:13:03.463456 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:13:03.463456 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:13:03.463456 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:13:03.463456 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:13:03.463456 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:13:03.463456 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:13:03.463456 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:13:03.463456 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:13:03.463456 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:13:03.463456 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:13:03.463456 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:13:03.464407 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:13:03.464407 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:13:03.464407 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:13:03.464407 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:13:03.464407 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:13:03.464407 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:13:03.464407 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:13:03.464407 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:13:03.464407 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 533/1074] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:13:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:13:03.469246 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec1e34-9170-4c03-850e-6e4d25977eec None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:03.506333 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:03.555913 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3aa19b-8896-4f7b-9d89-c7bfdf3360a4 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:03.580853 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cec1e34-9170-4c03-850e-6e4d25977eec None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:03.592979 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01170cb2-8153-4d08-8b59-a5dbb23aa289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:03.593657 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01170cb2-8153-4d08-8b59-a5dbb23aa289 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:03.593940 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01170cb2-8153-4d08-8b59-a5dbb23aa289 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:03.594217 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01170cb2-8153-4d08-8b59-a5dbb23aa289 None admin] PATH_INFO: `/v3/users/6bdc061ac88b4219b368a21cda69bf8d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:03.595380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01170cb2-8153-4d08-8b59-a5dbb23aa289 None admin] RBAC: Authorizing `identity:get_user(user_id=6bdc061ac88b4219b368a21cda69bf8d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:03.596829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01170cb2-8153-4d08-8b59-a5dbb23aa289 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:03.603672 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 542/1075] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:13:03 2022] GET /identity/v3/users/6bdc061ac88b4219b368a21cda69bf8d => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:13:03.604673 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01170cb2-8153-4d08-8b59-a5dbb23aa289 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:03.630648 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887a785-0278-49c1-ac04-be1dff3a99d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:03.631290 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887a785-0278-49c1-ac04-be1dff3a99d3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:03.631569 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887a785-0278-49c1-ac04-be1dff3a99d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:03.631838 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887a785-0278-49c1-ac04-be1dff3a99d3 None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:03.632617 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887a785-0278-49c1-ac04-be1dff3a99d3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:13:03.632922 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887a785-0278-49c1-ac04-be1dff3a99d3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:03.634341 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887a785-0278-49c1-ac04-be1dff3a99d3 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:03.647168 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 534/1076] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jul 27 15:13:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:03.652954 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887a785-0278-49c1-ac04-be1dff3a99d3 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:03.663112 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:03.715344 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01170cb2-8153-4d08-8b59-a5dbb23aa289 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:03.754730 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c118d-6746-47eb-8b70-69cc2f95225f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:03.755363 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c118d-6746-47eb-8b70-69cc2f95225f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:03.755638 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c118d-6746-47eb-8b70-69cc2f95225f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:03.755908 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25c118d-6746-47eb-8b70-69cc2f95225f None admin] PATH_INFO: `/v3/projects/24a6ee5bdd3d45a6ba534edc46c08365` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:03.756629 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:03.757074 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c118d-6746-47eb-8b70-69cc2f95225f None admin] RBAC: Authorizing `identity:get_project(project_id=24a6ee5bdd3d45a6ba534edc46c08365)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:03.758495 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25c118d-6746-47eb-8b70-69cc2f95225f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:03.760483 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 543/1077] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:13:03 2022] GET /identity/v3/projects/24a6ee5bdd3d45a6ba534edc46c08365 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:13:03.766367 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c118d-6746-47eb-8b70-69cc2f95225f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:03.767698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887a785-0278-49c1-ac04-be1dff3a99d3 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:03.804028 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fda82b-25b9-479a-b8e5-3dbbe51e6161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:03.804714 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fda82b-25b9-479a-b8e5-3dbbe51e6161 None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:03.804999 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fda82b-25b9-479a-b8e5-3dbbe51e6161 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:03.805272 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fda82b-25b9-479a-b8e5-3dbbe51e6161 None admin] PATH_INFO: `/v3/projects/0b616213eaea4a22afee15d4cbe5a3c5/users/d3e01aa0ef1340cbba7170bac4a82783/roles/c0bb546247e847f1a87281d2a3bb21e7` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:03.807471 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fda82b-25b9-479a-b8e5-3dbbe51e6161 None admin] RBAC: Authorizing `identity:create_grant(project_id=0b616213eaea4a22afee15d4cbe5a3c5, user_id=d3e01aa0ef1340cbba7170bac4a82783, role_id=c0bb546247e847f1a87281d2a3bb21e7)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:03.808910 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fda82b-25b9-479a-b8e5-3dbbe51e6161 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:03.822430 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 535/1078] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jul 27 15:13:03 2022] PUT /identity/v3/projects/0b616213eaea4a22afee15d4cbe5a3c5/users/d3e01aa0ef1340cbba7170bac4a82783/roles/c0bb546247e847f1a87281d2a3bb21e7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:13:03.888807 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25c118d-6746-47eb-8b70-69cc2f95225f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:03.912814 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:03.929223 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79d629-4883-4a11-9152-b41d31f46e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:03.929966 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79d629-4883-4a11-9152-b41d31f46e13 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:03.930250 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79d629-4883-4a11-9152-b41d31f46e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:03.930523 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79d629-4883-4a11-9152-b41d31f46e13 None admin] PATH_INFO: `/v3/projects/24a6ee5bdd3d45a6ba534edc46c08365/users/6bdc061ac88b4219b368a21cda69bf8d/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:03.932617 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e79d629-4883-4a11-9152-b41d31f46e13 None admin] RBAC: Authorizing `identity:create_grant(project_id=24a6ee5bdd3d45a6ba534edc46c08365, user_id=6bdc061ac88b4219b368a21cda69bf8d, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:03.934067 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e79d629-4883-4a11-9152-b41d31f46e13 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:03.935335 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f938c6-18fc-412a-8cef-8ed8d4d06c7a None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:03.935630 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f938c6-18fc-412a-8cef-8ed8d4d06c7a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:03.935910 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f938c6-18fc-412a-8cef-8ed8d4d06c7a None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:03.937891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 536/1079] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:13:03.942953 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31749da0-587c-470b-abec-bfe7c0485350 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:03.943230 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31749da0-587c-470b-abec-bfe7c0485350 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:03.943480 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31749da0-587c-470b-abec-bfe7c0485350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:03.948819 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 544/1080] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jul 27 15:13:03 2022] PUT /identity/v3/projects/24a6ee5bdd3d45a6ba534edc46c08365/users/6bdc061ac88b4219b368a21cda69bf8d/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:13:03.966887 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-31749da0-587c-470b-abec-bfe7c0485350 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:13:03.968177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-31749da0-587c-470b-abec-bfe7c0485350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:13:04.050955 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 537/1081] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:13:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 15:13:04.073822 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79d629-4883-4a11-9152-b41d31f46e13 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:04.182334 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79d629-4883-4a11-9152-b41d31f46e13 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:04.215677 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6de51-19da-4c4b-af8f-9cd4510d1bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:04.216320 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6de51-19da-4c4b-af8f-9cd4510d1bdb None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:04.216596 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6de51-19da-4c4b-af8f-9cd4510d1bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:04.216868 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e6de51-19da-4c4b-af8f-9cd4510d1bdb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:04.264079 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:04.287182 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6de51-19da-4c4b-af8f-9cd4510d1bdb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:04.289025 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e6de51-19da-4c4b-af8f-9cd4510d1bdb None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:04.387764 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 545/1082] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:13:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 15:13:04.394156 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31749da0-587c-470b-abec-bfe7c0485350 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:04.481642 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:04.499488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31749da0-587c-470b-abec-bfe7c0485350 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:04.534445 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcee221-005f-4519-8191-fd17a6939c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:04.535085 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcee221-005f-4519-8191-fd17a6939c8d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:04.535367 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcee221-005f-4519-8191-fd17a6939c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:04.535665 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcee221-005f-4519-8191-fd17a6939c8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:04.545791 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcee221-005f-4519-8191-fd17a6939c8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:04.547227 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcee221-005f-4519-8191-fd17a6939c8d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:04.562042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-1fcee221-005f-4519-8191-fd17a6939c8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:13:04.562042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:13:04.562042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:13:04.562042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:13:04.562042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:13:04.562042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:13:04.562042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:13:04.562042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:13:04.562042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:13:04.562042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:13:04.562042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:13:04.562042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:13:04.562042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:13:04.562042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:13:04.562042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:13:04.562939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:13:04.562939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:13:04.562939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:13:04.562939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:13:04.562939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:13:04.562939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:13:04.562939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:13:04.562939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:13:04.562939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:13:04.562939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:13:04.562939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:13:04.562939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:13:04.562939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:13:04.562939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:13:04.562939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:13:04.562939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:13:04.562939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:13:04.569444 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:13:04.569444 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:13:04.569444 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:13:04.569444 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:13:04.569444 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 538/1083] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:13:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:13:04.570255 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6de51-19da-4c4b-af8f-9cd4510d1bdb None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:04.654647 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:04.675063 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e6de51-19da-4c4b-af8f-9cd4510d1bdb None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:04.710197 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119eac5-13a9-447f-ab4b-a9b3eb6296c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:04.710860 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119eac5-13a9-447f-ab4b-a9b3eb6296c4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:04.711143 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119eac5-13a9-447f-ab4b-a9b3eb6296c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:04.711413 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119eac5-13a9-447f-ab4b-a9b3eb6296c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:04.712130 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119eac5-13a9-447f-ab4b-a9b3eb6296c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:13:04.712432 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119eac5-13a9-447f-ab4b-a9b3eb6296c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:04.713831 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5119eac5-13a9-447f-ab4b-a9b3eb6296c4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:04.726805 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 546/1084] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:05.845490 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2648d9-9e0a-4c0b-9054-f17b456e3785 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:05.846031 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2648d9-9e0a-4c0b-9054-f17b456e3785 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:05.846031 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2648d9-9e0a-4c0b-9054-f17b456e3785 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:05.847430 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 539/1085] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:13:05.852388 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a501d-76ce-4a1c-86a8-a2310f15699a None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:05.852810 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a501d-76ce-4a1c-86a8-a2310f15699a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:05.852920 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5a501d-76ce-4a1c-86a8-a2310f15699a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:05.870446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-2c5a501d-76ce-4a1c-86a8-a2310f15699a None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:13:05.871630 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2c5a501d-76ce-4a1c-86a8-a2310f15699a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:13:05.936007 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 547/1086] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:13:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 15:13:05.954844 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78953ff-f45a-4f91-97b9-123814c8ced5 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:05.955135 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78953ff-f45a-4f91-97b9-123814c8ced5 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:05.955413 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78953ff-f45a-4f91-97b9-123814c8ced5 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:05.956778 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 540/1087] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:13:05.959420 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a501d-76ce-4a1c-86a8-a2310f15699a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:05.962235 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d9237-35dc-4347-89f6-8c0e738ad923 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:05.962518 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d9237-35dc-4347-89f6-8c0e738ad923 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:05.962790 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d9237-35dc-4347-89f6-8c0e738ad923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:05.980318 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-342d9237-35dc-4347-89f6-8c0e738ad923 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:13:05.981488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-342d9237-35dc-4347-89f6-8c0e738ad923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:13:06.027363 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:06.049634 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 541/1088] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:13:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 15:13:06.056330 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5a501d-76ce-4a1c-86a8-a2310f15699a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:06.072675 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d9237-35dc-4347-89f6-8c0e738ad923 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:06.090876 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649871f-3906-4a7c-aa52-8ac50eb5355b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:06.091510 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649871f-3906-4a7c-aa52-8ac50eb5355b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:06.091789 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649871f-3906-4a7c-aa52-8ac50eb5355b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:06.092082 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9649871f-3906-4a7c-aa52-8ac50eb5355b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:06.101933 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9649871f-3906-4a7c-aa52-8ac50eb5355b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:13:06.106659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-9649871f-3906-4a7c-aa52-8ac50eb5355b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 15:13:06.106659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:13:06.106659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:13:06.106659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:13:06.106659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:13:06.106659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:13:06.106659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:13:06.106659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:13:06.106659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:13:06.106659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:13:06.106659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:13:06.106659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:13:06.106659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:13:06.106659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:13:06.106659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:13:06.106659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:13:06.107777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:13:06.107777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:13:06.107777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:13:06.107777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:13:06.107777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:13:06.107777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:13:06.107777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:13:06.107777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:13:06.107777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:13:06.107777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:13:06.107777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:13:06.107777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:13:06.107777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:13:06.107777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:13:06.107777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:13:06.107777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:13:06.108717 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:13:06.108717 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:13:06.108717 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:13:06.108717 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:13:06.108717 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:13:06.108717 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:13:06.108717 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:13:06.108717 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:13:06.108717 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:13:06.108717 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:13:06.108717 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 15:13:06.108717 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:13:06.112757 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 548/1089] 10.222.0.40 () {56 vars in 1120 bytes} [Wed Jul 27 15:13:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:13:06.113527 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649871f-3906-4a7c-aa52-8ac50eb5355b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:06.139168 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:06.173745 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d9237-35dc-4347-89f6-8c0e738ad923 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:06.207216 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebabf7d-4196-44f2-a275-46d69c6886a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:06.207936 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebabf7d-4196-44f2-a275-46d69c6886a3 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:06.208281 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebabf7d-4196-44f2-a275-46d69c6886a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:06.208558 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebabf7d-4196-44f2-a275-46d69c6886a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:06.210979 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9649871f-3906-4a7c-aa52-8ac50eb5355b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:06.218194 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebabf7d-4196-44f2-a275-46d69c6886a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:13:06.222991 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-7ebabf7d-4196-44f2-a275-46d69c6886a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:13:06.222991 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:13:06.222991 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:13:06.222991 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:13:06.222991 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:13:06.222991 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:13:06.222991 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:13:06.222991 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:13:06.222991 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:13:06.222991 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:13:06.222991 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:13:06.222991 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:13:06.222991 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:13:06.222991 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:13:06.222991 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:13:06.222991 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:13:06.224076 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:13:06.224076 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:13:06.224076 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:13:06.224076 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:13:06.224076 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:13:06.224076 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:13:06.224076 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:13:06.224076 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:13:06.224076 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:13:06.224076 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:13:06.224076 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:13:06.224076 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:13:06.224076 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:13:06.224076 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:13:06.224076 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:13:06.224076 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:13:06.224926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:13:06.224926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:13:06.224926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:13:06.224926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:13:06.224926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:13:06.224926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:13:06.224926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:13:06.224926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:13:06.224926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:13:06.224926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:13:06.224926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:13:06.224926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:13:06.224926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 542/1090] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jul 27 15:13:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:13:06.230095 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebabf7d-4196-44f2-a275-46d69c6886a3 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:06.240586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:06.246721 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e2536-00fc-4d65-ae1e-3212fb011b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:06.247341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e2536-00fc-4d65-ae1e-3212fb011b64 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:06.247620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e2536-00fc-4d65-ae1e-3212fb011b64 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:06.247895 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830e2536-00fc-4d65-ae1e-3212fb011b64 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:06.248652 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e2536-00fc-4d65-ae1e-3212fb011b64 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:13:06.248954 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e2536-00fc-4d65-ae1e-3212fb011b64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:06.250317 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830e2536-00fc-4d65-ae1e-3212fb011b64 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:06.258955 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 549/1091] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Jul 27 15:13:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:06.264501 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e2536-00fc-4d65-ae1e-3212fb011b64 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:06.329608 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebabf7d-4196-44f2-a275-46d69c6886a3 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:06.354088 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:06.362595 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830e2536-00fc-4d65-ae1e-3212fb011b64 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:06.362849 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd65e6a-c1ed-4b79-affe-ac161e3b7e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:06.363456 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd65e6a-c1ed-4b79-affe-ac161e3b7e27 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:06.364277 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd65e6a-c1ed-4b79-affe-ac161e3b7e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:06.364550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd65e6a-c1ed-4b79-affe-ac161e3b7e27 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:06.365254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd65e6a-c1ed-4b79-affe-ac161e3b7e27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:13:06.365557 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd65e6a-c1ed-4b79-affe-ac161e3b7e27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:06.366931 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd65e6a-c1ed-4b79-affe-ac161e3b7e27 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:06.374976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 543/1092] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:13:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:13:06.381340 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd65e6a-c1ed-4b79-affe-ac161e3b7e27 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:06.396891 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc839c-cd9f-4cdb-ba54-b01f91ed46c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:06.397516 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc839c-cd9f-4cdb-ba54-b01f91ed46c0 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:06.397813 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc839c-cd9f-4cdb-ba54-b01f91ed46c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:06.398081 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdc839c-cd9f-4cdb-ba54-b01f91ed46c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:06.409384 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc839c-cd9f-4cdb-ba54-b01f91ed46c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:06.410847 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdc839c-cd9f-4cdb-ba54-b01f91ed46c0 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:06.425110 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-7fdc839c-cd9f-4cdb-ba54-b01f91ed46c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:13:06.425110 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:13:06.425110 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:13:06.425110 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:13:06.425110 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:13:06.425110 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:13:06.425110 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:13:06.425110 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:13:06.425110 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:13:06.425110 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:13:06.425110 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:13:06.425110 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:13:06.425110 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:13:06.425110 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:13:06.425110 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:13:06.426705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:13:06.426705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:13:06.426705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:13:06.426705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:13:06.426705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:13:06.426705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:13:06.426705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:13:06.426705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:13:06.426705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:13:06.426705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:13:06.426705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:13:06.426705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:13:06.426705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:13:06.426705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:13:06.426705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:13:06.426705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:13:06.426705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:13:06.432586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:13:06.432586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:13:06.432586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:13:06.432586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:13:06.432586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 550/1093] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:13:06.432586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc839c-cd9f-4cdb-ba54-b01f91ed46c0 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:06.477396 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:06.487933 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd65e6a-c1ed-4b79-affe-ac161e3b7e27 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:06.521822 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871fd6fb-c7ac-4b44-9b97-b295b9d6bd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:06.522459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871fd6fb-c7ac-4b44-9b97-b295b9d6bd31 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:06.522741 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871fd6fb-c7ac-4b44-9b97-b295b9d6bd31 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:06.523020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871fd6fb-c7ac-4b44-9b97-b295b9d6bd31 None admin] PATH_INFO: `/v3/users/6bdc061ac88b4219b368a21cda69bf8d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:06.524215 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871fd6fb-c7ac-4b44-9b97-b295b9d6bd31 None admin] RBAC: Authorizing `identity:get_user(user_id=6bdc061ac88b4219b368a21cda69bf8d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:06.525651 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871fd6fb-c7ac-4b44-9b97-b295b9d6bd31 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:06.527252 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 544/1094] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:13:06 2022] GET /identity/v3/users/6bdc061ac88b4219b368a21cda69bf8d => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:13:06.531182 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdc839c-cd9f-4cdb-ba54-b01f91ed46c0 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:06.533035 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871fd6fb-c7ac-4b44-9b97-b295b9d6bd31 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:06.564797 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f081c17-eb83-40d5-906c-38d85c5843f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:06.565404 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f081c17-eb83-40d5-906c-38d85c5843f4 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:06.565681 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f081c17-eb83-40d5-906c-38d85c5843f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:06.565949 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f081c17-eb83-40d5-906c-38d85c5843f4 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:06.566624 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f081c17-eb83-40d5-906c-38d85c5843f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:13:06.567469 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f081c17-eb83-40d5-906c-38d85c5843f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:06.568841 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f081c17-eb83-40d5-906c-38d85c5843f4 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:06.582888 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 551/1095] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:06.588356 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f081c17-eb83-40d5-906c-38d85c5843f4 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:06.591299 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:06.635214 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871fd6fb-c7ac-4b44-9b97-b295b9d6bd31 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:06.668274 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb30c1e-61d1-4e8a-9305-68135992d5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:06.668879 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb30c1e-61d1-4e8a-9305-68135992d5ce None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:06.669157 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb30c1e-61d1-4e8a-9305-68135992d5ce None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:06.669425 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb30c1e-61d1-4e8a-9305-68135992d5ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:06.685877 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f081c17-eb83-40d5-906c-38d85c5843f4 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:06.688162 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:06.720039 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7ce4d-a016-47cf-b3c1-02fa1ee4f76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:06.720656 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7ce4d-a016-47cf-b3c1-02fa1ee4f76d None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:06.720933 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7ce4d-a016-47cf-b3c1-02fa1ee4f76d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:06.721200 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7ce4d-a016-47cf-b3c1-02fa1ee4f76d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:06.728620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7ce4d-a016-47cf-b3c1-02fa1ee4f76d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:06.730037 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f7ce4d-a016-47cf-b3c1-02fa1ee4f76d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:06.734791 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb30c1e-61d1-4e8a-9305-68135992d5ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:06.736240 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb30c1e-61d1-4e8a-9305-68135992d5ce None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:06.742036 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-79f7ce4d-a016-47cf-b3c1-02fa1ee4f76d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 15:13:06.742036 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:13:06.742036 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:13:06.742036 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:13:06.742036 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:13:06.742036 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:13:06.742036 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:13:06.742036 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:13:06.742036 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:13:06.742036 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:13:06.742036 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:13:06.742036 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:13:06.742036 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:13:06.742036 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:13:06.742036 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:13:06.742036 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:13:06.743160 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:13:06.743160 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:13:06.743160 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:13:06.743160 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:13:06.743160 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:13:06.743160 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:13:06.743160 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:13:06.743160 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:13:06.743160 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:13:06.743160 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:13:06.743160 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:13:06.743160 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:13:06.743160 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:13:06.743160 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:13:06.743160 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:13:06.743160 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:13:06.743160 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:13:06.743160 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:13:06.744323 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:13:06.744323 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:13:06.744323 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:13:06.744323 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:13:06.744323 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:13:06.744323 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:13:06.744323 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:13:06.744323 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:13:06.744323 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 15:13:06.744323 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:13:06.744323 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 552/1096] 10.222.0.40 () {56 vars in 1093 bytes} [Wed Jul 27 15:13:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:13:06.748805 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7ce4d-a016-47cf-b3c1-02fa1ee4f76d None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:06.790996 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:06.836418 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 545/1097] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:13:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 15:13:06.842120 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb30c1e-61d1-4e8a-9305-68135992d5ce None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:06.846080 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7ce4d-a016-47cf-b3c1-02fa1ee4f76d None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:06.879287 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01e613-9b98-4e48-951f-53f4215b876f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:06.880306 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01e613-9b98-4e48-951f-53f4215b876f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:06.880588 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01e613-9b98-4e48-951f-53f4215b876f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:06.880861 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01e613-9b98-4e48-951f-53f4215b876f None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:06.881641 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01e613-9b98-4e48-951f-53f4215b876f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:13:06.881942 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01e613-9b98-4e48-951f-53f4215b876f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:06.883335 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01e613-9b98-4e48-951f-53f4215b876f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:06.899763 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 553/1098] 10.222.0.40 () {56 vars in 1133 bytes} [Wed Jul 27 15:13:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:13:06.905195 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01e613-9b98-4e48-951f-53f4215b876f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:06.928732 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:06.943296 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb30c1e-61d1-4e8a-9305-68135992d5ce None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:06.978723 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d893ca4-4a67-443d-9738-8c0a5ca28568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:06.979351 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d893ca4-4a67-443d-9738-8c0a5ca28568 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:06.979641 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d893ca4-4a67-443d-9738-8c0a5ca28568 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:06.979916 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d893ca4-4a67-443d-9738-8c0a5ca28568 None admin] PATH_INFO: `/v3/projects/24a6ee5bdd3d45a6ba534edc46c08365` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:06.981091 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d893ca4-4a67-443d-9738-8c0a5ca28568 None admin] RBAC: Authorizing `identity:get_project(project_id=24a6ee5bdd3d45a6ba534edc46c08365)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:06.982512 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d893ca4-4a67-443d-9738-8c0a5ca28568 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:06.984205 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 546/1099] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:13:06 2022] GET /identity/v3/projects/24a6ee5bdd3d45a6ba534edc46c08365 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:13:06.990271 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d893ca4-4a67-443d-9738-8c0a5ca28568 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:07.001307 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01e613-9b98-4e48-951f-53f4215b876f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:07.015024 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:07.040153 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878951d6-75ae-42eb-b98f-cfe0bee0be83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:07.040768 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878951d6-75ae-42eb-b98f-cfe0bee0be83 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:07.041050 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878951d6-75ae-42eb-b98f-cfe0bee0be83 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:07.041323 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878951d6-75ae-42eb-b98f-cfe0bee0be83 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:07.092861 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d893ca4-4a67-443d-9738-8c0a5ca28568 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:07.112884 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878951d6-75ae-42eb-b98f-cfe0bee0be83 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:07.114358 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878951d6-75ae-42eb-b98f-cfe0bee0be83 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:07.126774 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5c960-8de1-44f8-ac55-3af412f3a9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:07.127389 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5c960-8de1-44f8-ac55-3af412f3a9d6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:07.127672 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5c960-8de1-44f8-ac55-3af412f3a9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:07.127946 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5c960-8de1-44f8-ac55-3af412f3a9d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:07.128770 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add5c960-8de1-44f8-ac55-3af412f3a9d6 None admin] RBAC: Adding query filter params (role.id=6535f8b98008471dba33e89bd460880d, scope.project.id=24a6ee5bdd3d45a6ba534edc46c08365, user.id=6bdc061ac88b4219b368a21cda69bf8d) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:13:07.129080 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add5c960-8de1-44f8-ac55-3af412f3a9d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:07.130484 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add5c960-8de1-44f8-ac55-3af412f3a9d6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:07.136379 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 547/1100] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:13:06 2022] GET /identity/v3/role_assignments?user.id=6bdc061ac88b4219b368a21cda69bf8d&scope.project.id=24a6ee5bdd3d45a6ba534edc46c08365&role.id=6535f8b98008471dba33e89bd460880d => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:13:07.137084 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:07.224180 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 554/1101] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:13:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 15:13:07.225316 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5c960-8de1-44f8-ac55-3af412f3a9d6 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:07.318475 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:07.331461 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5c960-8de1-44f8-ac55-3af412f3a9d6 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:07.364497 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb33bfa-aa2f-4467-aa6a-567dca06913c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:07.365140 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb33bfa-aa2f-4467-aa6a-567dca06913c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:07.365452 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb33bfa-aa2f-4467-aa6a-567dca06913c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:07.365752 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb33bfa-aa2f-4467-aa6a-567dca06913c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:07.376605 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb33bfa-aa2f-4467-aa6a-567dca06913c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:07.378023 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb33bfa-aa2f-4467-aa6a-567dca06913c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:07.392079 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-bfb33bfa-aa2f-4467-aa6a-567dca06913c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:13:07.392079 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:13:07.392079 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:13:07.392079 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:13:07.392079 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:13:07.392079 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:13:07.392079 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:13:07.392079 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:13:07.392079 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:13:07.392079 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:13:07.392079 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:13:07.392079 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:13:07.392079 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:13:07.392079 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:13:07.392079 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:13:07.393135 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:13:07.393135 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:13:07.393135 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:13:07.393135 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:13:07.393135 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:13:07.393135 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:13:07.393135 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:13:07.393135 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:13:07.393135 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:13:07.393135 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:13:07.393135 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:13:07.393135 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:13:07.393135 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:13:07.393135 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:13:07.393135 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:13:07.393135 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:13:07.393135 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:13:07.394056 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:13:07.394056 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:13:07.394056 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:13:07.394056 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:13:07.394056 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 548/1102] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:13:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:13:07.399626 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878951d6-75ae-42eb-b98f-cfe0bee0be83 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:07.498592 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878951d6-75ae-42eb-b98f-cfe0bee0be83 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:07.521341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:07.532899 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883ad98-822e-4ad6-bec9-799ecd25cdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:07.533506 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883ad98-822e-4ad6-bec9-799ecd25cdab None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:07.533782 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883ad98-822e-4ad6-bec9-799ecd25cdab None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:07.534051 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d883ad98-822e-4ad6-bec9-799ecd25cdab None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:07.534731 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d883ad98-822e-4ad6-bec9-799ecd25cdab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:13:07.535030 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d883ad98-822e-4ad6-bec9-799ecd25cdab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:07.536605 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d883ad98-822e-4ad6-bec9-799ecd25cdab None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:07.547638 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 555/1103] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:07.553262 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb33bfa-aa2f-4467-aa6a-567dca06913c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:07.657148 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb33bfa-aa2f-4467-aa6a-567dca06913c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:07.690650 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5837ac4-b173-4b66-a3ab-a8a0bc310b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:07.691279 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5837ac4-b173-4b66-a3ab-a8a0bc310b29 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:07.691555 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5837ac4-b173-4b66-a3ab-a8a0bc310b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:07.692400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5837ac4-b173-4b66-a3ab-a8a0bc310b29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:07.698828 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5837ac4-b173-4b66-a3ab-a8a0bc310b29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:07.700282 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5837ac4-b173-4b66-a3ab-a8a0bc310b29 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:07.702656 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:07.712068 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-b5837ac4-b173-4b66-a3ab-a8a0bc310b29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:13:07.712068 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:13:07.712068 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:13:07.712068 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:13:07.712068 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:13:07.712068 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:13:07.712068 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:13:07.712068 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:13:07.712068 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:13:07.712068 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:13:07.712068 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:13:07.712068 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:13:07.712068 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:13:07.712068 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:13:07.712068 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:13:07.712949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:13:07.712949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:13:07.712949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:13:07.712949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:13:07.712949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:13:07.712949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:13:07.712949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:13:07.712949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:13:07.712949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:13:07.712949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:13:07.712949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:13:07.712949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:13:07.712949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:13:07.712949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:13:07.712949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:13:07.712949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:13:07.712949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:13:07.713875 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:13:07.713875 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:13:07.713875 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:13:07.713875 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:13:07.713875 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:13:07.713875 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:13:07.713875 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:13:07.713875 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:13:07.713875 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 549/1104] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:13:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:13:07.719117 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883ad98-822e-4ad6-bec9-799ecd25cdab None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:07.815798 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d883ad98-822e-4ad6-bec9-799ecd25cdab None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:07.848608 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8453e6-36f6-49c0-8d92-2eac61111156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:07.849211 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8453e6-36f6-49c0-8d92-2eac61111156 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:07.849488 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8453e6-36f6-49c0-8d92-2eac61111156 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:07.849758 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8453e6-36f6-49c0-8d92-2eac61111156 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:07.850497 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8453e6-36f6-49c0-8d92-2eac61111156 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:13:07.850800 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8453e6-36f6-49c0-8d92-2eac61111156 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:07.852227 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8453e6-36f6-49c0-8d92-2eac61111156 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:07.864633 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 556/1105] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jul 27 15:13:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:07.870719 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5837ac4-b173-4b66-a3ab-a8a0bc310b29 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:07.968192 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5837ac4-b173-4b66-a3ab-a8a0bc310b29 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:08.000581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c12257-d1ad-481d-b135-287bea1d6921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:08.001221 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c12257-d1ad-481d-b135-287bea1d6921 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:08.001506 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c12257-d1ad-481d-b135-287bea1d6921 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:08.001782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c12257-d1ad-481d-b135-287bea1d6921 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:08.002569 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c12257-d1ad-481d-b135-287bea1d6921 None admin] RBAC: Adding query filter params (role.id=c0bb546247e847f1a87281d2a3bb21e7, scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5, user.id=d3e01aa0ef1340cbba7170bac4a82783) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:13:08.002880 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c12257-d1ad-481d-b135-287bea1d6921 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:08.004850 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c12257-d1ad-481d-b135-287bea1d6921 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:08.010620 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 550/1106] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:13:07 2022] GET /identity/v3/role_assignments?user.id=d3e01aa0ef1340cbba7170bac4a82783&scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5&role.id=c0bb546247e847f1a87281d2a3bb21e7 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:09.179261 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a328c4-1715-48b8-ad6b-98285046c183 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:09.179822 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a328c4-1715-48b8-ad6b-98285046c183 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:09.179822 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a328c4-1715-48b8-ad6b-98285046c183 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:09.181175 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 557/1107] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:13:09.186229 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac23b1-1058-4210-bf71-8e73a5b73a2c None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:09.186620 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac23b1-1058-4210-bf71-8e73a5b73a2c None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:09.186789 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac23b1-1058-4210-bf71-8e73a5b73a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:09.204449 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-2cac23b1-1058-4210-bf71-8e73a5b73a2c None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:13:09.205628 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-2cac23b1-1058-4210-bf71-8e73a5b73a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:13:09.262633 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:09.271905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 551/1108] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:13:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:13:09.296834 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a328c4-1715-48b8-ad6b-98285046c183 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:09.346007 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:09.402391 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a328c4-1715-48b8-ad6b-98285046c183 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:09.435637 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e6cf0-0897-4608-8099-e7f06ee80ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:09.436219 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e6cf0-0897-4608-8099-e7f06ee80ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:09.436496 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e6cf0-0897-4608-8099-e7f06ee80ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:09.436765 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e6cf0-0897-4608-8099-e7f06ee80ec8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:09.437889 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e6cf0-0897-4608-8099-e7f06ee80ec8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:09.439300 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e6cf0-0897-4608-8099-e7f06ee80ec8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:09.440874 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 558/1109] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:13:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:09.446655 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac23b1-1058-4210-bf71-8e73a5b73a2c None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:09.541485 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac23b1-1058-4210-bf71-8e73a5b73a2c None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:09.574991 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a21437b-550f-4e70-be01-5a00dbd9fa9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:09.575623 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21437b-550f-4e70-be01-5a00dbd9fa9a None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:09.575909 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21437b-550f-4e70-be01-5a00dbd9fa9a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:09.576225 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a21437b-550f-4e70-be01-5a00dbd9fa9a None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:09.576919 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21437b-550f-4e70-be01-5a00dbd9fa9a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:09.578355 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a21437b-550f-4e70-be01-5a00dbd9fa9a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:09.599311 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 552/1110] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Jul 27 15:13:09 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:13:11.646498 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53a7b3-fbdb-4bd0-b7c1-101b48e51c03 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:11.647011 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53a7b3-fbdb-4bd0-b7c1-101b48e51c03 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:11.647011 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53a7b3-fbdb-4bd0-b7c1-101b48e51c03 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:11.648399 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 559/1111] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:13:11.653671 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce198b-0539-4b5c-b1d7-91b20a6b9e84 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:11.654107 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce198b-0539-4b5c-b1d7-91b20a6b9e84 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:11.654214 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce198b-0539-4b5c-b1d7-91b20a6b9e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:11.672672 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-94ce198b-0539-4b5c-b1d7-91b20a6b9e84 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:13:11.673844 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-94ce198b-0539-4b5c-b1d7-91b20a6b9e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:13:11.718037 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:11.739736 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 553/1112] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:13:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:13:11.762044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53a7b3-fbdb-4bd0-b7c1-101b48e51c03 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:11.860843 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53a7b3-fbdb-4bd0-b7c1-101b48e51c03 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:11.870937 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:11.894481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c552312-67d6-44e7-af26-a00c0ca95094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:11.895651 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c552312-67d6-44e7-af26-a00c0ca95094 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:11.895929 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c552312-67d6-44e7-af26-a00c0ca95094 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:11.896229 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c552312-67d6-44e7-af26-a00c0ca95094 None admin] PATH_INFO: `/v3/roles/ce7d7a296f4e448dbb11ded292818043` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:11.897674 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c552312-67d6-44e7-af26-a00c0ca95094 None admin] RBAC: Authorizing `identity:get_role(role_id=ce7d7a296f4e448dbb11ded292818043)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:11.899027 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c552312-67d6-44e7-af26-a00c0ca95094 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:11.900379 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 560/1113] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:13:11 2022] GET /identity/v3/roles/ce7d7a296f4e448dbb11ded292818043 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:11.905907 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce198b-0539-4b5c-b1d7-91b20a6b9e84 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:12.001502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce198b-0539-4b5c-b1d7-91b20a6b9e84 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:12.034964 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf03b71-c1e5-4909-96cb-fe003eb36c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:12.035598 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf03b71-c1e5-4909-96cb-fe003eb36c94 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:12.035873 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf03b71-c1e5-4909-96cb-fe003eb36c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:12.036178 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf03b71-c1e5-4909-96cb-fe003eb36c94 None admin] PATH_INFO: `/v3/users/b79238ab41b642b68e880c046ec9b81e` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:12.048779 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf03b71-c1e5-4909-96cb-fe003eb36c94 None admin] RBAC: Authorizing `identity:get_user(user_id=b79238ab41b642b68e880c046ec9b81e)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:12.050186 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf03b71-c1e5-4909-96cb-fe003eb36c94 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:12.051784 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 554/1114] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:13:11 2022] GET /identity/v3/users/b79238ab41b642b68e880c046ec9b81e => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:12.057264 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c552312-67d6-44e7-af26-a00c0ca95094 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:12.154605 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c552312-67d6-44e7-af26-a00c0ca95094 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:12.189890 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e81b5-78f5-4456-9690-e6fb84ddf62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:12.190504 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e81b5-78f5-4456-9690-e6fb84ddf62b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:12.190783 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e81b5-78f5-4456-9690-e6fb84ddf62b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:12.191057 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65e81b5-78f5-4456-9690-e6fb84ddf62b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:12.234415 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:12.256565 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e81b5-78f5-4456-9690-e6fb84ddf62b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:12.257988 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65e81b5-78f5-4456-9690-e6fb84ddf62b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:12.353380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 561/1115] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:13:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 15:13:12.359287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf03b71-c1e5-4909-96cb-fe003eb36c94 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:12.398796 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:12.457074 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf03b71-c1e5-4909-96cb-fe003eb36c94 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:12.490441 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b59151-69c4-4732-b292-aafac8414a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:12.491066 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b59151-69c4-4732-b292-aafac8414a6e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:12.491350 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b59151-69c4-4732-b292-aafac8414a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:12.491622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b59151-69c4-4732-b292-aafac8414a6e None admin] PATH_INFO: `/v3/projects/24a6ee5bdd3d45a6ba534edc46c08365` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:12.492806 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b59151-69c4-4732-b292-aafac8414a6e None admin] RBAC: Authorizing `identity:get_project(project_id=24a6ee5bdd3d45a6ba534edc46c08365)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:12.494310 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b59151-69c4-4732-b292-aafac8414a6e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:12.496198 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 555/1116] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:13:12 2022] GET /identity/v3/projects/24a6ee5bdd3d45a6ba534edc46c08365 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:12.502269 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e81b5-78f5-4456-9690-e6fb84ddf62b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:12.578136 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:12.599862 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65e81b5-78f5-4456-9690-e6fb84ddf62b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:12.632931 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd26db-273b-49cd-aefb-82c435e4919b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:12.633525 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd26db-273b-49cd-aefb-82c435e4919b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:12.633805 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd26db-273b-49cd-aefb-82c435e4919b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:12.634075 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd26db-273b-49cd-aefb-82c435e4919b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:12.634942 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd26db-273b-49cd-aefb-82c435e4919b None admin] RBAC: Adding query filter params (role.id=ce7d7a296f4e448dbb11ded292818043, scope.project.id=24a6ee5bdd3d45a6ba534edc46c08365, user.id=b79238ab41b642b68e880c046ec9b81e) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:13:12.635243 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd26db-273b-49cd-aefb-82c435e4919b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:12.636751 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fd26db-273b-49cd-aefb-82c435e4919b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:12.642670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 562/1117] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:13:12 2022] GET /identity/v3/role_assignments?user.id=b79238ab41b642b68e880c046ec9b81e&scope.project.id=24a6ee5bdd3d45a6ba534edc46c08365&role.id=ce7d7a296f4e448dbb11ded292818043 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:14.580344 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0312e-225b-4095-9030-84f61ce579f4 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:14.580887 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0312e-225b-4095-9030-84f61ce579f4 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:14.580887 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e0312e-225b-4095-9030-84f61ce579f4 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:14.582242 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 556/1118] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:13:14.587626 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173d7d3-33cf-4840-8acc-dc3dcaa1848a None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:14.588114 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173d7d3-33cf-4840-8acc-dc3dcaa1848a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:14.588215 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9173d7d3-33cf-4840-8acc-dc3dcaa1848a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:14.606122 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9173d7d3-33cf-4840-8acc-dc3dcaa1848a None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:13:14.607305 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9173d7d3-33cf-4840-8acc-dc3dcaa1848a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:13:14.672548 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 563/1119] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:13:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:13:14.696324 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0312e-225b-4095-9030-84f61ce579f4 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:14.809334 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e0312e-225b-4095-9030-84f61ce579f4 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:14.816435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:14.842858 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffe8cc-259d-40b2-877d-710fe0d43f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:14.843418 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffe8cc-259d-40b2-877d-710fe0d43f8a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:14.843697 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffe8cc-259d-40b2-877d-710fe0d43f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:14.843966 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ffe8cc-259d-40b2-877d-710fe0d43f8a None admin] PATH_INFO: `/v3/roles/ce7d7a296f4e448dbb11ded292818043` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:14.845399 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ffe8cc-259d-40b2-877d-710fe0d43f8a None admin] RBAC: Authorizing `identity:get_role(role_id=ce7d7a296f4e448dbb11ded292818043)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:14.846749 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ffe8cc-259d-40b2-877d-710fe0d43f8a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:14.848614 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 557/1120] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:13:14 2022] GET /identity/v3/roles/ce7d7a296f4e448dbb11ded292818043 => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:14.854738 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173d7d3-33cf-4840-8acc-dc3dcaa1848a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:14.921715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:14.950274 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9173d7d3-33cf-4840-8acc-dc3dcaa1848a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:14.982840 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab07cd4-52c9-4464-8c01-889832e115b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:14.983453 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab07cd4-52c9-4464-8c01-889832e115b2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:14.983734 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab07cd4-52c9-4464-8c01-889832e115b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:14.984027 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab07cd4-52c9-4464-8c01-889832e115b2 None admin] PATH_INFO: `/v3/users/b79238ab41b642b68e880c046ec9b81e` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:14.985173 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab07cd4-52c9-4464-8c01-889832e115b2 None admin] RBAC: Authorizing `identity:get_user(user_id=b79238ab41b642b68e880c046ec9b81e)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:14.986587 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab07cd4-52c9-4464-8c01-889832e115b2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:14.988166 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 564/1121] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:13:14 2022] GET /identity/v3/users/b79238ab41b642b68e880c046ec9b81e => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:14.994485 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffe8cc-259d-40b2-877d-710fe0d43f8a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:15.105127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ffe8cc-259d-40b2-877d-710fe0d43f8a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:15.137929 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83330471-c5ef-4d5c-807f-4c7d64804e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:15.138559 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83330471-c5ef-4d5c-807f-4c7d64804e83 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:15.138842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83330471-c5ef-4d5c-807f-4c7d64804e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:15.139117 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83330471-c5ef-4d5c-807f-4c7d64804e83 None admin] PATH_INFO: `/v3/projects/24a6ee5bdd3d45a6ba534edc46c08365` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:15.140282 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83330471-c5ef-4d5c-807f-4c7d64804e83 None admin] RBAC: Authorizing `identity:get_project(project_id=24a6ee5bdd3d45a6ba534edc46c08365)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:15.142307 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83330471-c5ef-4d5c-807f-4c7d64804e83 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:15.143973 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 558/1122] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:13:14 2022] GET /identity/v3/projects/24a6ee5bdd3d45a6ba534edc46c08365 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:15.149918 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab07cd4-52c9-4464-8c01-889832e115b2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:15.247235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab07cd4-52c9-4464-8c01-889832e115b2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:15.280852 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb90d1-438a-43b4-9677-5e905aa733e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:15.281496 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb90d1-438a-43b4-9677-5e905aa733e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:15.281778 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb90d1-438a-43b4-9677-5e905aa733e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:15.282052 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb90d1-438a-43b4-9677-5e905aa733e8 None admin] PATH_INFO: `/v3/projects/24a6ee5bdd3d45a6ba534edc46c08365/users/b79238ab41b642b68e880c046ec9b81e/roles/ce7d7a296f4e448dbb11ded292818043` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:15.284259 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb90d1-438a-43b4-9677-5e905aa733e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=24a6ee5bdd3d45a6ba534edc46c08365, user_id=b79238ab41b642b68e880c046ec9b81e, role_id=ce7d7a296f4e448dbb11ded292818043)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:15.286339 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb90d1-438a-43b4-9677-5e905aa733e8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:15.295077 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:15.299857 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 565/1123] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jul 27 15:13:15 2022] PUT /identity/v3/projects/24a6ee5bdd3d45a6ba534edc46c08365/users/b79238ab41b642b68e880c046ec9b81e/roles/ce7d7a296f4e448dbb11ded292818043 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:13:17.269706 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa29ef9-78b9-4cde-ab65-2c7c9061a5ca None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:17.270255 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa29ef9-78b9-4cde-ab65-2c7c9061a5ca None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:17.270255 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa29ef9-78b9-4cde-ab65-2c7c9061a5ca None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:17.271595 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 559/1124] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:13:17.276730 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed397a26-1810-4e0f-898b-033c596cda29 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:17.277122 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed397a26-1810-4e0f-898b-033c596cda29 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:17.277290 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed397a26-1810-4e0f-898b-033c596cda29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:17.296025 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-ed397a26-1810-4e0f-898b-033c596cda29 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:13:17.297203 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ed397a26-1810-4e0f-898b-033c596cda29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:13:17.361003 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 566/1125] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:13:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:13:17.383781 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa29ef9-78b9-4cde-ab65-2c7c9061a5ca None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:17.426774 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:17.481117 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa29ef9-78b9-4cde-ab65-2c7c9061a5ca None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:17.513119 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df293e-e38b-4bb7-bfa0-0f411aca613e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:17.513738 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df293e-e38b-4bb7-bfa0-0f411aca613e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:17.514020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df293e-e38b-4bb7-bfa0-0f411aca613e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:17.514296 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df293e-e38b-4bb7-bfa0-0f411aca613e None admin] PATH_INFO: `/v3/roles/ce7d7a296f4e448dbb11ded292818043` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:17.515711 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df293e-e38b-4bb7-bfa0-0f411aca613e None admin] RBAC: Authorizing `identity:get_role(role_id=ce7d7a296f4e448dbb11ded292818043)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:17.517095 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54df293e-e38b-4bb7-bfa0-0f411aca613e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:17.518423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 560/1126] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:13:17 2022] GET /identity/v3/roles/ce7d7a296f4e448dbb11ded292818043 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:17.524623 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed397a26-1810-4e0f-898b-033c596cda29 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:17.621168 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed397a26-1810-4e0f-898b-033c596cda29 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:17.649591 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:17.655838 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2cac7-06f9-4c4d-931c-e2a0bf67a556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:17.656493 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2cac7-06f9-4c4d-931c-e2a0bf67a556 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:17.656772 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2cac7-06f9-4c4d-931c-e2a0bf67a556 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:17.657042 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf2cac7-06f9-4c4d-931c-e2a0bf67a556 None admin] PATH_INFO: `/v3/users/b79238ab41b642b68e880c046ec9b81e` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:17.658181 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2cac7-06f9-4c4d-931c-e2a0bf67a556 None admin] RBAC: Authorizing `identity:get_user(user_id=b79238ab41b642b68e880c046ec9b81e)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:17.659580 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf2cac7-06f9-4c4d-931c-e2a0bf67a556 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:17.661210 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 567/1127] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:13:17 2022] GET /identity/v3/users/b79238ab41b642b68e880c046ec9b81e => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:17.667209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df293e-e38b-4bb7-bfa0-0f411aca613e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:17.763586 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df293e-e38b-4bb7-bfa0-0f411aca613e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:17.773355 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:17.796072 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208063d-8f40-4643-8c0d-c87aa602740d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:17.796627 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208063d-8f40-4643-8c0d-c87aa602740d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:17.796906 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208063d-8f40-4643-8c0d-c87aa602740d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:17.797179 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5208063d-8f40-4643-8c0d-c87aa602740d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:17.862815 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208063d-8f40-4643-8c0d-c87aa602740d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:17.864821 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5208063d-8f40-4643-8c0d-c87aa602740d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:17.959159 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 561/1128] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:13:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 15:13:17.964946 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2cac7-06f9-4c4d-931c-e2a0bf67a556 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:18.060809 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf2cac7-06f9-4c4d-931c-e2a0bf67a556 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:18.094230 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9dcba9-f166-4884-82c6-2eb130ce993f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:18.094840 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dcba9-f166-4884-82c6-2eb130ce993f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:18.095121 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dcba9-f166-4884-82c6-2eb130ce993f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:18.095390 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9dcba9-f166-4884-82c6-2eb130ce993f None admin] PATH_INFO: `/v3/projects/24a6ee5bdd3d45a6ba534edc46c08365` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:18.096557 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9dcba9-f166-4884-82c6-2eb130ce993f None admin] RBAC: Authorizing `identity:get_project(project_id=24a6ee5bdd3d45a6ba534edc46c08365)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:18.097985 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9dcba9-f166-4884-82c6-2eb130ce993f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:18.099583 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 568/1129] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:13:17 2022] GET /identity/v3/projects/24a6ee5bdd3d45a6ba534edc46c08365 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:18.105309 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208063d-8f40-4643-8c0d-c87aa602740d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:18.116517 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:18.201833 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5208063d-8f40-4643-8c0d-c87aa602740d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:18.233705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52353488-9b15-47c8-b121-6251838692cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:18.234304 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52353488-9b15-47c8-b121-6251838692cf None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:18.234585 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52353488-9b15-47c8-b121-6251838692cf None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:18.234857 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52353488-9b15-47c8-b121-6251838692cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:18.235633 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52353488-9b15-47c8-b121-6251838692cf None admin] RBAC: Adding query filter params (role.id=ce7d7a296f4e448dbb11ded292818043, scope.project.id=24a6ee5bdd3d45a6ba534edc46c08365, user.id=b79238ab41b642b68e880c046ec9b81e) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:13:18.235943 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52353488-9b15-47c8-b121-6251838692cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:18.237372 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52353488-9b15-47c8-b121-6251838692cf None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:18.243458 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 562/1130] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:13:18 2022] GET /identity/v3/role_assignments?user.id=b79238ab41b642b68e880c046ec9b81e&scope.project.id=24a6ee5bdd3d45a6ba534edc46c08365&role.id=ce7d7a296f4e448dbb11ded292818043 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:20.257018 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b852a3-23fd-4b09-b593-4623325248a3 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:20.257607 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b852a3-23fd-4b09-b593-4623325248a3 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:20.257607 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b852a3-23fd-4b09-b593-4623325248a3 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:20.258877 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 569/1131] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:13:20.264354 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7d4e6-af7b-4b31-b828-05cebb0c203c None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:20.264768 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7d4e6-af7b-4b31-b828-05cebb0c203c None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:20.264913 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7d4e6-af7b-4b31-b828-05cebb0c203c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:20.282428 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-e2a7d4e6-af7b-4b31-b828-05cebb0c203c None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:13:20.283656 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e2a7d4e6-af7b-4b31-b828-05cebb0c203c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:13:20.350978 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 563/1132] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:13:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:13:20.373550 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b852a3-23fd-4b09-b593-4623325248a3 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:20.438480 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:20.473099 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b852a3-23fd-4b09-b593-4623325248a3 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:20.505800 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5a50ef-6d26-4e6c-a473-16e4867b54f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:20.506412 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a50ef-6d26-4e6c-a473-16e4867b54f2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:20.506689 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a50ef-6d26-4e6c-a473-16e4867b54f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:20.506955 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5a50ef-6d26-4e6c-a473-16e4867b54f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:20.508156 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a50ef-6d26-4e6c-a473-16e4867b54f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:20.509507 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5a50ef-6d26-4e6c-a473-16e4867b54f2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:20.511061 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 570/1133] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:13:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:20.517077 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7d4e6-af7b-4b31-b828-05cebb0c203c None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:20.520225 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:20.611843 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7d4e6-af7b-4b31-b828-05cebb0c203c None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:20.644835 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8b785-4eaf-4ba5-917f-9157cf59e662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:20.645444 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8b785-4eaf-4ba5-917f-9157cf59e662 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:20.645728 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8b785-4eaf-4ba5-917f-9157cf59e662 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:20.646005 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8b785-4eaf-4ba5-917f-9157cf59e662 None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:20.646692 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8b785-4eaf-4ba5-917f-9157cf59e662 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:20.648142 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8b785-4eaf-4ba5-917f-9157cf59e662 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:20.674258 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 564/1134] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Jul 27 15:13:20 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:13:22.670205 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc8d2b-16d2-4624-9738-ae1cd9a927a9 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:22.670706 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc8d2b-16d2-4624-9738-ae1cd9a927a9 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:22.670819 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc8d2b-16d2-4624-9738-ae1cd9a927a9 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:22.672111 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 571/1135] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:13:22.677818 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393a13c-83f2-4fa8-900f-e5d8fe01a261 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:22.678253 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393a13c-83f2-4fa8-900f-e5d8fe01a261 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:22.678355 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393a13c-83f2-4fa8-900f-e5d8fe01a261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:22.695918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-f393a13c-83f2-4fa8-900f-e5d8fe01a261 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:13:22.697125 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f393a13c-83f2-4fa8-900f-e5d8fe01a261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:13:22.746568 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:22.763209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 565/1136] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:13:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:13:22.788264 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc8d2b-16d2-4624-9738-ae1cd9a927a9 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:22.907571 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc8d2b-16d2-4624-9738-ae1cd9a927a9 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:22.940543 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c31b6c-afbe-44fa-8e79-d46fd11d4bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:22.941164 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c31b6c-afbe-44fa-8e79-d46fd11d4bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:22.941448 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c31b6c-afbe-44fa-8e79-d46fd11d4bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:22.941728 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c31b6c-afbe-44fa-8e79-d46fd11d4bc8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:22.942880 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c31b6c-afbe-44fa-8e79-d46fd11d4bc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:22.944333 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c31b6c-afbe-44fa-8e79-d46fd11d4bc8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:22.945907 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 572/1137] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:13:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:22.951954 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393a13c-83f2-4fa8-900f-e5d8fe01a261 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:23.048172 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393a13c-83f2-4fa8-900f-e5d8fe01a261 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:23.080668 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b0cca-d44a-450e-afe1-2f35a0a3e8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:23.081262 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b0cca-d44a-450e-afe1-2f35a0a3e8ea None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:23.081544 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b0cca-d44a-450e-afe1-2f35a0a3e8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:23.082410 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b0cca-d44a-450e-afe1-2f35a0a3e8ea None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:23.083085 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b0cca-d44a-450e-afe1-2f35a0a3e8ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:23.084525 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b0cca-d44a-450e-afe1-2f35a0a3e8ea None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:23.104534 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 566/1138] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Jul 27 15:13:22 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:13:25.130448 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f20b8-4dbf-4e95-928b-90290cb72a4b None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:25.130966 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f20b8-4dbf-4e95-928b-90290cb72a4b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:25.131090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f20b8-4dbf-4e95-928b-90290cb72a4b None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:25.132377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 573/1139] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:13:25.137451 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbe17f-d217-4ffc-8baf-e37d1fc99e23 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:25.137834 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbe17f-d217-4ffc-8baf-e37d1fc99e23 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:25.138054 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbe17f-d217-4ffc-8baf-e37d1fc99e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:25.156155 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-0ebbe17f-d217-4ffc-8baf-e37d1fc99e23 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:13:25.157342 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-0ebbe17f-d217-4ffc-8baf-e37d1fc99e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:13:25.191673 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:25.225032 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 567/1140] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:13:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:13:25.247782 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f20b8-4dbf-4e95-928b-90290cb72a4b None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:25.250640 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:25.347448 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f20b8-4dbf-4e95-928b-90290cb72a4b None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:25.380680 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f8fe6-c991-4318-bbd2-e75aa1c54689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:25.381236 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f8fe6-c991-4318-bbd2-e75aa1c54689 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:25.381518 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f8fe6-c991-4318-bbd2-e75aa1c54689 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:25.381790 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f8fe6-c991-4318-bbd2-e75aa1c54689 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:25.391460 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f8fe6-c991-4318-bbd2-e75aa1c54689 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:13:25.396906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-f77f8fe6-c991-4318-bbd2-e75aa1c54689 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:13:25.396906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:13:25.396906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:13:25.396906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:13:25.396906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:13:25.396906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:13:25.396906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:13:25.396906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:13:25.396906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:13:25.396906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:13:25.396906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:13:25.396906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:13:25.396906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:13:25.396906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:13:25.396906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:13:25.396906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:13:25.398090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:13:25.398090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:13:25.398090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:13:25.398090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:13:25.398090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:13:25.398090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:13:25.398090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:13:25.398090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:13:25.398090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:13:25.398090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:13:25.398090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:13:25.398090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:13:25.398090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:13:25.398090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:13:25.398090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:13:25.398090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:13:25.399212 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:13:25.399212 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:13:25.399212 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:13:25.399212 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:13:25.399212 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:13:25.399212 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:13:25.399212 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:13:25.399212 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:13:25.399212 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:13:25.399212 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:13:25.399212 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:13:25.399212 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:13:25.399212 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 574/1141] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jul 27 15:13:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:13:25.406083 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbe17f-d217-4ffc-8baf-e37d1fc99e23 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:25.505205 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbe17f-d217-4ffc-8baf-e37d1fc99e23 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:25.537422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffceaa3-997b-422c-9873-1d67aac1591f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:25.538025 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffceaa3-997b-422c-9873-1d67aac1591f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:25.538303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffceaa3-997b-422c-9873-1d67aac1591f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:25.538573 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffceaa3-997b-422c-9873-1d67aac1591f None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:25.539541 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffceaa3-997b-422c-9873-1d67aac1591f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:13:25.539849 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffceaa3-997b-422c-9873-1d67aac1591f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:25.541226 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffceaa3-997b-422c-9873-1d67aac1591f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:25.548875 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 568/1142] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:13:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:25.554662 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f8fe6-c991-4318-bbd2-e75aa1c54689 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:25.614581 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:25.653157 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f8fe6-c991-4318-bbd2-e75aa1c54689 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:25.685657 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059153a4-8295-4095-85ce-ff1e8d604934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:25.686273 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059153a4-8295-4095-85ce-ff1e8d604934 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:25.686555 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059153a4-8295-4095-85ce-ff1e8d604934 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:25.686827 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059153a4-8295-4095-85ce-ff1e8d604934 None admin] PATH_INFO: `/v3/users/690b17b205fb43f390aeca4e5ca4ce5a` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:25.699914 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059153a4-8295-4095-85ce-ff1e8d604934 None admin] RBAC: Authorizing `identity:get_user(user_id=690b17b205fb43f390aeca4e5ca4ce5a)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:25.701417 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059153a4-8295-4095-85ce-ff1e8d604934 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:25.703000 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 575/1143] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:13:25 2022] GET /identity/v3/users/690b17b205fb43f390aeca4e5ca4ce5a => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:25.708890 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffceaa3-997b-422c-9873-1d67aac1591f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:25.745531 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:25.810158 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffceaa3-997b-422c-9873-1d67aac1591f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:25.842357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08232422-c730-4222-8c2b-5bbc0cc4de3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:25.842966 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08232422-c730-4222-8c2b-5bbc0cc4de3a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:25.843249 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08232422-c730-4222-8c2b-5bbc0cc4de3a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:25.843524 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08232422-c730-4222-8c2b-5bbc0cc4de3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:25.908069 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08232422-c730-4222-8c2b-5bbc0cc4de3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:25.909464 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08232422-c730-4222-8c2b-5bbc0cc4de3a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:25.940968 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:26.005419 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 569/1144] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:13:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 15:13:26.011245 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059153a4-8295-4095-85ce-ff1e8d604934 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:26.106571 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059153a4-8295-4095-85ce-ff1e8d604934 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:26.126130 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:26.140006 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8fb5a-c894-48f2-baf5-e7acfc1bb165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:26.140642 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8fb5a-c894-48f2-baf5-e7acfc1bb165 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:26.140923 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8fb5a-c894-48f2-baf5-e7acfc1bb165 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:26.141196 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8fb5a-c894-48f2-baf5-e7acfc1bb165 None admin] PATH_INFO: `/v3/projects/82a12f96e5004588840e8db69f0d7c9d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:26.142342 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8fb5a-c894-48f2-baf5-e7acfc1bb165 None admin] RBAC: Authorizing `identity:get_project(project_id=82a12f96e5004588840e8db69f0d7c9d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:26.143745 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8fb5a-c894-48f2-baf5-e7acfc1bb165 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:26.145422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 576/1145] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:13:26 2022] GET /identity/v3/projects/82a12f96e5004588840e8db69f0d7c9d => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:26.151335 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08232422-c730-4222-8c2b-5bbc0cc4de3a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:26.249454 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08232422-c730-4222-8c2b-5bbc0cc4de3a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:26.282221 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4912ddf-a665-48d3-b8a3-6573382034e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:26.282826 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4912ddf-a665-48d3-b8a3-6573382034e5 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:26.283107 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4912ddf-a665-48d3-b8a3-6573382034e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:26.283380 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4912ddf-a665-48d3-b8a3-6573382034e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:26.284188 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4912ddf-a665-48d3-b8a3-6573382034e5 None admin] RBAC: Adding query filter params (role.id=6535f8b98008471dba33e89bd460880d, scope.project.id=82a12f96e5004588840e8db69f0d7c9d, user.id=690b17b205fb43f390aeca4e5ca4ce5a) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:13:26.284499 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4912ddf-a665-48d3-b8a3-6573382034e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:26.286450 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4912ddf-a665-48d3-b8a3-6573382034e5 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:26.288234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:26.293138 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 570/1146] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:13:26 2022] GET /identity/v3/role_assignments?user.id=690b17b205fb43f390aeca4e5ca4ce5a&scope.project.id=82a12f96e5004588840e8db69f0d7c9d&role.id=6535f8b98008471dba33e89bd460880d => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:28.250363 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42a4d4-1d7a-4de2-9b1c-b2dfcafc1144 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:28.250926 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42a4d4-1d7a-4de2-9b1c-b2dfcafc1144 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:28.250926 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b42a4d4-1d7a-4de2-9b1c-b2dfcafc1144 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:28.252279 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 577/1147] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:13:28.257923 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0192fd-79ce-45d2-a1b4-9b254a175154 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:28.258336 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0192fd-79ce-45d2-a1b4-9b254a175154 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:28.258468 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0192fd-79ce-45d2-a1b4-9b254a175154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:28.277174 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-dc0192fd-79ce-45d2-a1b4-9b254a175154 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:13:28.278360 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-dc0192fd-79ce-45d2-a1b4-9b254a175154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:13:28.345123 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 571/1148] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:13:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 15:13:28.368099 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42a4d4-1d7a-4de2-9b1c-b2dfcafc1144 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:28.476892 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b42a4d4-1d7a-4de2-9b1c-b2dfcafc1144 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:28.509860 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd1656-7fc0-4285-a028-9771d84bd662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:28.510428 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd1656-7fc0-4285-a028-9771d84bd662 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:28.510709 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd1656-7fc0-4285-a028-9771d84bd662 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:28.510986 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cd1656-7fc0-4285-a028-9771d84bd662 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:28.520972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cd1656-7fc0-4285-a028-9771d84bd662 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:13:28.525838 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-b1cd1656-7fc0-4285-a028-9771d84bd662 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:13:28.525838 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:13:28.525838 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:13:28.525838 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:13:28.525838 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:13:28.525838 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:13:28.525838 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:13:28.525838 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:13:28.525838 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:13:28.525838 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:13:28.525838 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:13:28.525838 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:13:28.525838 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:13:28.525838 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:13:28.525838 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:13:28.525838 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:13:28.526939 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:13:28.526939 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:13:28.526939 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:13:28.526939 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:13:28.526939 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:13:28.526939 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:13:28.526939 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:13:28.526939 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:13:28.526939 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:13:28.526939 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:13:28.526939 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:13:28.526939 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:13:28.526939 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:13:28.526939 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:13:28.526939 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:13:28.526939 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:13:28.527829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:13:28.527829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:13:28.527829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:13:28.527829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:13:28.527829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:13:28.527829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:13:28.527829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:13:28.527829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:13:28.527829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:13:28.527829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:13:28.527829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:13:28.527829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:13:28.527829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 578/1149] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jul 27 15:13:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:13:28.533091 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0192fd-79ce-45d2-a1b4-9b254a175154 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:28.630119 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0192fd-79ce-45d2-a1b4-9b254a175154 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:28.655087 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:28.663262 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ee160-b54e-4177-bf24-93b43676a4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:28.664166 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ee160-b54e-4177-bf24-93b43676a4e0 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:28.664451 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ee160-b54e-4177-bf24-93b43676a4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:28.664727 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ee160-b54e-4177-bf24-93b43676a4e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:28.665440 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ee160-b54e-4177-bf24-93b43676a4e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:13:28.665748 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ee160-b54e-4177-bf24-93b43676a4e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:28.667104 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ee160-b54e-4177-bf24-93b43676a4e0 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:28.674917 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 572/1150] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:13:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:28.681292 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd1656-7fc0-4285-a028-9771d84bd662 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:28.729456 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:28.779216 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cd1656-7fc0-4285-a028-9771d84bd662 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:28.812392 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad402706-4752-4256-96fc-90ee5dd24401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:28.813022 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad402706-4752-4256-96fc-90ee5dd24401 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:28.813302 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad402706-4752-4256-96fc-90ee5dd24401 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:28.813573 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad402706-4752-4256-96fc-90ee5dd24401 None admin] PATH_INFO: `/v3/users/690b17b205fb43f390aeca4e5ca4ce5a` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:28.814725 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad402706-4752-4256-96fc-90ee5dd24401 None admin] RBAC: Authorizing `identity:get_user(user_id=690b17b205fb43f390aeca4e5ca4ce5a)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:28.816206 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad402706-4752-4256-96fc-90ee5dd24401 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:28.817787 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 579/1151] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:13:28 2022] GET /identity/v3/users/690b17b205fb43f390aeca4e5ca4ce5a => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:28.823680 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ee160-b54e-4177-bf24-93b43676a4e0 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:28.919517 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ee160-b54e-4177-bf24-93b43676a4e0 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:28.951036 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ecbd1-5d84-435a-a2a8-4dd9d13fe836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:28.951652 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ecbd1-5d84-435a-a2a8-4dd9d13fe836 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:28.951928 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ecbd1-5d84-435a-a2a8-4dd9d13fe836 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:28.952223 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ecbd1-5d84-435a-a2a8-4dd9d13fe836 None admin] PATH_INFO: `/v3/projects/82a12f96e5004588840e8db69f0d7c9d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:28.953341 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ecbd1-5d84-435a-a2a8-4dd9d13fe836 None admin] RBAC: Authorizing `identity:get_project(project_id=82a12f96e5004588840e8db69f0d7c9d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:28.954743 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ecbd1-5d84-435a-a2a8-4dd9d13fe836 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:28.956407 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 573/1152] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:13:28 2022] GET /identity/v3/projects/82a12f96e5004588840e8db69f0d7c9d => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:28.962542 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad402706-4752-4256-96fc-90ee5dd24401 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:29.057854 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad402706-4752-4256-96fc-90ee5dd24401 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:29.074464 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:29.091856 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd61f6-a4f6-4bb9-8d64-1bc19bc6c590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:29.092528 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd61f6-a4f6-4bb9-8d64-1bc19bc6c590 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:29.092808 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd61f6-a4f6-4bb9-8d64-1bc19bc6c590 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:29.093082 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd61f6-a4f6-4bb9-8d64-1bc19bc6c590 None admin] PATH_INFO: `/v3/projects/82a12f96e5004588840e8db69f0d7c9d/users/690b17b205fb43f390aeca4e5ca4ce5a/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:29.095010 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd61f6-a4f6-4bb9-8d64-1bc19bc6c590 None admin] RBAC: Authorizing `identity:create_grant(project_id=82a12f96e5004588840e8db69f0d7c9d, user_id=690b17b205fb43f390aeca4e5ca4ce5a, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:29.096448 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dd61f6-a4f6-4bb9-8d64-1bc19bc6c590 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:29.109102 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 580/1153] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jul 27 15:13:28 2022] PUT /identity/v3/projects/82a12f96e5004588840e8db69f0d7c9d/users/690b17b205fb43f390aeca4e5ca4ce5a/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:13:31.101026 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b5fa3-1501-4c59-9e73-90f3c6235df3 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:31.101566 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b5fa3-1501-4c59-9e73-90f3c6235df3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:31.101566 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630b5fa3-1501-4c59-9e73-90f3c6235df3 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:31.103015 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 574/1154] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:13:31.108262 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce70cc2-30e9-4273-b8ca-242e663d1f8f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:31.108686 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce70cc2-30e9-4273-b8ca-242e663d1f8f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:31.108813 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce70cc2-30e9-4273-b8ca-242e663d1f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:31.131700 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4ce70cc2-30e9-4273-b8ca-242e663d1f8f None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:13:31.132925 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4ce70cc2-30e9-4273-b8ca-242e663d1f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:13:31.199348 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 581/1155] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:13:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:13:31.223771 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b5fa3-1501-4c59-9e73-90f3c6235df3 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:31.282213 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:31.324842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630b5fa3-1501-4c59-9e73-90f3c6235df3 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:31.357431 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c64f13-3855-404c-a022-e81481402347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:31.357997 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c64f13-3855-404c-a022-e81481402347 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:31.358277 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c64f13-3855-404c-a022-e81481402347 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:31.358549 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c64f13-3855-404c-a022-e81481402347 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:31.368250 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c64f13-3855-404c-a022-e81481402347 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:13:31.373173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-a1c64f13-3855-404c-a022-e81481402347 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:13:31.373173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:13:31.373173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:13:31.373173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:13:31.373173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:13:31.373173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:13:31.373173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:13:31.373173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:13:31.373173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:13:31.373173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:13:31.373173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:13:31.373173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:13:31.373173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:13:31.373173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:13:31.373173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:13:31.373173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:13:31.374254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:13:31.374254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:13:31.374254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:13:31.374254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:13:31.374254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:13:31.374254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:13:31.374254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:13:31.374254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:13:31.374254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:13:31.374254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:13:31.374254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:13:31.374254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:13:31.374254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:13:31.374254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:13:31.374254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:13:31.374254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:13:31.375421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:13:31.375421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:13:31.375421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:13:31.375421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:13:31.375421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:13:31.375421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:13:31.375421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:13:31.375421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:13:31.375421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:13:31.375421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:13:31.375421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:13:31.375421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:13:31.375421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 575/1156] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jul 27 15:13:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:13:31.380847 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce70cc2-30e9-4273-b8ca-242e663d1f8f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:31.476600 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce70cc2-30e9-4273-b8ca-242e663d1f8f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:31.483576 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:31.511225 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7acbd-0be8-43c1-8688-74d995046400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:31.511829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7acbd-0be8-43c1-8688-74d995046400 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:31.512155 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7acbd-0be8-43c1-8688-74d995046400 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:31.512434 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7acbd-0be8-43c1-8688-74d995046400 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:31.513147 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7acbd-0be8-43c1-8688-74d995046400 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:13:31.513456 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7acbd-0be8-43c1-8688-74d995046400 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:31.514810 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7acbd-0be8-43c1-8688-74d995046400 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:31.523159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 582/1157] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:13:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:31.528789 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c64f13-3855-404c-a022-e81481402347 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:31.627222 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c64f13-3855-404c-a022-e81481402347 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:31.644825 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:31.661300 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d7d98-23f1-4c23-8691-f609041718c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:31.661923 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d7d98-23f1-4c23-8691-f609041718c4 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:31.662203 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d7d98-23f1-4c23-8691-f609041718c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:31.662476 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d7d98-23f1-4c23-8691-f609041718c4 None admin] PATH_INFO: `/v3/users/690b17b205fb43f390aeca4e5ca4ce5a` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:31.663617 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d7d98-23f1-4c23-8691-f609041718c4 None admin] RBAC: Authorizing `identity:get_user(user_id=690b17b205fb43f390aeca4e5ca4ce5a)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:31.665339 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d7d98-23f1-4c23-8691-f609041718c4 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:31.666924 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 576/1158] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:13:31 2022] GET /identity/v3/users/690b17b205fb43f390aeca4e5ca4ce5a => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:31.672715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7acbd-0be8-43c1-8688-74d995046400 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:31.769390 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7acbd-0be8-43c1-8688-74d995046400 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:31.802228 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622218b-391e-4d09-b650-5f87040bd7c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:31.802825 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622218b-391e-4d09-b650-5f87040bd7c9 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:31.803110 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622218b-391e-4d09-b650-5f87040bd7c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:31.803384 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622218b-391e-4d09-b650-5f87040bd7c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:31.838076 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:31.870194 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622218b-391e-4d09-b650-5f87040bd7c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:31.871628 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622218b-391e-4d09-b650-5f87040bd7c9 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:31.966629 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 583/1159] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:13:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 15:13:31.972382 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d7d98-23f1-4c23-8691-f609041718c4 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:32.068683 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d7d98-23f1-4c23-8691-f609041718c4 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:32.100874 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364d4e1d-dee4-41f3-ae5b-64b3a5f89549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:32.101491 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d4e1d-dee4-41f3-ae5b-64b3a5f89549 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:32.102016 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d4e1d-dee4-41f3-ae5b-64b3a5f89549 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:32.102016 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d4e1d-dee4-41f3-ae5b-64b3a5f89549 None admin] PATH_INFO: `/v3/projects/82a12f96e5004588840e8db69f0d7c9d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:32.103162 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d4e1d-dee4-41f3-ae5b-64b3a5f89549 None admin] RBAC: Authorizing `identity:get_project(project_id=82a12f96e5004588840e8db69f0d7c9d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:32.104603 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364d4e1d-dee4-41f3-ae5b-64b3a5f89549 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:32.106226 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 577/1160] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:13:31 2022] GET /identity/v3/projects/82a12f96e5004588840e8db69f0d7c9d => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:32.112128 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622218b-391e-4d09-b650-5f87040bd7c9 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:32.176518 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:32.208377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622218b-391e-4d09-b650-5f87040bd7c9 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:32.241603 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a875810-90e1-4140-b9d2-ffcfc292d1a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:32.242142 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a875810-90e1-4140-b9d2-ffcfc292d1a7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:32.242424 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a875810-90e1-4140-b9d2-ffcfc292d1a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:32.242696 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a875810-90e1-4140-b9d2-ffcfc292d1a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:32.243471 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a875810-90e1-4140-b9d2-ffcfc292d1a7 None admin] RBAC: Adding query filter params (role.id=6535f8b98008471dba33e89bd460880d, scope.project.id=82a12f96e5004588840e8db69f0d7c9d, user.id=690b17b205fb43f390aeca4e5ca4ce5a) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:13:32.243781 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a875810-90e1-4140-b9d2-ffcfc292d1a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:32.245212 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a875810-90e1-4140-b9d2-ffcfc292d1a7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:32.250795 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 584/1161] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:13:32 2022] GET /identity/v3/role_assignments?user.id=690b17b205fb43f390aeca4e5ca4ce5a&scope.project.id=82a12f96e5004588840e8db69f0d7c9d&role.id=6535f8b98008471dba33e89bd460880d => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:34.234886 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443c49c-8189-47d5-9fab-7efae1f5cc3a None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:34.235447 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443c49c-8189-47d5-9fab-7efae1f5cc3a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:34.235447 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443c49c-8189-47d5-9fab-7efae1f5cc3a None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:34.236788 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 578/1162] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:13:34.241933 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9b0bb-2c86-4f67-a661-9b0fe1b5e1ad None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:34.242354 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9b0bb-2c86-4f67-a661-9b0fe1b5e1ad None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:34.242491 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b9b0bb-2c86-4f67-a661-9b0fe1b5e1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:34.260946 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-56b9b0bb-2c86-4f67-a661-9b0fe1b5e1ad None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:13:34.262120 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-56b9b0bb-2c86-4f67-a661-9b0fe1b5e1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:13:34.327483 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 585/1163] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:13:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:13:34.350616 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443c49c-8189-47d5-9fab-7efae1f5cc3a None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:34.405666 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:34.450226 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3443c49c-8189-47d5-9fab-7efae1f5cc3a None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:34.482619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b503c-19ea-488a-8aea-54cceece91f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:34.483220 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b503c-19ea-488a-8aea-54cceece91f1 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:34.483503 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b503c-19ea-488a-8aea-54cceece91f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:34.483777 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5b503c-19ea-488a-8aea-54cceece91f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:34.550734 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b503c-19ea-488a-8aea-54cceece91f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:34.552115 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5b503c-19ea-488a-8aea-54cceece91f1 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:34.608328 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:34.653121 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 579/1164] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:13:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 15:13:34.659255 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9b0bb-2c86-4f67-a661-9b0fe1b5e1ad None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:34.717649 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:34.755178 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b9b0bb-2c86-4f67-a661-9b0fe1b5e1ad None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:34.787028 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e698ea-ff21-42f1-95fa-807c131b7440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:34.787645 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e698ea-ff21-42f1-95fa-807c131b7440 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:34.787925 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e698ea-ff21-42f1-95fa-807c131b7440 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:34.788225 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e698ea-ff21-42f1-95fa-807c131b7440 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:34.794929 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e698ea-ff21-42f1-95fa-807c131b7440 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:34.796381 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e698ea-ff21-42f1-95fa-807c131b7440 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:34.808024 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-c5e698ea-ff21-42f1-95fa-807c131b7440 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 27 15:13:34.808024 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:13:34.808024 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 27 15:13:34.808024 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 27 15:13:34.808024 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:13:34.808024 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:13:34.808024 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:13:34.808024 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:13:34.808024 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 27 15:13:34.808024 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:13:34.808024 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 15:13:34.808024 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:13:34.808024 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:13:34.808024 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:13:34.808024 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:13:34.808024 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:13:34.808024 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:13:34.809290 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:13:34.809290 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:13:34.809290 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:13:34.809290 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:13:34.809290 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:13:34.809290 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:13:34.809290 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:13:34.809290 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:13:34.809290 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:13:34.809290 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:13:34.809290 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:13:34.809290 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:13:34.809290 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:13:34.809290 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:13:34.809290 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:13:34.809290 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:13:34.810365 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:13:34.810365 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:13:34.810365 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:13:34.810365 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:13:34.810365 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:13:34.810365 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:13:34.810365 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:13:34.810365 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:13:34.810365 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:13:34.810365 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:13:34.810365 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 27 15:13:34.810365 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:13:34.810365 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 27 15:13:34.810365 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:13:34.810365 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 586/1165] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Jul 27 15:13:34 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:13:34.814935 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b503c-19ea-488a-8aea-54cceece91f1 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:34.909200 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5b503c-19ea-488a-8aea-54cceece91f1 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:34.942531 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354949ae-4e3f-4ad8-97c4-22a5b7a2a0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:34.943124 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354949ae-4e3f-4ad8-97c4-22a5b7a2a0a4 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:34.943402 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354949ae-4e3f-4ad8-97c4-22a5b7a2a0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:34.943674 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354949ae-4e3f-4ad8-97c4-22a5b7a2a0a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:34.944375 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354949ae-4e3f-4ad8-97c4-22a5b7a2a0a4 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:13:34.944677 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354949ae-4e3f-4ad8-97c4-22a5b7a2a0a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:34.946029 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354949ae-4e3f-4ad8-97c4-22a5b7a2a0a4 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:34.952836 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 580/1166] 10.222.0.40 () {56 vars in 1115 bytes} [Wed Jul 27 15:13:34 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:36.923630 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ba9ae-7e57-483f-b387-2a45d6528dba None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:36.924170 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ba9ae-7e57-483f-b387-2a45d6528dba None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:36.924170 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41ba9ae-7e57-483f-b387-2a45d6528dba None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:36.925970 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 587/1167] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:13:36.931268 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27348e-de1c-4c46-a737-7f2107813d69 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:36.931656 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27348e-de1c-4c46-a737-7f2107813d69 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:36.931827 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27348e-de1c-4c46-a737-7f2107813d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:36.950163 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-8b27348e-de1c-4c46-a737-7f2107813d69 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:13:36.951349 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8b27348e-de1c-4c46-a737-7f2107813d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:13:36.964784 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:37.016694 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 581/1168] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:13:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:13:37.040869 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ba9ae-7e57-483f-b387-2a45d6528dba None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:37.137483 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41ba9ae-7e57-483f-b387-2a45d6528dba None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:37.158674 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:37.170658 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf256cd-24f2-4596-aa1d-5519de6e7dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:37.171246 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf256cd-24f2-4596-aa1d-5519de6e7dc7 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:37.171531 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf256cd-24f2-4596-aa1d-5519de6e7dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:37.171803 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf256cd-24f2-4596-aa1d-5519de6e7dc7 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:37.172531 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf256cd-24f2-4596-aa1d-5519de6e7dc7 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:37.173927 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf256cd-24f2-4596-aa1d-5519de6e7dc7 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:37.188573 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 588/1169] 10.222.0.40 () {60 vars in 1138 bytes} [Wed Jul 27 15:13:37 2022] POST /identity/v3/domains => generated 267 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:13:39.194761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d64ad-6490-44fa-9da9-ee5a971e0809 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:39.195317 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d64ad-6490-44fa-9da9-ee5a971e0809 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:39.195317 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55d64ad-6490-44fa-9da9-ee5a971e0809 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:39.196696 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 582/1170] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:13:39.201841 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437be361-fae9-44b3-827b-b66899e2c8a5 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:39.202231 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437be361-fae9-44b3-827b-b66899e2c8a5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:39.202388 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437be361-fae9-44b3-827b-b66899e2c8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:39.220004 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-437be361-fae9-44b3-827b-b66899e2c8a5 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:13:39.221198 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-437be361-fae9-44b3-827b-b66899e2c8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:13:39.286737 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 589/1171] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:13:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:13:39.310245 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d64ad-6490-44fa-9da9-ee5a971e0809 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:39.409014 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55d64ad-6490-44fa-9da9-ee5a971e0809 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:39.442267 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3697e6f7-67c1-42a1-8448-a9c9050faa5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:39.442893 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697e6f7-67c1-42a1-8448-a9c9050faa5d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:39.443175 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697e6f7-67c1-42a1-8448-a9c9050faa5d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:39.443451 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697e6f7-67c1-42a1-8448-a9c9050faa5d None admin] PATH_INFO: `/v3/domains/9782f5b93a494fb3999614f7b9800538` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:39.453514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3697e6f7-67c1-42a1-8448-a9c9050faa5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=9782f5b93a494fb3999614f7b9800538)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:39.454889 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3697e6f7-67c1-42a1-8448-a9c9050faa5d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:39.456680 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 583/1172] 10.222.0.40 () {56 vars in 1183 bytes} [Wed Jul 27 15:13:39 2022] GET /identity/v3/domains/9782f5b93a494fb3999614f7b9800538 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:39.462123 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437be361-fae9-44b3-827b-b66899e2c8a5 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:39.564454 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437be361-fae9-44b3-827b-b66899e2c8a5 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:39.577698 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:39.599774 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e1b8fa-b77d-404a-a725-70e7733de12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:39.600421 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1b8fa-b77d-404a-a725-70e7733de12d None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:39.600703 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1b8fa-b77d-404a-a725-70e7733de12d None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:39.600974 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1b8fa-b77d-404a-a725-70e7733de12d None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:39.601657 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e1b8fa-b77d-404a-a725-70e7733de12d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:39.603066 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e1b8fa-b77d-404a-a725-70e7733de12d None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:39.628277 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 590/1173] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Jul 27 15:13:39 2022] POST /identity/v3/projects => generated 361 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:13:41.607293 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4702db-6659-4c84-98ab-8550acb9e3bd None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:41.607747 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4702db-6659-4c84-98ab-8550acb9e3bd None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:41.607847 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4702db-6659-4c84-98ab-8550acb9e3bd None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:41.609220 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 584/1174] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:13:41.614952 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5711b7c-ca73-47ac-ac79-89046a503dfa None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:41.615406 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5711b7c-ca73-47ac-ac79-89046a503dfa None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:41.615514 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5711b7c-ca73-47ac-ac79-89046a503dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:41.633809 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a5711b7c-ca73-47ac-ac79-89046a503dfa None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:13:41.634984 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a5711b7c-ca73-47ac-ac79-89046a503dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:13:41.700539 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 591/1175] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:13:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:13:41.724489 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4702db-6659-4c84-98ab-8550acb9e3bd None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:41.735823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:41.824391 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4702db-6659-4c84-98ab-8550acb9e3bd None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:41.856264 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb5b0b-412a-4a0d-be1a-088654d32092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:41.856831 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb5b0b-412a-4a0d-be1a-088654d32092 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:41.857108 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb5b0b-412a-4a0d-be1a-088654d32092 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:41.857377 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb5b0b-412a-4a0d-be1a-088654d32092 None admin] PATH_INFO: `/v3/domains/9782f5b93a494fb3999614f7b9800538` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:41.858500 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb5b0b-412a-4a0d-be1a-088654d32092 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9782f5b93a494fb3999614f7b9800538)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:41.859896 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb5b0b-412a-4a0d-be1a-088654d32092 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:41.861470 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 585/1176] 10.222.0.40 () {56 vars in 1183 bytes} [Wed Jul 27 15:13:41 2022] GET /identity/v3/domains/9782f5b93a494fb3999614f7b9800538 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:41.867704 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5711b7c-ca73-47ac-ac79-89046a503dfa None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:41.957789 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:41.964830 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5711b7c-ca73-47ac-ac79-89046a503dfa None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:41.998266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552cdefe-f954-41a8-b5bb-c4b7402680ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:41.998865 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cdefe-f954-41a8-b5bb-c4b7402680ca None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:41.999143 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cdefe-f954-41a8-b5bb-c4b7402680ca None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:41.999410 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552cdefe-f954-41a8-b5bb-c4b7402680ca None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:42.000111 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552cdefe-f954-41a8-b5bb-c4b7402680ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:42.001517 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552cdefe-f954-41a8-b5bb-c4b7402680ca None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:42.021287 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 592/1177] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Jul 27 15:13:41 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:13:44.056807 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a19c3-a1f2-4a06-9f52-351c8fff1cbe None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:44.057325 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a19c3-a1f2-4a06-9f52-351c8fff1cbe None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:44.057426 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a19c3-a1f2-4a06-9f52-351c8fff1cbe None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:44.058683 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 586/1178] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:13:44.063684 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e656ab7-4614-4b38-8445-eb2123a52170 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:44.064110 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e656ab7-4614-4b38-8445-eb2123a52170 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:44.064284 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e656ab7-4614-4b38-8445-eb2123a52170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:44.082917 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-2e656ab7-4614-4b38-8445-eb2123a52170 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:13:44.084134 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2e656ab7-4614-4b38-8445-eb2123a52170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:13:44.156450 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 593/1179] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:13:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:13:44.178977 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a19c3-a1f2-4a06-9f52-351c8fff1cbe None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:44.254667 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:44.277715 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072a19c3-a1f2-4a06-9f52-351c8fff1cbe None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:44.311344 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1429c6-e90e-4268-b8a0-292daaf479cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:44.311905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1429c6-e90e-4268-b8a0-292daaf479cb None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:44.312211 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1429c6-e90e-4268-b8a0-292daaf479cb None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:44.312487 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1429c6-e90e-4268-b8a0-292daaf479cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:44.322165 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1429c6-e90e-4268-b8a0-292daaf479cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:13:44.327010 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-2b1429c6-e90e-4268-b8a0-292daaf479cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:13:44.327010 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:13:44.327010 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:13:44.327010 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:13:44.327010 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:13:44.327010 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:13:44.327010 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:13:44.327010 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:13:44.327010 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:13:44.327010 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:13:44.327010 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:13:44.327010 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:13:44.327010 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:13:44.327010 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:13:44.327010 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:13:44.327010 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:13:44.328245 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:13:44.328245 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:13:44.328245 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:13:44.328245 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:13:44.328245 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:13:44.328245 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:13:44.328245 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:13:44.328245 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:13:44.328245 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:13:44.328245 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:13:44.328245 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:13:44.328245 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:13:44.328245 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:13:44.328245 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:13:44.328245 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:13:44.328245 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:13:44.329323 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:13:44.329323 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:13:44.329323 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:13:44.329323 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:13:44.329323 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:13:44.329323 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:13:44.329323 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:13:44.329323 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:13:44.329323 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:13:44.329323 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:13:44.329323 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:13:44.329323 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:13:44.329323 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 587/1180] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jul 27 15:13:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:13:44.334006 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e656ab7-4614-4b38-8445-eb2123a52170 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:44.412971 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:44.432506 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e656ab7-4614-4b38-8445-eb2123a52170 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:44.464593 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c7115-522d-4116-97c3-2cd3dac7227f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:44.465189 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c7115-522d-4116-97c3-2cd3dac7227f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:44.465471 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c7115-522d-4116-97c3-2cd3dac7227f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:44.465744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c7115-522d-4116-97c3-2cd3dac7227f None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:44.466447 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73c7115-522d-4116-97c3-2cd3dac7227f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:13:44.466748 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73c7115-522d-4116-97c3-2cd3dac7227f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:44.468110 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73c7115-522d-4116-97c3-2cd3dac7227f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:44.476324 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 594/1181] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:13:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:44.481969 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1429c6-e90e-4268-b8a0-292daaf479cb None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:44.578818 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1429c6-e90e-4268-b8a0-292daaf479cb None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:44.612776 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c085f-0a4c-47b7-97bd-246ad6f5de9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:44.613400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c085f-0a4c-47b7-97bd-246ad6f5de9f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:44.613682 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c085f-0a4c-47b7-97bd-246ad6f5de9f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:44.613955 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69c085f-0a4c-47b7-97bd-246ad6f5de9f None admin] PATH_INFO: `/v3/users/642e29a7a4364244a81afacada6a7e72` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:44.616616 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:44.628147 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c085f-0a4c-47b7-97bd-246ad6f5de9f None admin] RBAC: Authorizing `identity:get_user(user_id=642e29a7a4364244a81afacada6a7e72)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:44.629591 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69c085f-0a4c-47b7-97bd-246ad6f5de9f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:44.631212 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 588/1182] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:13:44 2022] GET /identity/v3/users/642e29a7a4364244a81afacada6a7e72 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:44.636996 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c7115-522d-4116-97c3-2cd3dac7227f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:44.732509 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73c7115-522d-4116-97c3-2cd3dac7227f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:44.763588 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad1a31-3eba-4b26-b16c-eccf18c56a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:44.764205 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad1a31-3eba-4b26-b16c-eccf18c56a38 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:44.764484 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad1a31-3eba-4b26-b16c-eccf18c56a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:44.764754 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dad1a31-3eba-4b26-b16c-eccf18c56a38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:44.776488 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:44.829639 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad1a31-3eba-4b26-b16c-eccf18c56a38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:44.831599 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dad1a31-3eba-4b26-b16c-eccf18c56a38 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:44.924266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 595/1183] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:13:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 15:13:44.930021 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c085f-0a4c-47b7-97bd-246ad6f5de9f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:45.025071 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69c085f-0a4c-47b7-97bd-246ad6f5de9f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:45.058282 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714dc043-abab-45e4-b7bd-cf20a939fd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:45.058908 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dc043-abab-45e4-b7bd-cf20a939fd17 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:45.059175 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dc043-abab-45e4-b7bd-cf20a939fd17 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:45.059448 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714dc043-abab-45e4-b7bd-cf20a939fd17 None admin] PATH_INFO: `/v3/projects/b4b51cbe23e24af29cb4b9a6df598b34` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:45.060604 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714dc043-abab-45e4-b7bd-cf20a939fd17 None admin] RBAC: Authorizing `identity:get_project(project_id=b4b51cbe23e24af29cb4b9a6df598b34)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:45.062034 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714dc043-abab-45e4-b7bd-cf20a939fd17 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:45.063762 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 589/1184] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:13:44 2022] GET /identity/v3/projects/b4b51cbe23e24af29cb4b9a6df598b34 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:45.070438 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad1a31-3eba-4b26-b16c-eccf18c56a38 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:45.112021 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:45.169954 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dad1a31-3eba-4b26-b16c-eccf18c56a38 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:45.203205 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18356d08-64fc-4401-8f21-b017824ec426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:45.203798 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18356d08-64fc-4401-8f21-b017824ec426 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:45.204097 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18356d08-64fc-4401-8f21-b017824ec426 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:45.204363 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18356d08-64fc-4401-8f21-b017824ec426 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:45.205136 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18356d08-64fc-4401-8f21-b017824ec426 None admin] RBAC: Adding query filter params (role.id=6535f8b98008471dba33e89bd460880d, scope.project.id=b4b51cbe23e24af29cb4b9a6df598b34, user.id=642e29a7a4364244a81afacada6a7e72) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:13:45.205439 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18356d08-64fc-4401-8f21-b017824ec426 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:45.206863 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18356d08-64fc-4401-8f21-b017824ec426 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:45.212081 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 596/1185] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:13:45 2022] GET /identity/v3/role_assignments?user.id=642e29a7a4364244a81afacada6a7e72&scope.project.id=b4b51cbe23e24af29cb4b9a6df598b34&role.id=6535f8b98008471dba33e89bd460880d => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:47.209629 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d05c2a-bca8-4cc7-ac97-1d09c6815308 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:47.210176 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d05c2a-bca8-4cc7-ac97-1d09c6815308 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:47.210176 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d05c2a-bca8-4cc7-ac97-1d09c6815308 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:47.211522 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 590/1186] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:13:47.216811 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db4047-5681-4d2a-a6cf-8d04d285123d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:47.217243 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db4047-5681-4d2a-a6cf-8d04d285123d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:47.217336 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db4047-5681-4d2a-a6cf-8d04d285123d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:47.235301 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-31db4047-5681-4d2a-a6cf-8d04d285123d None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:13:47.236557 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-31db4047-5681-4d2a-a6cf-8d04d285123d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:13:47.299596 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 597/1187] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:13:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:13:47.321888 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d05c2a-bca8-4cc7-ac97-1d09c6815308 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:47.383750 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:47.424121 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d05c2a-bca8-4cc7-ac97-1d09c6815308 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:47.465630 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4c045-bd96-4ae3-99b2-e700d4d85746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:47.466183 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4c045-bd96-4ae3-99b2-e700d4d85746 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:47.466466 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4c045-bd96-4ae3-99b2-e700d4d85746 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:47.466744 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc4c045-bd96-4ae3-99b2-e700d4d85746 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:47.476728 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc4c045-bd96-4ae3-99b2-e700d4d85746 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:13:47.481619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-8cc4c045-bd96-4ae3-99b2-e700d4d85746 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:13:47.481619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:13:47.481619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:13:47.481619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:13:47.481619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:13:47.481619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:13:47.481619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:13:47.481619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:13:47.481619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:13:47.481619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:13:47.481619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:13:47.481619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:13:47.481619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:13:47.481619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:13:47.481619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:13:47.481619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:13:47.482709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:13:47.482709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:13:47.482709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:13:47.482709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:13:47.482709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:13:47.482709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:13:47.482709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:13:47.482709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:13:47.482709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:13:47.482709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:13:47.482709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:13:47.482709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:13:47.482709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:13:47.482709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:13:47.482709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:13:47.482709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:13:47.488590 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:13:47.488590 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:13:47.488590 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:13:47.488590 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:13:47.488590 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:13:47.488590 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:13:47.488590 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:13:47.488590 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:13:47.488590 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:13:47.488590 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:13:47.488590 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:13:47.488590 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:13:47.488590 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 591/1188] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jul 27 15:13:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:13:47.489459 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db4047-5681-4d2a-a6cf-8d04d285123d None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:47.522974 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:47.593701 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db4047-5681-4d2a-a6cf-8d04d285123d None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:47.628972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f51feb-bb78-44d5-a344-2b05dcbad2df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:47.629574 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f51feb-bb78-44d5-a344-2b05dcbad2df None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:47.629855 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f51feb-bb78-44d5-a344-2b05dcbad2df None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:47.630127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f51feb-bb78-44d5-a344-2b05dcbad2df None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:47.630834 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f51feb-bb78-44d5-a344-2b05dcbad2df None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:13:47.631139 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f51feb-bb78-44d5-a344-2b05dcbad2df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:47.632534 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f51feb-bb78-44d5-a344-2b05dcbad2df None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:47.640317 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 598/1189] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:13:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:47.646152 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4c045-bd96-4ae3-99b2-e700d4d85746 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:47.742326 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc4c045-bd96-4ae3-99b2-e700d4d85746 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:47.764461 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:47.776187 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573ead9-2300-4f10-978a-97147b507171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:47.776812 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573ead9-2300-4f10-978a-97147b507171 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:47.777093 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573ead9-2300-4f10-978a-97147b507171 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:47.777368 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f573ead9-2300-4f10-978a-97147b507171 None admin] PATH_INFO: `/v3/users/642e29a7a4364244a81afacada6a7e72` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:47.778517 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f573ead9-2300-4f10-978a-97147b507171 None admin] RBAC: Authorizing `identity:get_user(user_id=642e29a7a4364244a81afacada6a7e72)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:47.779931 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f573ead9-2300-4f10-978a-97147b507171 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:47.781557 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 592/1190] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:13:47 2022] GET /identity/v3/users/642e29a7a4364244a81afacada6a7e72 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:47.787500 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f51feb-bb78-44d5-a344-2b05dcbad2df None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:47.881684 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:47.887818 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f51feb-bb78-44d5-a344-2b05dcbad2df None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:47.920935 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c1ce8-3b48-44de-ad44-998dc8cf2f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:47.921563 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c1ce8-3b48-44de-ad44-998dc8cf2f29 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:47.921851 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c1ce8-3b48-44de-ad44-998dc8cf2f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:47.922124 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c1ce8-3b48-44de-ad44-998dc8cf2f29 None admin] PATH_INFO: `/v3/projects/b4b51cbe23e24af29cb4b9a6df598b34` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:47.923266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c1ce8-3b48-44de-ad44-998dc8cf2f29 None admin] RBAC: Authorizing `identity:get_project(project_id=b4b51cbe23e24af29cb4b9a6df598b34)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:47.925298 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c1ce8-3b48-44de-ad44-998dc8cf2f29 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:47.926951 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 599/1191] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:13:47 2022] GET /identity/v3/projects/b4b51cbe23e24af29cb4b9a6df598b34 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:47.932883 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573ead9-2300-4f10-978a-97147b507171 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:48.029404 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f573ead9-2300-4f10-978a-97147b507171 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:48.062005 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd85678-c532-4c8b-8608-117ac53282c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:48.062652 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd85678-c532-4c8b-8608-117ac53282c4 None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:48.062932 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd85678-c532-4c8b-8608-117ac53282c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:48.063208 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd85678-c532-4c8b-8608-117ac53282c4 None admin] PATH_INFO: `/v3/projects/b4b51cbe23e24af29cb4b9a6df598b34/users/642e29a7a4364244a81afacada6a7e72/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:48.065647 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd85678-c532-4c8b-8608-117ac53282c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=b4b51cbe23e24af29cb4b9a6df598b34, user_id=642e29a7a4364244a81afacada6a7e72, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:48.067059 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd85678-c532-4c8b-8608-117ac53282c4 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:48.079937 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 593/1192] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jul 27 15:13:47 2022] PUT /identity/v3/projects/b4b51cbe23e24af29cb4b9a6df598b34/users/642e29a7a4364244a81afacada6a7e72/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:13:50.058103 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf9715-76ee-46c1-9063-ba22a77ebc5e None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:50.058623 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf9715-76ee-46c1-9063-ba22a77ebc5e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:50.058719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daf9715-76ee-46c1-9063-ba22a77ebc5e None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:50.060057 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 600/1193] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:13:50.065045 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a3118-bd27-415d-81c4-d6771d890197 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:50.065931 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a3118-bd27-415d-81c4-d6771d890197 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:50.066189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a3118-bd27-415d-81c4-d6771d890197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:50.083616 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-057a3118-bd27-415d-81c4-d6771d890197 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:13:50.084804 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-057a3118-bd27-415d-81c4-d6771d890197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:13:50.129226 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:50.150529 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 594/1194] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:13:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:13:50.173384 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf9715-76ee-46c1-9063-ba22a77ebc5e None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:50.272383 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daf9715-76ee-46c1-9063-ba22a77ebc5e None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:50.305246 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac7749-4abe-4222-86d9-fa9406b216f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:50.305868 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac7749-4abe-4222-86d9-fa9406b216f1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:50.306150 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac7749-4abe-4222-86d9-fa9406b216f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:50.306424 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac7749-4abe-4222-86d9-fa9406b216f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:50.316716 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac7749-4abe-4222-86d9-fa9406b216f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:13:50.321481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-7eac7749-4abe-4222-86d9-fa9406b216f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:13:50.321481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:13:50.321481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:13:50.321481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:13:50.321481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:13:50.321481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:13:50.321481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:13:50.321481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:13:50.321481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:13:50.321481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:13:50.321481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:13:50.321481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:13:50.321481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:13:50.321481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:13:50.321481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:13:50.321481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:13:50.322606 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:13:50.322606 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:13:50.322606 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:13:50.322606 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:13:50.322606 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:13:50.322606 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:13:50.322606 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:13:50.322606 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:13:50.322606 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:13:50.322606 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:13:50.322606 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:13:50.322606 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:13:50.322606 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:13:50.322606 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:13:50.322606 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:13:50.322606 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:13:50.323659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:13:50.323659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:13:50.323659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:13:50.323659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:13:50.323659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:13:50.323659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:13:50.323659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:13:50.323659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:13:50.323659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:13:50.323659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:13:50.323659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:13:50.323659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:13:50.323659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 601/1195] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jul 27 15:13:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:13:50.328746 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a3118-bd27-415d-81c4-d6771d890197 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:50.430919 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a3118-bd27-415d-81c4-d6771d890197 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:50.463689 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16fc91d-172d-42eb-9efa-763db142054c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:50.464316 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fc91d-172d-42eb-9efa-763db142054c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:50.464599 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fc91d-172d-42eb-9efa-763db142054c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:50.464874 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fc91d-172d-42eb-9efa-763db142054c None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:50.465581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16fc91d-172d-42eb-9efa-763db142054c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:13:50.465887 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16fc91d-172d-42eb-9efa-763db142054c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:50.467239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16fc91d-172d-42eb-9efa-763db142054c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:50.475656 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 595/1196] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:13:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:50.481350 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac7749-4abe-4222-86d9-fa9406b216f1 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:50.507910 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:50.578645 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac7749-4abe-4222-86d9-fa9406b216f1 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:50.611501 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cfd6e-ff2a-45ed-96e6-16aa266fa6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:50.612185 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cfd6e-ff2a-45ed-96e6-16aa266fa6e5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:50.612467 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cfd6e-ff2a-45ed-96e6-16aa266fa6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:50.612738 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cfd6e-ff2a-45ed-96e6-16aa266fa6e5 None admin] PATH_INFO: `/v3/users/642e29a7a4364244a81afacada6a7e72` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:50.613881 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8cfd6e-ff2a-45ed-96e6-16aa266fa6e5 None admin] RBAC: Authorizing `identity:get_user(user_id=642e29a7a4364244a81afacada6a7e72)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:50.615298 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8cfd6e-ff2a-45ed-96e6-16aa266fa6e5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:50.616916 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 602/1197] 10.222.0.40 () {56 vars in 1177 bytes} [Wed Jul 27 15:13:50 2022] GET /identity/v3/users/642e29a7a4364244a81afacada6a7e72 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:50.622578 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16fc91d-172d-42eb-9efa-763db142054c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:50.665644 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:50.720279 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16fc91d-172d-42eb-9efa-763db142054c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:50.752412 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72154a26-c01a-47ef-ba56-e316b738c5c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:50.753044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72154a26-c01a-47ef-ba56-e316b738c5c4 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:50.753330 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72154a26-c01a-47ef-ba56-e316b738c5c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:50.753609 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72154a26-c01a-47ef-ba56-e316b738c5c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:50.818888 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72154a26-c01a-47ef-ba56-e316b738c5c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:50.820354 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72154a26-c01a-47ef-ba56-e316b738c5c4 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:50.859738 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:50.915611 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 596/1198] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:13:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 15:13:50.921376 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cfd6e-ff2a-45ed-96e6-16aa266fa6e5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:51.017985 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:13:51.025429 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cfd6e-ff2a-45ed-96e6-16aa266fa6e5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:51.057108 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3808cf2f-019e-4ece-bd09-64d944cc7df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:51.057731 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808cf2f-019e-4ece-bd09-64d944cc7df1 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:51.058013 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808cf2f-019e-4ece-bd09-64d944cc7df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:51.058293 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3808cf2f-019e-4ece-bd09-64d944cc7df1 None admin] PATH_INFO: `/v3/projects/b4b51cbe23e24af29cb4b9a6df598b34` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:51.059476 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3808cf2f-019e-4ece-bd09-64d944cc7df1 None admin] RBAC: Authorizing `identity:get_project(project_id=b4b51cbe23e24af29cb4b9a6df598b34)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:51.060912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3808cf2f-019e-4ece-bd09-64d944cc7df1 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:51.062534 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 603/1199] 10.222.0.40 () {56 vars in 1186 bytes} [Wed Jul 27 15:13:50 2022] GET /identity/v3/projects/b4b51cbe23e24af29cb4b9a6df598b34 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:13:51.069128 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72154a26-c01a-47ef-ba56-e316b738c5c4 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:13:51.164054 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72154a26-c01a-47ef-ba56-e316b738c5c4 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:13:51.197155 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4689f-16da-461d-a6af-de09be42ba60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:13:51.197752 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4689f-16da-461d-a6af-de09be42ba60 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:13:51.198034 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4689f-16da-461d-a6af-de09be42ba60 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:13:51.198307 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4689f-16da-461d-a6af-de09be42ba60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:13:51.199086 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4689f-16da-461d-a6af-de09be42ba60 None admin] RBAC: Adding query filter params (role.id=6535f8b98008471dba33e89bd460880d, scope.project.id=b4b51cbe23e24af29cb4b9a6df598b34, user.id=642e29a7a4364244a81afacada6a7e72) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:13:51.199396 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4689f-16da-461d-a6af-de09be42ba60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:13:51.200834 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4689f-16da-461d-a6af-de09be42ba60 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:13:51.206450 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 597/1200] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:13:51 2022] GET /identity/v3/role_assignments?user.id=642e29a7a4364244a81afacada6a7e72&scope.project.id=b4b51cbe23e24af29cb4b9a6df598b34&role.id=6535f8b98008471dba33e89bd460880d => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:14:01.053167 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=19 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:14:01.203871 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=97 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:14:45.965906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b21c9-2333-4df7-a70a-a368dabdc1f0 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:45.966566 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b21c9-2333-4df7-a70a-a368dabdc1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:45.966566 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b21c9-2333-4df7-a70a-a368dabdc1f0 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:45.967670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 604/1201] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:14:45.975199 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f38271-86e9-4b14-b0b7-330ca988616b None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:45.975728 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f38271-86e9-4b14-b0b7-330ca988616b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:45.975816 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f38271-86e9-4b14-b0b7-330ca988616b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:46.001651 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-e6f38271-86e9-4b14-b0b7-330ca988616b None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:14:46.005514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e6f38271-86e9-4b14-b0b7-330ca988616b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:14:46.105761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 598/1202] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:14:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:14:46.131902 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b21c9-2333-4df7-a70a-a368dabdc1f0 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:14:46.262591 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b21c9-2333-4df7-a70a-a368dabdc1f0 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:14:46.305854 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b85b9-e6fd-47d4-a706-07203261123b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:14:46.306465 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b85b9-e6fd-47d4-a706-07203261123b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:46.306776 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b85b9-e6fd-47d4-a706-07203261123b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:46.307063 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3b85b9-e6fd-47d4-a706-07203261123b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:46.329385 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b85b9-e6fd-47d4-a706-07203261123b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:14:46.330872 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3b85b9-e6fd-47d4-a706-07203261123b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:14:46.351172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-1c3b85b9-e6fd-47d4-a706-07203261123b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:14:46.351172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:14:46.351172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:14:46.351172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:14:46.351172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:14:46.351172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:14:46.351172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:14:46.351172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:14:46.351172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:14:46.351172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:14:46.351172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:14:46.351172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:14:46.351172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:14:46.351172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:14:46.351172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:14:46.356521 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:14:46.356521 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:14:46.356521 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:14:46.356521 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:14:46.356521 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:14:46.356521 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:14:46.356521 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:14:46.356521 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:14:46.356521 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:14:46.356521 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:14:46.356521 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:14:46.356521 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:14:46.356521 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:14:46.356521 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:14:46.356521 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:14:46.356521 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:14:46.356521 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:14:46.357729 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:14:46.357729 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:14:46.357729 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:14:46.357729 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:14:46.357729 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 605/1203] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:14:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:14:46.359011 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f38271-86e9-4b14-b0b7-330ca988616b None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:14:46.512036 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f38271-86e9-4b14-b0b7-330ca988616b None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:14:46.558350 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:14:46.570835 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf5b996-c328-47ec-ad84-b037302ce69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:14:46.571652 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5b996-c328-47ec-ad84-b037302ce69f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:46.572357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5b996-c328-47ec-ad84-b037302ce69f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:46.572890 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5b996-c328-47ec-ad84-b037302ce69f None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:46.573868 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5b996-c328-47ec-ad84-b037302ce69f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:14:46.574306 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5b996-c328-47ec-ad84-b037302ce69f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:14:46.576076 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf5b996-c328-47ec-ad84-b037302ce69f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:14:46.597761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 599/1204] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:14:46.607170 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b85b9-e6fd-47d4-a706-07203261123b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:14:46.676515 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:14:46.734084 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3b85b9-e6fd-47d4-a706-07203261123b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:14:46.773605 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54acb6f3-2cfc-4cc9-8b30-1b16d55dfb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:14:46.774234 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acb6f3-2cfc-4cc9-8b30-1b16d55dfb03 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:46.774497 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acb6f3-2cfc-4cc9-8b30-1b16d55dfb03 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:46.774775 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54acb6f3-2cfc-4cc9-8b30-1b16d55dfb03 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:46.775450 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54acb6f3-2cfc-4cc9-8b30-1b16d55dfb03 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:14:46.776903 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54acb6f3-2cfc-4cc9-8b30-1b16d55dfb03 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:14:46.812112 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 606/1205] 10.222.0.40 () {60 vars in 1132 bytes} [Wed Jul 27 15:14:46 2022] POST /identity/v3/users => generated 251 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:14:49.430106 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efae25e-68f1-4e3a-a7b2-e2b646e80ad5 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:49.430695 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efae25e-68f1-4e3a-a7b2-e2b646e80ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:49.430776 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efae25e-68f1-4e3a-a7b2-e2b646e80ad5 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:49.432494 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 600/1206] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:14:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:14:49.438919 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c57dd-e099-40db-87d9-56ed64ac3cbd None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:49.439365 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c57dd-e099-40db-87d9-56ed64ac3cbd None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:49.439533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34c57dd-e099-40db-87d9-56ed64ac3cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:49.459906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d34c57dd-e099-40db-87d9-56ed64ac3cbd None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:14:49.461227 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d34c57dd-e099-40db-87d9-56ed64ac3cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:14:49.540586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 607/1207] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:14:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:14:49.570728 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efae25e-68f1-4e3a-a7b2-e2b646e80ad5 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:14:49.692238 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efae25e-68f1-4e3a-a7b2-e2b646e80ad5 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:14:49.734556 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707e469-df6e-47c7-ab62-8fe52659c19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:14:49.735224 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707e469-df6e-47c7-ab62-8fe52659c19c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:49.735514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707e469-df6e-47c7-ab62-8fe52659c19c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:49.735884 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707e469-df6e-47c7-ab62-8fe52659c19c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:49.748930 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707e469-df6e-47c7-ab62-8fe52659c19c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:14:49.753831 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-2707e469-df6e-47c7-ab62-8fe52659c19c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:14:49.753831 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:14:49.753831 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:14:49.753831 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:14:49.753831 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:14:49.753831 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:14:49.753831 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:14:49.753831 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:14:49.753831 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:14:49.753831 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:14:49.753831 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:14:49.753831 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:14:49.753831 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:14:49.753831 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:14:49.753831 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:14:49.753831 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:14:49.755377 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:14:49.755377 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:14:49.755377 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:14:49.755377 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:14:49.755377 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:14:49.755377 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:14:49.755377 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:14:49.755377 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:14:49.755377 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:14:49.755377 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:14:49.755377 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:14:49.755377 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:14:49.755377 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:14:49.755377 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:14:49.755377 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:14:49.755377 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:14:49.756294 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:14:49.756294 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:14:49.756294 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:14:49.756294 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:14:49.756294 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:14:49.756294 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:14:49.756294 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:14:49.756294 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:14:49.756294 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:14:49.756294 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:14:49.756294 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:14:49.756294 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:14:49.756294 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 601/1208] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jul 27 15:14:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:14:49.761246 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c57dd-e099-40db-87d9-56ed64ac3cbd None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:14:49.809286 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:14:49.878108 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34c57dd-e099-40db-87d9-56ed64ac3cbd None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:14:49.919310 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032ca7f-9f6a-49a5-ac00-ab0f765c5dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:14:49.920037 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032ca7f-9f6a-49a5-ac00-ab0f765c5dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:49.920351 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032ca7f-9f6a-49a5-ac00-ab0f765c5dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:49.920621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032ca7f-9f6a-49a5-ac00-ab0f765c5dd3 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:49.921425 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032ca7f-9f6a-49a5-ac00-ab0f765c5dd3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:14:49.921742 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032ca7f-9f6a-49a5-ac00-ab0f765c5dd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:14:49.923194 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032ca7f-9f6a-49a5-ac00-ab0f765c5dd3 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:14:49.932380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 608/1209] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jul 27 15:14:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:14:49.938119 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707e469-df6e-47c7-ab62-8fe52659c19c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:14:50.004582 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:14:50.067435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707e469-df6e-47c7-ab62-8fe52659c19c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:14:50.111393 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b515e-b791-41ef-bb8b-8231eda4b56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:14:50.112234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b515e-b791-41ef-bb8b-8231eda4b56b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:50.112639 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b515e-b791-41ef-bb8b-8231eda4b56b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:50.112843 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b515e-b791-41ef-bb8b-8231eda4b56b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:50.124662 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b515e-b791-41ef-bb8b-8231eda4b56b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:14:50.126955 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b515e-b791-41ef-bb8b-8231eda4b56b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:14:50.146154 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-396b515e-b791-41ef-bb8b-8231eda4b56b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:14:50.146154 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:14:50.146154 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:14:50.146154 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:14:50.146154 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:14:50.146154 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:14:50.146154 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:14:50.146154 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:14:50.146154 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:14:50.146154 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:14:50.146154 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:14:50.146154 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:14:50.146154 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:14:50.146154 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:14:50.146154 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:14:50.147460 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:14:50.147460 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:14:50.147460 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:14:50.147460 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:14:50.147460 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:14:50.147460 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:14:50.147460 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:14:50.147460 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:14:50.147460 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:14:50.147460 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:14:50.147460 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:14:50.147460 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:14:50.147460 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:14:50.147460 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:14:50.147460 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:14:50.147460 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:14:50.147460 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:14:50.148440 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:14:50.148440 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:14:50.148440 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:14:50.148440 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:14:50.148440 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 602/1210] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:14:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:14:50.153311 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032ca7f-9f6a-49a5-ac00-ab0f765c5dd3 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:14:50.276063 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:14:50.282211 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032ca7f-9f6a-49a5-ac00-ab0f765c5dd3 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:14:50.325370 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d64cc2-6bb9-47c0-a130-d21ef11d7792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:14:50.326191 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d64cc2-6bb9-47c0-a130-d21ef11d7792 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:50.326565 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d64cc2-6bb9-47c0-a130-d21ef11d7792 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:50.326979 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d64cc2-6bb9-47c0-a130-d21ef11d7792 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:50.327800 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d64cc2-6bb9-47c0-a130-d21ef11d7792 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:14:50.328254 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d64cc2-6bb9-47c0-a130-d21ef11d7792 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:14:50.330318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d64cc2-6bb9-47c0-a130-d21ef11d7792 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:14:50.344341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 609/1211] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:14:50.350519 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b515e-b791-41ef-bb8b-8231eda4b56b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:14:50.484141 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b515e-b791-41ef-bb8b-8231eda4b56b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:14:50.486548 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:14:50.523937 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a67e41-107d-4276-8a16-0e7950568910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:14:50.524828 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a67e41-107d-4276-8a16-0e7950568910 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:50.525173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a67e41-107d-4276-8a16-0e7950568910 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:50.525476 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a67e41-107d-4276-8a16-0e7950568910 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:50.534005 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a67e41-107d-4276-8a16-0e7950568910 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:14:50.535469 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a67e41-107d-4276-8a16-0e7950568910 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:14:50.548527 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-27a67e41-107d-4276-8a16-0e7950568910 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 15:14:50.548527 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:14:50.548527 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:14:50.548527 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:14:50.548527 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:14:50.548527 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:14:50.548527 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:14:50.548527 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:14:50.548527 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:14:50.548527 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:14:50.548527 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:14:50.548527 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:14:50.548527 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:14:50.548527 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:14:50.548527 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:14:50.548527 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:14:50.549647 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:14:50.549647 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:14:50.549647 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:14:50.549647 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:14:50.549647 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:14:50.549647 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:14:50.549647 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:14:50.549647 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:14:50.549647 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:14:50.549647 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:14:50.549647 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:14:50.549647 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:14:50.549647 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:14:50.549647 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:14:50.549647 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:14:50.549647 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:14:50.549647 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:14:50.549647 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:14:50.550762 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:14:50.550762 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:14:50.550762 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:14:50.550762 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:14:50.550762 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:14:50.550762 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:14:50.550762 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:14:50.550762 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:14:50.550762 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 15:14:50.550762 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:14:50.554941 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 603/1212] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:14:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:14:50.555926 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d64cc2-6bb9-47c0-a130-d21ef11d7792 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:14:50.676790 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d64cc2-6bb9-47c0-a130-d21ef11d7792 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:14:50.716717 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2853b-509d-4bde-b9bc-6ac489af76ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:14:50.717343 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2853b-509d-4bde-b9bc-6ac489af76ce None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:50.717626 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2853b-509d-4bde-b9bc-6ac489af76ce None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:50.717903 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e2853b-509d-4bde-b9bc-6ac489af76ce None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:50.718736 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2853b-509d-4bde-b9bc-6ac489af76ce None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:14:50.719034 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2853b-509d-4bde-b9bc-6ac489af76ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:14:50.720468 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e2853b-509d-4bde-b9bc-6ac489af76ce None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:14:50.740419 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 610/1213] 10.222.0.40 () {56 vars in 1143 bytes} [Wed Jul 27 15:14:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:14:50.746195 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a67e41-107d-4276-8a16-0e7950568910 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:14:50.878276 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a67e41-107d-4276-8a16-0e7950568910 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:14:50.918480 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41829378-754b-4dd2-9607-40920c8a3917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:14:50.919085 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41829378-754b-4dd2-9607-40920c8a3917 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:50.919364 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41829378-754b-4dd2-9607-40920c8a3917 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:50.919634 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41829378-754b-4dd2-9607-40920c8a3917 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:50.959907 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:14:51.006136 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41829378-754b-4dd2-9607-40920c8a3917 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:14:51.007670 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41829378-754b-4dd2-9607-40920c8a3917 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:14:51.137215 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 604/1214] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:14:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 15:14:51.143003 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2853b-509d-4bde-b9bc-6ac489af76ce None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:14:51.165511 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:14:51.258377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e2853b-509d-4bde-b9bc-6ac489af76ce None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:14:51.296068 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450accf-1168-4163-b3bf-dac421363df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:14:51.296954 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450accf-1168-4163-b3bf-dac421363df2 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:51.297383 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450accf-1168-4163-b3bf-dac421363df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:51.297804 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6450accf-1168-4163-b3bf-dac421363df2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:51.310512 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450accf-1168-4163-b3bf-dac421363df2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:14:51.312410 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6450accf-1168-4163-b3bf-dac421363df2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:14:51.331277 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-6450accf-1168-4163-b3bf-dac421363df2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:14:51.331277 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:14:51.331277 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:14:51.331277 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:14:51.331277 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:14:51.331277 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:14:51.331277 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:14:51.331277 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:14:51.331277 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:14:51.331277 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:14:51.331277 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:14:51.331277 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:14:51.331277 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:14:51.331277 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:14:51.331277 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:14:51.332827 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:14:51.332827 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:14:51.332827 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:14:51.332827 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:14:51.332827 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:14:51.332827 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:14:51.332827 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:14:51.332827 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:14:51.332827 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:14:51.332827 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:14:51.332827 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:14:51.332827 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:14:51.332827 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:14:51.332827 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:14:51.332827 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:14:51.332827 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:14:51.332827 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:14:51.333952 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:14:51.333952 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:14:51.333952 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:14:51.333952 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:14:51.339862 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 611/1215] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:14:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:14:51.343713 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41829378-754b-4dd2-9607-40920c8a3917 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:14:51.411399 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:14:51.454603 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41829378-754b-4dd2-9607-40920c8a3917 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:14:51.492477 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d90dcb-083b-4ba0-b825-40f5f76e20bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:14:51.493159 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d90dcb-083b-4ba0-b825-40f5f76e20bf None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:51.493403 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d90dcb-083b-4ba0-b825-40f5f76e20bf None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:51.493624 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d90dcb-083b-4ba0-b825-40f5f76e20bf None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:51.494306 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d90dcb-083b-4ba0-b825-40f5f76e20bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:14:51.494605 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d90dcb-083b-4ba0-b825-40f5f76e20bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:14:51.495949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d90dcb-083b-4ba0-b825-40f5f76e20bf None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:14:51.512079 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 605/1216] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:14:51.512973 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450accf-1168-4163-b3bf-dac421363df2 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:14:51.604746 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:14:51.646776 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6450accf-1168-4163-b3bf-dac421363df2 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:14:51.684075 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f15705-f028-4fe6-87fe-622996322e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:14:51.684684 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f15705-f028-4fe6-87fe-622996322e51 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:51.684993 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f15705-f028-4fe6-87fe-622996322e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:51.685322 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f15705-f028-4fe6-87fe-622996322e51 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:51.697188 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f15705-f028-4fe6-87fe-622996322e51 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:14:51.698887 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f15705-f028-4fe6-87fe-622996322e51 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:14:51.712308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-19f15705-f028-4fe6-87fe-622996322e51 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:14:51.712308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:14:51.712308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:14:51.712308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:14:51.712308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:14:51.712308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:14:51.712308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:14:51.712308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:14:51.712308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:14:51.712308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:14:51.712308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:14:51.712308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:14:51.712308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:14:51.712308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:14:51.712308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:14:51.713266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:14:51.713266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:14:51.713266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:14:51.713266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:14:51.713266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:14:51.713266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:14:51.713266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:14:51.713266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:14:51.713266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:14:51.713266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:14:51.713266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:14:51.713266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:14:51.713266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:14:51.713266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:14:51.713266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:14:51.713266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:14:51.713266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:14:51.714758 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:14:51.714758 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:14:51.714758 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:14:51.714758 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:14:51.714758 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:14:51.714758 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:14:51.714758 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:14:51.714758 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:14:51.714758 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 612/1217] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:14:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:14:51.719463 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d90dcb-083b-4ba0-b825-40f5f76e20bf None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:14:51.836376 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d90dcb-083b-4ba0-b825-40f5f76e20bf None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:14:51.861652 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:14:51.878185 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e930b9-ad00-475d-a798-9ac1309ec82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:14:51.878852 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e930b9-ad00-475d-a798-9ac1309ec82d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:51.879254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e930b9-ad00-475d-a798-9ac1309ec82d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:51.879540 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e930b9-ad00-475d-a798-9ac1309ec82d None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:51.880565 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e930b9-ad00-475d-a798-9ac1309ec82d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:14:51.880946 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e930b9-ad00-475d-a798-9ac1309ec82d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:14:51.882778 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e930b9-ad00-475d-a798-9ac1309ec82d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:14:51.902887 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 606/1218] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jul 27 15:14:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:14:51.904724 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f15705-f028-4fe6-87fe-622996322e51 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:14:52.024495 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f15705-f028-4fe6-87fe-622996322e51 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:14:52.056971 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:14:52.065231 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43fa03-1f78-4be4-ad42-d89bea5e4b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:14:52.065851 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43fa03-1f78-4be4-ad42-d89bea5e4b1c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:52.066133 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43fa03-1f78-4be4-ad42-d89bea5e4b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:52.066407 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43fa03-1f78-4be4-ad42-d89bea5e4b1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:52.067196 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de43fa03-1f78-4be4-ad42-d89bea5e4b1c None admin] RBAC: Adding query filter params (role.id=6a54ab92d32843d6bc4c2dcedae4bd13, scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5, user.id=a386d326dc634cbd943ac30f6e8d08bc) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:14:52.067659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de43fa03-1f78-4be4-ad42-d89bea5e4b1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:14:52.069265 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de43fa03-1f78-4be4-ad42-d89bea5e4b1c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:14:52.083452 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 613/1219] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:14:51 2022] GET /identity/v3/role_assignments?user.id=a386d326dc634cbd943ac30f6e8d08bc&scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5&role.id=6a54ab92d32843d6bc4c2dcedae4bd13 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:14:54.309024 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29e5a6-6d1e-4019-949e-1d0f20468d15 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:54.309617 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29e5a6-6d1e-4019-949e-1d0f20468d15 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:54.309765 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29e5a6-6d1e-4019-949e-1d0f20468d15 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:54.311400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 607/1220] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:14:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:14:54.317866 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a671d-5264-44eb-a4d6-00e04c3f40be None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:54.318270 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a671d-5264-44eb-a4d6-00e04c3f40be None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:54.318619 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901a671d-5264-44eb-a4d6-00e04c3f40be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:54.344102 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-901a671d-5264-44eb-a4d6-00e04c3f40be None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:14:54.345845 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-901a671d-5264-44eb-a4d6-00e04c3f40be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:14:54.427065 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 614/1221] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:14:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 15:14:54.454151 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29e5a6-6d1e-4019-949e-1d0f20468d15 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:14:54.565762 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29e5a6-6d1e-4019-949e-1d0f20468d15 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:14:54.605568 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79f679-f85b-4612-9ac4-0eea6c49ac0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:14:54.606220 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79f679-f85b-4612-9ac4-0eea6c49ac0b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:54.606515 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79f679-f85b-4612-9ac4-0eea6c49ac0b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:54.606882 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb79f679-f85b-4612-9ac4-0eea6c49ac0b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:54.619551 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb79f679-f85b-4612-9ac4-0eea6c49ac0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:14:54.625310 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-bb79f679-f85b-4612-9ac4-0eea6c49ac0b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:14:54.625310 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:14:54.625310 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:14:54.625310 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:14:54.625310 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:14:54.625310 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:14:54.625310 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:14:54.625310 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:14:54.625310 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:14:54.625310 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:14:54.625310 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:14:54.625310 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:14:54.625310 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:14:54.625310 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:14:54.625310 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:14:54.625310 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:14:54.626467 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:14:54.626467 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:14:54.626467 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:14:54.626467 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:14:54.626467 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:14:54.626467 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:14:54.626467 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:14:54.626467 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:14:54.626467 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:14:54.626467 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:14:54.626467 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:14:54.626467 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:14:54.626467 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:14:54.626467 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:14:54.626467 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:14:54.626467 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:14:54.627328 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:14:54.627328 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:14:54.627328 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:14:54.627328 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:14:54.627328 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:14:54.627328 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:14:54.627328 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:14:54.627328 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:14:54.627328 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:14:54.627328 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:14:54.627328 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:14:54.627328 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:14:54.627328 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 608/1222] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jul 27 15:14:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:14:54.632769 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a671d-5264-44eb-a4d6-00e04c3f40be None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:14:54.732762 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901a671d-5264-44eb-a4d6-00e04c3f40be None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:14:54.758920 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:14:54.770547 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da303ae-e567-4dde-908d-33ea16da2ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:14:54.771167 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da303ae-e567-4dde-908d-33ea16da2ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:54.771452 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da303ae-e567-4dde-908d-33ea16da2ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:54.771859 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da303ae-e567-4dde-908d-33ea16da2ba5 None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:54.772615 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da303ae-e567-4dde-908d-33ea16da2ba5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:14:54.772920 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da303ae-e567-4dde-908d-33ea16da2ba5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:14:54.774389 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da303ae-e567-4dde-908d-33ea16da2ba5 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:14:54.785076 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 615/1223] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jul 27 15:14:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:14:54.792449 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79f679-f85b-4612-9ac4-0eea6c49ac0b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:14:54.842285 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:14:54.914708 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb79f679-f85b-4612-9ac4-0eea6c49ac0b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:14:54.953930 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e72a6b-b6e7-4947-8725-e0aa8eff341c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:14:54.954570 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e72a6b-b6e7-4947-8725-e0aa8eff341c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:54.954854 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e72a6b-b6e7-4947-8725-e0aa8eff341c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:54.955124 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e72a6b-b6e7-4947-8725-e0aa8eff341c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:54.965552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e72a6b-b6e7-4947-8725-e0aa8eff341c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:14:54.967005 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e72a6b-b6e7-4947-8725-e0aa8eff341c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:14:54.985592 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-f8e72a6b-b6e7-4947-8725-e0aa8eff341c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:14:54.985592 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:14:54.985592 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:14:54.985592 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:14:54.985592 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:14:54.985592 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:14:54.985592 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:14:54.985592 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:14:54.985592 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:14:54.985592 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:14:54.985592 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:14:54.985592 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:14:54.985592 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:14:54.985592 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:14:54.985592 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:14:54.986702 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:14:54.986702 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:14:54.986702 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:14:54.986702 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:14:54.986702 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:14:54.986702 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:14:54.986702 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:14:54.986702 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:14:54.986702 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:14:54.986702 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:14:54.986702 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:14:54.986702 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:14:54.986702 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:14:54.986702 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:14:54.986702 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:14:54.986702 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:14:54.986702 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:14:54.992682 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:14:54.992682 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:14:54.992682 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:14:54.992682 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:14:54.992682 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 609/1224] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:14:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:14:54.993041 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da303ae-e567-4dde-908d-33ea16da2ba5 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:14:55.110919 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da303ae-e567-4dde-908d-33ea16da2ba5 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:14:55.153090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8643e9-c270-4745-a3ef-c556f931738b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:14:55.153773 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8643e9-c270-4745-a3ef-c556f931738b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:55.154110 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8643e9-c270-4745-a3ef-c556f931738b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:55.154385 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8643e9-c270-4745-a3ef-c556f931738b None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:55.155100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8643e9-c270-4745-a3ef-c556f931738b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:14:55.155434 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8643e9-c270-4745-a3ef-c556f931738b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:14:55.157871 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8643e9-c270-4745-a3ef-c556f931738b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:14:55.172353 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 616/1225] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:14:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:14:55.178278 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e72a6b-b6e7-4947-8725-e0aa8eff341c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:14:55.282550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:14:55.290050 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e72a6b-b6e7-4947-8725-e0aa8eff341c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:14:55.325894 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12112d7-4dd0-4eeb-9f54-9c9de6d150de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:14:55.326652 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12112d7-4dd0-4eeb-9f54-9c9de6d150de None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:55.326913 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12112d7-4dd0-4eeb-9f54-9c9de6d150de None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:55.327307 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12112d7-4dd0-4eeb-9f54-9c9de6d150de None admin] PATH_INFO: `/v3/users/placement` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:55.337139 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12112d7-4dd0-4eeb-9f54-9c9de6d150de None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:14:55.338579 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12112d7-4dd0-4eeb-9f54-9c9de6d150de None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:14:55.352842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-f12112d7-4dd0-4eeb-9f54-9c9de6d150de None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 15:14:55.352842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:14:55.352842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:14:55.352842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:14:55.352842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:14:55.352842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:14:55.352842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:14:55.352842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:14:55.352842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:14:55.352842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:14:55.352842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:14:55.352842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:14:55.352842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:14:55.352842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:14:55.352842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:14:55.352842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:14:55.353951 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:14:55.353951 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:14:55.353951 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:14:55.353951 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:14:55.353951 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:14:55.353951 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:14:55.353951 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:14:55.353951 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:14:55.353951 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:14:55.353951 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:14:55.353951 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:14:55.353951 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:14:55.353951 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:14:55.353951 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:14:55.353951 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:14:55.353951 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:14:55.353951 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:14:55.353951 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:14:55.355439 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:14:55.355439 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:14:55.355439 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:14:55.355439 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:14:55.355439 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:14:55.355439 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:14:55.355439 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:14:55.355439 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:14:55.355439 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 15:14:55.355439 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:14:55.355439 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 610/1226] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:14:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:14:55.360776 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8643e9-c270-4745-a3ef-c556f931738b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:14:55.414670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:14:55.479975 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8643e9-c270-4745-a3ef-c556f931738b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:14:55.520744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddccbf5-115c-4570-9754-a5abda31f834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:14:55.521367 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddccbf5-115c-4570-9754-a5abda31f834 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:55.521707 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddccbf5-115c-4570-9754-a5abda31f834 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:55.521925 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddccbf5-115c-4570-9754-a5abda31f834 None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:55.522725 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddccbf5-115c-4570-9754-a5abda31f834 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:14:55.523033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddccbf5-115c-4570-9754-a5abda31f834 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:14:55.524497 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddccbf5-115c-4570-9754-a5abda31f834 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:14:55.541950 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 617/1227] 10.222.0.40 () {56 vars in 1143 bytes} [Wed Jul 27 15:14:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:14:55.548519 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12112d7-4dd0-4eeb-9f54-9c9de6d150de None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:14:55.681460 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12112d7-4dd0-4eeb-9f54-9c9de6d150de None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:14:55.718822 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526ee5d-552d-4966-8799-1806748b8c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:14:55.719460 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526ee5d-552d-4966-8799-1806748b8c9e None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:55.719744 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526ee5d-552d-4966-8799-1806748b8c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:55.720050 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526ee5d-552d-4966-8799-1806748b8c9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:55.730380 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526ee5d-552d-4966-8799-1806748b8c9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:14:55.731815 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a526ee5d-552d-4966-8799-1806748b8c9e None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:14:55.746749 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-a526ee5d-552d-4966-8799-1806748b8c9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:14:55.746749 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:14:55.746749 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:14:55.746749 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:14:55.746749 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:14:55.746749 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:14:55.746749 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:14:55.746749 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:14:55.746749 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:14:55.746749 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:14:55.746749 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:14:55.746749 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:14:55.746749 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:14:55.746749 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:14:55.746749 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:14:55.747771 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:14:55.747771 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:14:55.747771 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:14:55.747771 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:14:55.747771 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:14:55.747771 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:14:55.747771 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:14:55.747771 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:14:55.747771 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:14:55.747771 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:14:55.747771 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:14:55.747771 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:14:55.747771 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:14:55.747771 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:14:55.747771 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:14:55.747771 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:14:55.747771 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:14:55.749099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:14:55.749099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:14:55.749099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:14:55.749099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:14:55.749099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 611/1228] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:14:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:14:55.754869 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddccbf5-115c-4570-9754-a5abda31f834 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:14:55.872350 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddccbf5-115c-4570-9754-a5abda31f834 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:14:55.875567 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:14:55.910952 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91ad63-5d96-4ec5-a72e-574ade622b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:14:55.911714 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91ad63-5d96-4ec5-a72e-574ade622b49 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:55.912019 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91ad63-5d96-4ec5-a72e-574ade622b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:55.912528 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b91ad63-5d96-4ec5-a72e-574ade622b49 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:55.913857 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b91ad63-5d96-4ec5-a72e-574ade622b49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:14:55.914157 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b91ad63-5d96-4ec5-a72e-574ade622b49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:14:55.915927 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b91ad63-5d96-4ec5-a72e-574ade622b49 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:14:55.930682 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 618/1229] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:14:55.936538 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526ee5d-552d-4966-8799-1806748b8c9e None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:14:55.947641 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:14:56.053211 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526ee5d-552d-4966-8799-1806748b8c9e None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:14:56.090872 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6474f8e-8126-46a5-bea3-4cc097f0729b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:14:56.091527 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6474f8e-8126-46a5-bea3-4cc097f0729b None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:56.091816 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6474f8e-8126-46a5-bea3-4cc097f0729b None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:56.092161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6474f8e-8126-46a5-bea3-4cc097f0729b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:56.100331 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6474f8e-8126-46a5-bea3-4cc097f0729b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:14:56.102391 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6474f8e-8126-46a5-bea3-4cc097f0729b None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:14:56.116232 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-a6474f8e-8126-46a5-bea3-4cc097f0729b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:14:56.116232 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:14:56.116232 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:14:56.116232 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:14:56.116232 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:14:56.116232 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:14:56.116232 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:14:56.116232 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:14:56.116232 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:14:56.116232 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:14:56.116232 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:14:56.116232 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:14:56.116232 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:14:56.116232 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:14:56.116232 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:14:56.117161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:14:56.117161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:14:56.117161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:14:56.117161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:14:56.117161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:14:56.117161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:14:56.117161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:14:56.117161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:14:56.117161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:14:56.117161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:14:56.117161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:14:56.117161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:14:56.117161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:14:56.117161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:14:56.117161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:14:56.117161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:14:56.117161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:14:56.118266 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:14:56.118266 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:14:56.118266 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:14:56.118266 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:14:56.118266 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:14:56.118266 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:14:56.118266 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:14:56.118266 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:14:56.118266 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 612/1230] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:14:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:14:56.124073 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91ad63-5d96-4ec5-a72e-574ade622b49 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:14:56.239745 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b91ad63-5d96-4ec5-a72e-574ade622b49 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:14:56.276043 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db1580-23f5-400a-a511-2b6c7a2eb229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:14:56.276686 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db1580-23f5-400a-a511-2b6c7a2eb229 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:56.276963 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db1580-23f5-400a-a511-2b6c7a2eb229 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:56.277252 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db1580-23f5-400a-a511-2b6c7a2eb229 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:56.278017 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db1580-23f5-400a-a511-2b6c7a2eb229 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:14:56.278320 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db1580-23f5-400a-a511-2b6c7a2eb229 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:14:56.279767 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db1580-23f5-400a-a511-2b6c7a2eb229 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:14:56.294248 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 619/1231] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jul 27 15:14:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:14:56.300391 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6474f8e-8126-46a5-bea3-4cc097f0729b None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:14:56.393086 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:14:56.435459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6474f8e-8126-46a5-bea3-4cc097f0729b None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:14:56.476029 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f96243-7991-4f24-bbf6-5b527cd6554a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:14:56.476681 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f96243-7991-4f24-bbf6-5b527cd6554a None admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:56.476963 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f96243-7991-4f24-bbf6-5b527cd6554a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:56.477262 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f96243-7991-4f24-bbf6-5b527cd6554a None admin] PATH_INFO: `/v3/projects/0b616213eaea4a22afee15d4cbe5a3c5/users/a386d326dc634cbd943ac30f6e8d08bc/roles/6a54ab92d32843d6bc4c2dcedae4bd13` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:56.492599 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f96243-7991-4f24-bbf6-5b527cd6554a None admin] RBAC: Authorizing `identity:create_grant(project_id=0b616213eaea4a22afee15d4cbe5a3c5, user_id=a386d326dc634cbd943ac30f6e8d08bc, role_id=6a54ab92d32843d6bc4c2dcedae4bd13)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:14:56.493973 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f96243-7991-4f24-bbf6-5b527cd6554a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:14:56.508025 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 613/1232] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jul 27 15:14:56 2022] PUT /identity/v3/projects/0b616213eaea4a22afee15d4cbe5a3c5/users/a386d326dc634cbd943ac30f6e8d08bc/roles/6a54ab92d32843d6bc4c2dcedae4bd13 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:14:58.638626 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff98c6-fdb0-402c-816d-c49f41082469 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:58.639168 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff98c6-fdb0-402c-816d-c49f41082469 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:58.639397 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ff98c6-fdb0-402c-816d-c49f41082469 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:58.641762 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 620/1233] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:14:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:14:58.647319 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ebccb-6237-4c34-b8e9-550f077c7c9a None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:58.647804 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ebccb-6237-4c34-b8e9-550f077c7c9a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:58.647894 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2ebccb-6237-4c34-b8e9-550f077c7c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:58.666887 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-5d2ebccb-6237-4c34-b8e9-550f077c7c9a None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:14:58.668145 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5d2ebccb-6237-4c34-b8e9-550f077c7c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:14:58.737464 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 614/1234] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:14:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:14:58.763946 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff98c6-fdb0-402c-816d-c49f41082469 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:14:58.793367 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:14:58.876289 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ff98c6-fdb0-402c-816d-c49f41082469 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:14:58.917360 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0181a-3b2c-4064-bce4-7fbfd0bff7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:14:58.918122 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0181a-3b2c-4064-bce4-7fbfd0bff7e7 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:58.918485 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0181a-3b2c-4064-bce4-7fbfd0bff7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:58.918927 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0181a-3b2c-4064-bce4-7fbfd0bff7e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:58.930729 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0181a-3b2c-4064-bce4-7fbfd0bff7e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:14:58.936576 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-c5a0181a-3b2c-4064-bce4-7fbfd0bff7e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:14:58.936576 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:14:58.936576 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:14:58.936576 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:14:58.936576 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:14:58.936576 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:14:58.936576 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:14:58.936576 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:14:58.936576 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:14:58.936576 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:14:58.936576 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:14:58.936576 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:14:58.936576 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:14:58.936576 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:14:58.936576 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:14:58.936576 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:14:58.938127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:14:58.938127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:14:58.938127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:14:58.938127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:14:58.938127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:14:58.938127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:14:58.938127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:14:58.938127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:14:58.938127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:14:58.938127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:14:58.938127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:14:58.938127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:14:58.938127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:14:58.938127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:14:58.938127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:14:58.938127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:14:58.938962 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:14:58.938962 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:14:58.938962 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:14:58.938962 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:14:58.938962 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:14:58.938962 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:14:58.938962 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:14:58.938962 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:14:58.938962 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:14:58.938962 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:14:58.938962 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 15:14:58.938962 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:14:58.938962 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 621/1235] 10.222.0.40 () {56 vars in 1102 bytes} [Wed Jul 27 15:14:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:14:58.945079 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ebccb-6237-4c34-b8e9-550f077c7c9a None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:14:58.995407 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:14:59.054020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2ebccb-6237-4c34-b8e9-550f077c7c9a None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:14:59.090432 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72a128-2b22-4d28-8b52-c39d49048137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:14:59.091066 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72a128-2b22-4d28-8b52-c39d49048137 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:59.091372 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72a128-2b22-4d28-8b52-c39d49048137 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:59.091647 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a72a128-2b22-4d28-8b52-c39d49048137 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:59.092443 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72a128-2b22-4d28-8b52-c39d49048137 None admin] RBAC: Adding query filter params (name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:14:59.092803 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72a128-2b22-4d28-8b52-c39d49048137 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:14:59.094347 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a72a128-2b22-4d28-8b52-c39d49048137 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:14:59.102761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 615/1236] 10.222.0.40 () {56 vars in 1103 bytes} [Wed Jul 27 15:14:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:14:59.109307 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0181a-3b2c-4064-bce4-7fbfd0bff7e7 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:14:59.199588 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:14:59.217518 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0181a-3b2c-4064-bce4-7fbfd0bff7e7 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:14:59.254178 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9014bce-280d-4cd5-9dfc-14cd6f499088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:14:59.254825 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9014bce-280d-4cd5-9dfc-14cd6f499088 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:59.255102 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9014bce-280d-4cd5-9dfc-14cd6f499088 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:59.255376 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9014bce-280d-4cd5-9dfc-14cd6f499088 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:59.267640 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9014bce-280d-4cd5-9dfc-14cd6f499088 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:14:59.269192 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9014bce-280d-4cd5-9dfc-14cd6f499088 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:14:59.284690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-d9014bce-280d-4cd5-9dfc-14cd6f499088 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:14:59.284690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:14:59.284690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:14:59.284690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:14:59.284690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:14:59.284690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:14:59.284690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:14:59.284690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:14:59.284690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:14:59.284690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:14:59.284690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:14:59.284690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:14:59.284690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:14:59.284690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:14:59.284690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:14:59.288972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:14:59.288972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:14:59.288972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:14:59.288972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:14:59.288972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:14:59.288972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:14:59.288972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:14:59.288972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:14:59.288972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:14:59.288972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:14:59.288972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:14:59.288972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:14:59.288972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:14:59.288972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:14:59.288972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:14:59.288972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:14:59.288972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:14:59.289856 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:14:59.289856 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:14:59.289856 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:14:59.289856 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:14:59.289856 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 622/1237] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:14:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:14:59.292234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72a128-2b22-4d28-8b52-c39d49048137 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:14:59.405223 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a72a128-2b22-4d28-8b52-c39d49048137 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:14:59.414924 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:14:59.439707 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ca91b-b567-412d-a9a5-91ae495ba59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:14:59.440348 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ca91b-b567-412d-a9a5-91ae495ba59a None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:59.440630 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ca91b-b567-412d-a9a5-91ae495ba59a None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:59.440903 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ca91b-b567-412d-a9a5-91ae495ba59a None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:59.441584 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ca91b-b567-412d-a9a5-91ae495ba59a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:14:59.441886 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ca91b-b567-412d-a9a5-91ae495ba59a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:14:59.443257 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ca91b-b567-412d-a9a5-91ae495ba59a None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:14:59.455656 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 616/1238] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:14:59.461418 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9014bce-280d-4cd5-9dfc-14cd6f499088 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:14:59.574490 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9014bce-280d-4cd5-9dfc-14cd6f499088 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:14:59.617065 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04daf4-0f4a-43f6-a8f6-4ae3503e5f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:14:59.617951 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04daf4-0f4a-43f6-a8f6-4ae3503e5f85 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:59.618331 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04daf4-0f4a-43f6-a8f6-4ae3503e5f85 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:59.618641 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04daf4-0f4a-43f6-a8f6-4ae3503e5f85 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:59.621880 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:14:59.629714 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04daf4-0f4a-43f6-a8f6-4ae3503e5f85 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:14:59.631565 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04daf4-0f4a-43f6-a8f6-4ae3503e5f85 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:14:59.643982 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-2d04daf4-0f4a-43f6-a8f6-4ae3503e5f85 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 15:14:59.643982 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:14:59.643982 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:14:59.643982 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:14:59.643982 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:14:59.643982 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:14:59.643982 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:14:59.643982 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:14:59.643982 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:14:59.643982 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:14:59.643982 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:14:59.643982 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:14:59.643982 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:14:59.643982 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:14:59.643982 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:14:59.643982 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:14:59.650257 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:14:59.650257 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:14:59.650257 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:14:59.650257 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:14:59.650257 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:14:59.650257 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:14:59.650257 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:14:59.650257 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:14:59.650257 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:14:59.650257 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:14:59.650257 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:14:59.650257 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:14:59.650257 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:14:59.650257 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:14:59.650257 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:14:59.650257 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:14:59.650257 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:14:59.650257 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:14:59.651463 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:14:59.651463 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:14:59.651463 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:14:59.651463 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:14:59.651463 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:14:59.651463 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:14:59.651463 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:14:59.651463 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:14:59.651463 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 15:14:59.651463 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:14:59.651463 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 623/1239] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:14:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:14:59.652257 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ca91b-b567-412d-a9a5-91ae495ba59a None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:14:59.762655 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ca91b-b567-412d-a9a5-91ae495ba59a None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:14:59.807998 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce00d0-e178-4784-9f9c-cc47f58eccbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:14:59.808637 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce00d0-e178-4784-9f9c-cc47f58eccbc None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:59.808911 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce00d0-e178-4784-9f9c-cc47f58eccbc None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:59.809188 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ce00d0-e178-4784-9f9c-cc47f58eccbc None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:14:59.809980 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce00d0-e178-4784-9f9c-cc47f58eccbc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:14:59.810286 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce00d0-e178-4784-9f9c-cc47f58eccbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:14:59.811698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ce00d0-e178-4784-9f9c-cc47f58eccbc None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:14:59.832988 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 617/1240] 10.222.0.40 () {56 vars in 1143 bytes} [Wed Jul 27 15:14:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:14:59.840088 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04daf4-0f4a-43f6-a8f6-4ae3503e5f85 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:14:59.953204 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04daf4-0f4a-43f6-a8f6-4ae3503e5f85 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:14:59.992332 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688f5ec-86c1-484d-bfdc-6ba1579f2344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:14:59.992945 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688f5ec-86c1-484d-bfdc-6ba1579f2344 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:14:59.993226 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688f5ec-86c1-484d-bfdc-6ba1579f2344 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:14:59.993498 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688f5ec-86c1-484d-bfdc-6ba1579f2344 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:00.063393 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:00.074208 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688f5ec-86c1-484d-bfdc-6ba1579f2344 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:00.075892 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688f5ec-86c1-484d-bfdc-6ba1579f2344 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:00.188520 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 624/1241] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:14:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 15:15:00.194434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce00d0-e178-4784-9f9c-cc47f58eccbc None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:00.222743 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:00.306989 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ce00d0-e178-4784-9f9c-cc47f58eccbc None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:00.350980 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd333b2d-2cc6-43ca-b5c3-67185bc0f723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:00.351667 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd333b2d-2cc6-43ca-b5c3-67185bc0f723 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:00.352133 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd333b2d-2cc6-43ca-b5c3-67185bc0f723 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:00.352552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd333b2d-2cc6-43ca-b5c3-67185bc0f723 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:00.364359 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd333b2d-2cc6-43ca-b5c3-67185bc0f723 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:00.365835 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd333b2d-2cc6-43ca-b5c3-67185bc0f723 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:00.382959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-bd333b2d-2cc6-43ca-b5c3-67185bc0f723 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:15:00.382959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:15:00.382959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:15:00.382959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:15:00.382959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:15:00.382959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:15:00.382959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:15:00.382959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:15:00.382959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:15:00.382959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:15:00.382959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:15:00.382959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:15:00.382959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:15:00.382959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:15:00.382959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:15:00.384049 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:15:00.384049 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:15:00.384049 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:15:00.384049 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:15:00.384049 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:15:00.384049 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:15:00.384049 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:15:00.384049 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:15:00.384049 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:15:00.384049 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:15:00.384049 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:15:00.384049 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:15:00.384049 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:15:00.384049 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:15:00.384049 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:15:00.384049 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:15:00.384049 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:15:00.385179 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:15:00.385179 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:15:00.385179 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:15:00.385179 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:15:00.385179 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 618/1242] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:15:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:15:00.390174 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688f5ec-86c1-484d-bfdc-6ba1579f2344 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:00.498440 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:00.505807 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688f5ec-86c1-484d-bfdc-6ba1579f2344 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:00.547088 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eeffde-3ce9-4eb7-b4e4-870fe14dad58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:00.547867 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eeffde-3ce9-4eb7-b4e4-870fe14dad58 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:00.548262 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eeffde-3ce9-4eb7-b4e4-870fe14dad58 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:00.548712 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eeffde-3ce9-4eb7-b4e4-870fe14dad58 None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:00.549632 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eeffde-3ce9-4eb7-b4e4-870fe14dad58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:15:00.549961 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eeffde-3ce9-4eb7-b4e4-870fe14dad58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:00.551660 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eeffde-3ce9-4eb7-b4e4-870fe14dad58 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:00.565606 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 625/1243] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:15:00.571150 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd333b2d-2cc6-43ca-b5c3-67185bc0f723 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:00.655027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:00.679868 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd333b2d-2cc6-43ca-b5c3-67185bc0f723 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:00.719459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b0f74b-2acb-4747-bbe1-0f6279905b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:00.720228 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0f74b-2acb-4747-bbe1-0f6279905b37 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:00.720552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0f74b-2acb-4747-bbe1-0f6279905b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:00.720795 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b0f74b-2acb-4747-bbe1-0f6279905b37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:00.729271 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b0f74b-2acb-4747-bbe1-0f6279905b37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:00.731163 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b0f74b-2acb-4747-bbe1-0f6279905b37 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:00.743321 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-47b0f74b-2acb-4747-bbe1-0f6279905b37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:15:00.743321 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:15:00.743321 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:15:00.743321 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:15:00.743321 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:15:00.743321 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:15:00.743321 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:15:00.743321 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:15:00.743321 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:15:00.743321 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:15:00.743321 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:15:00.743321 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:15:00.743321 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:15:00.743321 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:15:00.743321 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:15:00.744506 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:15:00.744506 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:15:00.744506 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:15:00.744506 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:15:00.744506 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:15:00.744506 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:15:00.744506 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:15:00.744506 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:15:00.744506 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:15:00.744506 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:15:00.744506 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:15:00.744506 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:15:00.744506 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:15:00.744506 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:15:00.744506 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:15:00.744506 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:15:00.744506 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:15:00.745443 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:15:00.745443 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:15:00.745443 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:15:00.745443 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:15:00.745443 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:15:00.745443 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:15:00.745443 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:15:00.745443 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:15:00.745443 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 619/1244] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:15:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:15:00.751909 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eeffde-3ce9-4eb7-b4e4-870fe14dad58 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:00.873788 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eeffde-3ce9-4eb7-b4e4-870fe14dad58 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:00.912541 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98491976-de2e-418c-a986-054800d47250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:00.913089 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98491976-de2e-418c-a986-054800d47250 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:00.913374 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98491976-de2e-418c-a986-054800d47250 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:00.913949 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98491976-de2e-418c-a986-054800d47250 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:00.914926 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98491976-de2e-418c-a986-054800d47250 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:15:00.915315 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98491976-de2e-418c-a986-054800d47250 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:00.917276 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98491976-de2e-418c-a986-054800d47250 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:00.930270 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 626/1245] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jul 27 15:15:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:15:00.936578 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b0f74b-2acb-4747-bbe1-0f6279905b37 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:01.054846 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b0f74b-2acb-4747-bbe1-0f6279905b37 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:01.098146 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de680335-64d0-4edf-86a9-fbb10b00ae95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:01.099035 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de680335-64d0-4edf-86a9-fbb10b00ae95 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:01.099323 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de680335-64d0-4edf-86a9-fbb10b00ae95 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:01.099609 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de680335-64d0-4edf-86a9-fbb10b00ae95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:01.100622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de680335-64d0-4edf-86a9-fbb10b00ae95 None admin] RBAC: Adding query filter params (role.id=6a54ab92d32843d6bc4c2dcedae4bd13, scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5, user.id=a386d326dc634cbd943ac30f6e8d08bc) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:15:01.101054 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de680335-64d0-4edf-86a9-fbb10b00ae95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:01.102959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de680335-64d0-4edf-86a9-fbb10b00ae95 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:01.121406 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 620/1246] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:15:00 2022] GET /identity/v3/role_assignments?user.id=a386d326dc634cbd943ac30f6e8d08bc&scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5&role.id=6a54ab92d32843d6bc4c2dcedae4bd13 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:15:03.257887 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2a9ab-4287-43f3-83c5-442ceb66ae05 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:03.258518 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2a9ab-4287-43f3-83c5-442ceb66ae05 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:03.258632 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2a9ab-4287-43f3-83c5-442ceb66ae05 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:03.260043 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 627/1247] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:15:03.266503 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4420483-e282-4a61-b1a1-d35a458aa83e None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:03.267013 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4420483-e282-4a61-b1a1-d35a458aa83e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:03.267122 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4420483-e282-4a61-b1a1-d35a458aa83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:03.273920 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:03.287930 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-d4420483-e282-4a61-b1a1-d35a458aa83e None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:15:03.289487 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d4420483-e282-4a61-b1a1-d35a458aa83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:15:03.373639 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 621/1248] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:15:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:15:03.396887 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2a9ab-4287-43f3-83c5-442ceb66ae05 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:03.418071 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:03.526374 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2a9ab-4287-43f3-83c5-442ceb66ae05 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:03.565681 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f5757-229f-4582-acf6-153e2003c339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:03.566315 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f5757-229f-4582-acf6-153e2003c339 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:03.566606 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f5757-229f-4582-acf6-153e2003c339 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:03.566858 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f5757-229f-4582-acf6-153e2003c339 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:03.578336 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3f5757-229f-4582-acf6-153e2003c339 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:15:03.583674 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-8d3f5757-229f-4582-acf6-153e2003c339 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:15:03.583674 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:15:03.583674 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:15:03.583674 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:15:03.583674 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:15:03.583674 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:15:03.583674 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:15:03.583674 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:15:03.583674 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:15:03.583674 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:15:03.583674 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:15:03.583674 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:15:03.583674 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:15:03.583674 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:15:03.583674 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:15:03.583674 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:15:03.584721 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:15:03.584721 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:15:03.584721 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:15:03.584721 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:15:03.584721 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:15:03.584721 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:15:03.584721 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:15:03.584721 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:15:03.584721 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:15:03.584721 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:15:03.584721 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:15:03.584721 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:15:03.584721 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:15:03.584721 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:15:03.584721 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:15:03.584721 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:15:03.585580 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:15:03.585580 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:15:03.585580 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:15:03.585580 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:15:03.585580 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:15:03.585580 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:15:03.585580 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:15:03.585580 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:15:03.585580 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:15:03.585580 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:15:03.585580 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:15:03.585580 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:15:03.585580 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 628/1249] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jul 27 15:15:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:15:03.591203 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4420483-e282-4a61-b1a1-d35a458aa83e None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:03.693122 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4420483-e282-4a61-b1a1-d35a458aa83e None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:03.725482 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:03.730906 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff2eabe-4a88-4b25-87ba-96ea2604d824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:03.731528 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2eabe-4a88-4b25-87ba-96ea2604d824 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:03.731798 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2eabe-4a88-4b25-87ba-96ea2604d824 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:03.732105 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff2eabe-4a88-4b25-87ba-96ea2604d824 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:03.732818 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff2eabe-4a88-4b25-87ba-96ea2604d824 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:15:03.733160 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff2eabe-4a88-4b25-87ba-96ea2604d824 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:03.734509 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff2eabe-4a88-4b25-87ba-96ea2604d824 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:03.742675 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 622/1250] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:15:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:15:03.748462 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f5757-229f-4582-acf6-153e2003c339 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:03.850549 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:03.885275 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f5757-229f-4582-acf6-153e2003c339 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:03.920598 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd22d58-5e87-4017-adf0-144fa356eb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:03.921233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd22d58-5e87-4017-adf0-144fa356eb31 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:03.922140 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd22d58-5e87-4017-adf0-144fa356eb31 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:03.922416 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd22d58-5e87-4017-adf0-144fa356eb31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:03.933157 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd22d58-5e87-4017-adf0-144fa356eb31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:03.935741 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd22d58-5e87-4017-adf0-144fa356eb31 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:03.952522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-3bd22d58-5e87-4017-adf0-144fa356eb31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:15:03.952522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:15:03.952522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:15:03.952522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:15:03.952522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:15:03.952522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:15:03.952522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:15:03.952522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:15:03.952522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:15:03.952522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:15:03.952522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:15:03.952522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:15:03.952522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:15:03.952522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:15:03.952522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:15:03.953802 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:15:03.953802 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:15:03.953802 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:15:03.953802 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:15:03.953802 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:15:03.953802 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:15:03.953802 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:15:03.953802 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:15:03.953802 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:15:03.953802 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:15:03.953802 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:15:03.953802 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:15:03.953802 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:15:03.953802 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:15:03.953802 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:15:03.953802 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:15:03.953802 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:15:03.957118 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:15:03.957118 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:15:03.957118 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:15:03.957118 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:15:03.957118 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 629/1251] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:15:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:15:03.959719 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff2eabe-4a88-4b25-87ba-96ea2604d824 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:04.071325 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff2eabe-4a88-4b25-87ba-96ea2604d824 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:04.112996 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c348ed-428a-4877-8adf-450f91855f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:04.113541 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c348ed-428a-4877-8adf-450f91855f78 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:04.113831 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c348ed-428a-4877-8adf-450f91855f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:04.114088 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c348ed-428a-4877-8adf-450f91855f78 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:04.114774 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c348ed-428a-4877-8adf-450f91855f78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:15:04.115087 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c348ed-428a-4877-8adf-450f91855f78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:04.116535 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c348ed-428a-4877-8adf-450f91855f78 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:04.133036 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 623/1252] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:15:04.139897 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd22d58-5e87-4017-adf0-144fa356eb31 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:04.252899 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd22d58-5e87-4017-adf0-144fa356eb31 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:04.280566 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:04.291396 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678afd48-aa89-479b-aedb-8c588aa11790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:04.292165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678afd48-aa89-479b-aedb-8c588aa11790 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:04.292450 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678afd48-aa89-479b-aedb-8c588aa11790 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:04.292777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678afd48-aa89-479b-aedb-8c588aa11790 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:04.302121 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678afd48-aa89-479b-aedb-8c588aa11790 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:04.303981 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678afd48-aa89-479b-aedb-8c588aa11790 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:04.318711 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-678afd48-aa89-479b-aedb-8c588aa11790 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 15:15:04.318711 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:15:04.318711 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:15:04.318711 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:15:04.318711 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:15:04.318711 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:15:04.318711 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:15:04.318711 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:15:04.318711 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:15:04.318711 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:15:04.318711 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:15:04.318711 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:15:04.318711 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:15:04.318711 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:15:04.318711 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:15:04.318711 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:15:04.320294 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:15:04.320294 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:15:04.320294 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:15:04.320294 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:15:04.320294 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:15:04.320294 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:15:04.320294 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:15:04.320294 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:15:04.320294 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:15:04.320294 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:15:04.320294 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:15:04.320294 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:15:04.320294 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:15:04.320294 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:15:04.320294 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:15:04.320294 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:15:04.320294 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:15:04.320294 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:15:04.321285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:15:04.321285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:15:04.321285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:15:04.321285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:15:04.321285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:15:04.321285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:15:04.321285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:15:04.321285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:15:04.321285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 15:15:04.321285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:15:04.321285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 630/1253] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:15:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:15:04.326303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c348ed-428a-4877-8adf-450f91855f78 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:04.394625 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:04.444515 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c348ed-428a-4877-8adf-450f91855f78 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:04.484003 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad1fa8-6e44-4ac7-8926-ebcecba6d12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:04.484630 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad1fa8-6e44-4ac7-8926-ebcecba6d12f None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:04.484913 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad1fa8-6e44-4ac7-8926-ebcecba6d12f None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:04.485189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad1fa8-6e44-4ac7-8926-ebcecba6d12f None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:04.486024 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad1fa8-6e44-4ac7-8926-ebcecba6d12f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:15:04.486370 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad1fa8-6e44-4ac7-8926-ebcecba6d12f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:04.488079 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fad1fa8-6e44-4ac7-8926-ebcecba6d12f None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:04.506898 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 624/1254] 10.222.0.40 () {56 vars in 1143 bytes} [Wed Jul 27 15:15:04 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:15:04.512971 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678afd48-aa89-479b-aedb-8c588aa11790 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:04.622537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678afd48-aa89-479b-aedb-8c588aa11790 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:04.659958 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad5f8f-da8c-40ad-bdab-6e84077175b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:04.660530 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad5f8f-da8c-40ad-bdab-6e84077175b8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:04.660827 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad5f8f-da8c-40ad-bdab-6e84077175b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:04.661098 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad5f8f-da8c-40ad-bdab-6e84077175b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:04.718602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:04.733144 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad5f8f-da8c-40ad-bdab-6e84077175b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:04.735371 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad5f8f-da8c-40ad-bdab-6e84077175b8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:04.842821 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 631/1255] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:15:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 15:15:04.849441 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad1fa8-6e44-4ac7-8926-ebcecba6d12f None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:04.957716 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad1fa8-6e44-4ac7-8926-ebcecba6d12f None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:04.972189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:04.996906 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9153ae88-6098-407f-917c-b3e5583e69c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:04.997657 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153ae88-6098-407f-917c-b3e5583e69c0 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:04.998010 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153ae88-6098-407f-917c-b3e5583e69c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:04.998340 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9153ae88-6098-407f-917c-b3e5583e69c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:05.010208 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9153ae88-6098-407f-917c-b3e5583e69c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:05.011932 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9153ae88-6098-407f-917c-b3e5583e69c0 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:05.027891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-9153ae88-6098-407f-917c-b3e5583e69c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:15:05.027891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:15:05.027891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:15:05.027891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:15:05.027891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:15:05.027891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:15:05.027891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:15:05.027891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:15:05.027891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:15:05.027891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:15:05.027891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:15:05.027891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:15:05.027891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:15:05.027891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:15:05.027891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:15:05.029020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:15:05.029020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:15:05.029020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:15:05.029020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:15:05.029020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:15:05.029020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:15:05.029020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:15:05.029020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:15:05.029020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:15:05.029020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:15:05.029020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:15:05.029020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:15:05.029020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:15:05.029020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:15:05.029020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:15:05.029020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:15:05.029020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:15:05.030124 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:15:05.030124 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:15:05.030124 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:15:05.030124 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:15:05.030124 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 625/1256] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:15:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:15:05.036198 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad5f8f-da8c-40ad-bdab-6e84077175b8 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:05.134692 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:05.149176 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad5f8f-da8c-40ad-bdab-6e84077175b8 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:05.190692 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972e968-3e5f-4639-baf6-3611d7f2e36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:05.191536 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972e968-3e5f-4639-baf6-3611d7f2e36a None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:05.191932 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972e968-3e5f-4639-baf6-3611d7f2e36a None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:05.192275 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972e968-3e5f-4639-baf6-3611d7f2e36a None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:05.193334 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972e968-3e5f-4639-baf6-3611d7f2e36a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:15:05.193754 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972e968-3e5f-4639-baf6-3611d7f2e36a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:05.195338 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972e968-3e5f-4639-baf6-3611d7f2e36a None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:05.209885 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 632/1257] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:15:05.215737 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9153ae88-6098-407f-917c-b3e5583e69c0 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:05.327171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9153ae88-6098-407f-917c-b3e5583e69c0 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:05.366814 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4ef71-9150-4484-8b7c-0d5ea4867af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:05.367467 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4ef71-9150-4484-8b7c-0d5ea4867af9 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:05.367747 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4ef71-9150-4484-8b7c-0d5ea4867af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:05.368047 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a4ef71-9150-4484-8b7c-0d5ea4867af9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:05.376172 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4ef71-9150-4484-8b7c-0d5ea4867af9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:05.377664 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a4ef71-9150-4484-8b7c-0d5ea4867af9 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:05.390006 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-29a4ef71-9150-4484-8b7c-0d5ea4867af9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:15:05.390006 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:15:05.390006 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:15:05.390006 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:15:05.390006 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:15:05.390006 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:15:05.390006 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:15:05.390006 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:15:05.390006 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:15:05.390006 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:15:05.390006 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:15:05.390006 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:15:05.390006 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:15:05.390006 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:15:05.390006 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:15:05.391534 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:15:05.391534 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:15:05.391534 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:15:05.391534 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:15:05.391534 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:15:05.391534 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:15:05.391534 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:15:05.391534 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:15:05.391534 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:15:05.391534 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:15:05.391534 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:15:05.391534 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:15:05.391534 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:15:05.391534 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:15:05.391534 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:15:05.391534 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:15:05.391534 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:15:05.392484 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:15:05.392484 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:15:05.392484 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:15:05.392484 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:15:05.392484 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:15:05.392484 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:15:05.392484 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:15:05.392484 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:15:05.392484 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 626/1258] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:15:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:15:05.397888 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972e968-3e5f-4639-baf6-3611d7f2e36a None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:05.503400 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972e968-3e5f-4639-baf6-3611d7f2e36a None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:05.539348 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586f6bb-fd54-4015-9dee-9b228517f563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:05.539968 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586f6bb-fd54-4015-9dee-9b228517f563 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:05.540351 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586f6bb-fd54-4015-9dee-9b228517f563 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:05.540624 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586f6bb-fd54-4015-9dee-9b228517f563 None admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:05.541383 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586f6bb-fd54-4015-9dee-9b228517f563 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:15:05.541692 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586f6bb-fd54-4015-9dee-9b228517f563 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:05.543133 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4586f6bb-fd54-4015-9dee-9b228517f563 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:05.556794 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 633/1259] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jul 27 15:15:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:15:05.563665 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4ef71-9150-4484-8b7c-0d5ea4867af9 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:05.591663 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:05.675057 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a4ef71-9150-4484-8b7c-0d5ea4867af9 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:05.708198 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a50a7b-549f-47e7-a832-93677c7542c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:05.708808 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a50a7b-549f-47e7-a832-93677c7542c8 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:05.709087 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a50a7b-549f-47e7-a832-93677c7542c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:05.709355 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a50a7b-549f-47e7-a832-93677c7542c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:05.710128 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a50a7b-549f-47e7-a832-93677c7542c8 None admin] RBAC: Adding query filter params (role.id=6535f8b98008471dba33e89bd460880d, scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5, user.id=a386d326dc634cbd943ac30f6e8d08bc) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:15:05.710435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a50a7b-549f-47e7-a832-93677c7542c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:05.711847 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a50a7b-549f-47e7-a832-93677c7542c8 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:05.717456 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 627/1260] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:15:05 2022] GET /identity/v3/role_assignments?user.id=a386d326dc634cbd943ac30f6e8d08bc&scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5&role.id=6535f8b98008471dba33e89bd460880d => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:15:07.678008 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd5eb7-e111-4cc2-8a10-1da47515a4bc None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:07.678516 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd5eb7-e111-4cc2-8a10-1da47515a4bc None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:07.678607 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd5eb7-e111-4cc2-8a10-1da47515a4bc None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:07.679893 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 634/1261] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:15:07.684991 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef8ee9-bd98-4387-81b5-d34d98bb73f0 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:07.685395 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef8ee9-bd98-4387-81b5-d34d98bb73f0 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:07.685544 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edef8ee9-bd98-4387-81b5-d34d98bb73f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:07.704046 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-edef8ee9-bd98-4387-81b5-d34d98bb73f0 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:15:07.705243 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-edef8ee9-bd98-4387-81b5-d34d98bb73f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:15:07.769345 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 628/1262] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:15:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:15:07.791336 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd5eb7-e111-4cc2-8a10-1da47515a4bc None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:07.802449 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:07.889721 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd5eb7-e111-4cc2-8a10-1da47515a4bc None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:07.921894 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed137afe-ca20-420a-8e56-ee7e8c0daa66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:07.922507 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed137afe-ca20-420a-8e56-ee7e8c0daa66 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:07.922786 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed137afe-ca20-420a-8e56-ee7e8c0daa66 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:07.923057 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed137afe-ca20-420a-8e56-ee7e8c0daa66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:07.932660 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed137afe-ca20-420a-8e56-ee7e8c0daa66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:15:07.938055 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-ed137afe-ca20-420a-8e56-ee7e8c0daa66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:15:07.938055 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:15:07.938055 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:15:07.938055 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:15:07.938055 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:15:07.938055 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:15:07.938055 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:15:07.938055 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:15:07.938055 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:15:07.938055 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:15:07.938055 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:15:07.938055 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:15:07.938055 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:15:07.938055 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:15:07.938055 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:15:07.938055 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:15:07.939173 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:15:07.939173 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:15:07.939173 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:15:07.939173 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:15:07.939173 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:15:07.939173 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:15:07.939173 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:15:07.939173 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:15:07.939173 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:15:07.939173 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:15:07.939173 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:15:07.939173 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:15:07.939173 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:15:07.939173 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:15:07.939173 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:15:07.939173 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:15:07.940203 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:15:07.940203 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:15:07.940203 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:15:07.940203 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:15:07.940203 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:15:07.940203 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:15:07.940203 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:15:07.940203 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:15:07.940203 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:15:07.940203 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:15:07.940203 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:15:07.940203 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:15:07.940203 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 635/1263] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jul 27 15:15:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:15:07.945075 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef8ee9-bd98-4387-81b5-d34d98bb73f0 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:07.962789 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:08.042670 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edef8ee9-bd98-4387-81b5-d34d98bb73f0 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:08.075816 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850b196-e910-4270-8bd4-407c5b3a5444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:08.076451 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850b196-e910-4270-8bd4-407c5b3a5444 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:08.076735 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850b196-e910-4270-8bd4-407c5b3a5444 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:08.077012 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1850b196-e910-4270-8bd4-407c5b3a5444 None admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:08.077744 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1850b196-e910-4270-8bd4-407c5b3a5444 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:15:08.078050 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1850b196-e910-4270-8bd4-407c5b3a5444 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:08.079402 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1850b196-e910-4270-8bd4-407c5b3a5444 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:08.087141 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 629/1264] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:15:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:15:08.092836 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed137afe-ca20-420a-8e56-ee7e8c0daa66 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:08.157836 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:08.190105 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed137afe-ca20-420a-8e56-ee7e8c0daa66 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:08.224550 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65e103-f5b5-49ae-a900-8df423b23993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:08.225627 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65e103-f5b5-49ae-a900-8df423b23993 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:08.225961 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65e103-f5b5-49ae-a900-8df423b23993 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:08.226238 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65e103-f5b5-49ae-a900-8df423b23993 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:08.237092 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65e103-f5b5-49ae-a900-8df423b23993 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:08.238533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65e103-f5b5-49ae-a900-8df423b23993 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:08.260446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-5c65e103-f5b5-49ae-a900-8df423b23993 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:15:08.260446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:15:08.260446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:15:08.260446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:15:08.260446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:15:08.260446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:15:08.260446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:15:08.260446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:15:08.260446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:15:08.260446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:15:08.260446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:15:08.260446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:15:08.260446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:15:08.260446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:15:08.260446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:15:08.261493 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:15:08.261493 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:15:08.261493 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:15:08.261493 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:15:08.261493 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:15:08.261493 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:15:08.261493 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:15:08.261493 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:15:08.261493 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:15:08.261493 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:15:08.261493 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:15:08.261493 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:15:08.261493 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:15:08.261493 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:15:08.261493 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:15:08.261493 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:15:08.261493 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:15:08.267965 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:15:08.267965 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:15:08.267965 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:15:08.267965 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:15:08.267965 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 636/1265] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:15:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:15:08.268329 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850b196-e910-4270-8bd4-407c5b3a5444 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:08.368753 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:08.389826 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1850b196-e910-4270-8bd4-407c5b3a5444 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:08.423226 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64d26d-da95-4ea5-aaff-18a545220702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:08.423765 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64d26d-da95-4ea5-aaff-18a545220702 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:08.424067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64d26d-da95-4ea5-aaff-18a545220702 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:08.424337 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64d26d-da95-4ea5-aaff-18a545220702 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:08.425016 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64d26d-da95-4ea5-aaff-18a545220702 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:15:08.425316 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64d26d-da95-4ea5-aaff-18a545220702 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:08.426656 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64d26d-da95-4ea5-aaff-18a545220702 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:08.438422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 630/1266] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:15:08.444133 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65e103-f5b5-49ae-a900-8df423b23993 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:08.540613 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65e103-f5b5-49ae-a900-8df423b23993 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:08.559911 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:08.584715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1323a-0be8-49e8-9b64-ccd7d23ffb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:08.585392 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1323a-0be8-49e8-9b64-ccd7d23ffb15 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:08.585677 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1323a-0be8-49e8-9b64-ccd7d23ffb15 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:08.585950 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1323a-0be8-49e8-9b64-ccd7d23ffb15 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:08.598738 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c1323a-0be8-49e8-9b64-ccd7d23ffb15 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:08.600229 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c1323a-0be8-49e8-9b64-ccd7d23ffb15 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:08.612022 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-d5c1323a-0be8-49e8-9b64-ccd7d23ffb15 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 15:15:08.612022 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:15:08.612022 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:15:08.612022 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:15:08.612022 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:15:08.612022 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:15:08.612022 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:15:08.612022 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:15:08.612022 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:15:08.612022 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:15:08.612022 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:15:08.612022 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:15:08.612022 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:15:08.612022 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:15:08.612022 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:15:08.612022 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:15:08.613130 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:15:08.613130 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:15:08.613130 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:15:08.613130 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:15:08.613130 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:15:08.613130 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:15:08.613130 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:15:08.613130 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:15:08.613130 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:15:08.613130 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:15:08.613130 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:15:08.613130 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:15:08.613130 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:15:08.613130 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:15:08.613130 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:15:08.613130 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:15:08.613130 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:15:08.613130 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:15:08.614104 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:15:08.614104 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:15:08.614104 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:15:08.614104 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:15:08.614104 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:15:08.614104 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:15:08.614104 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:15:08.614104 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:15:08.614104 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 15:15:08.614104 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:15:08.614104 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 637/1267] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:15:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:15:08.618886 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64d26d-da95-4ea5-aaff-18a545220702 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:08.714613 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64d26d-da95-4ea5-aaff-18a545220702 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:08.747487 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1ec5f-70b2-4656-8065-131fe01e808c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:08.748100 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1ec5f-70b2-4656-8065-131fe01e808c None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:08.748397 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1ec5f-70b2-4656-8065-131fe01e808c None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:08.748650 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1ec5f-70b2-4656-8065-131fe01e808c None admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:08.750059 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1ec5f-70b2-4656-8065-131fe01e808c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:15:08.750362 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1ec5f-70b2-4656-8065-131fe01e808c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:08.751769 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e1ec5f-70b2-4656-8065-131fe01e808c None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:08.759946 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:08.768278 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 631/1268] 10.222.0.40 () {56 vars in 1143 bytes} [Wed Jul 27 15:15:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:15:08.773827 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1323a-0be8-49e8-9b64-ccd7d23ffb15 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:08.871142 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1323a-0be8-49e8-9b64-ccd7d23ffb15 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:08.903206 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a53d6-ea40-4a42-b51c-b2801387915b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:08.903826 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a53d6-ea40-4a42-b51c-b2801387915b None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:08.904138 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a53d6-ea40-4a42-b51c-b2801387915b None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:08.904411 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a53d6-ea40-4a42-b51c-b2801387915b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:08.915579 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143a53d6-ea40-4a42-b51c-b2801387915b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:08.917057 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143a53d6-ea40-4a42-b51c-b2801387915b None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:08.932075 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-143a53d6-ea40-4a42-b51c-b2801387915b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:15:08.932075 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:15:08.932075 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:15:08.932075 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:15:08.932075 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:15:08.932075 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:15:08.932075 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:15:08.932075 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:15:08.932075 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:15:08.932075 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:15:08.932075 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:15:08.932075 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:15:08.932075 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:15:08.932075 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:15:08.932075 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:15:08.933211 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:15:08.933211 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:15:08.933211 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:15:08.933211 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:15:08.933211 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:15:08.933211 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:15:08.933211 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:15:08.933211 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:15:08.933211 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:15:08.933211 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:15:08.933211 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:15:08.933211 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:15:08.933211 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:15:08.933211 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:15:08.933211 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:15:08.933211 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:15:08.933211 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:15:08.934206 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:15:08.934206 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:15:08.934206 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:15:08.934206 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:15:08.934206 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 638/1269] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:15:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:15:08.939103 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1ec5f-70b2-4656-8065-131fe01e808c None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:09.043169 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1ec5f-70b2-4656-8065-131fe01e808c None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:09.076481 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d463182-68b1-4594-ad3b-392a7b791b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:09.077089 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d463182-68b1-4594-ad3b-392a7b791b60 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:09.077372 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d463182-68b1-4594-ad3b-392a7b791b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:09.077676 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d463182-68b1-4594-ad3b-392a7b791b60 None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:09.078361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d463182-68b1-4594-ad3b-392a7b791b60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:15:09.078666 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d463182-68b1-4594-ad3b-392a7b791b60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:09.080049 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d463182-68b1-4594-ad3b-392a7b791b60 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:09.090914 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 632/1270] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:15:09.097042 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a53d6-ea40-4a42-b51c-b2801387915b None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:09.128005 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:09.194104 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a53d6-ea40-4a42-b51c-b2801387915b None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:09.231523 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163de7e0-6c10-41c0-9aa4-b86338d64767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:09.232178 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163de7e0-6c10-41c0-9aa4-b86338d64767 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:09.232462 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163de7e0-6c10-41c0-9aa4-b86338d64767 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:09.232734 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163de7e0-6c10-41c0-9aa4-b86338d64767 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:09.239272 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163de7e0-6c10-41c0-9aa4-b86338d64767 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:09.240717 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163de7e0-6c10-41c0-9aa4-b86338d64767 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:09.251713 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-163de7e0-6c10-41c0-9aa4-b86338d64767 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:15:09.251713 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:15:09.251713 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:15:09.251713 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:15:09.251713 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:15:09.251713 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:15:09.251713 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:15:09.251713 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:15:09.251713 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:15:09.251713 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:15:09.251713 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:15:09.251713 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:15:09.251713 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:15:09.251713 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:15:09.251713 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:15:09.252744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:15:09.252744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:15:09.252744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:15:09.252744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:15:09.252744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:15:09.252744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:15:09.252744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:15:09.252744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:15:09.252744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:15:09.252744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:15:09.252744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:15:09.252744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:15:09.252744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:15:09.252744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:15:09.252744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:15:09.252744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:15:09.252744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:15:09.253840 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:15:09.253840 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:15:09.253840 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:15:09.253840 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:15:09.253840 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:15:09.253840 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:15:09.253840 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:15:09.253840 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:15:09.253840 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 639/1271] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:15:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 15:15:09.258567 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d463182-68b1-4594-ad3b-392a7b791b60 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:09.321655 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:09.368272 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d463182-68b1-4594-ad3b-392a7b791b60 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:09.401096 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba804a16-30af-4fbd-8093-3ccca3000f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:09.401698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba804a16-30af-4fbd-8093-3ccca3000f5d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:09.401986 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba804a16-30af-4fbd-8093-3ccca3000f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:09.402261 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba804a16-30af-4fbd-8093-3ccca3000f5d None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:09.403000 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba804a16-30af-4fbd-8093-3ccca3000f5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:15:09.403307 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba804a16-30af-4fbd-8093-3ccca3000f5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:09.404743 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba804a16-30af-4fbd-8093-3ccca3000f5d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:09.416610 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 633/1272] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jul 27 15:15:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:15:09.423112 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163de7e0-6c10-41c0-9aa4-b86338d64767 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:09.511205 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:09.520250 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163de7e0-6c10-41c0-9aa4-b86338d64767 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:09.552725 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b14b340-3912-4bf2-8520-67004e6c2092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:09.553368 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14b340-3912-4bf2-8520-67004e6c2092 None admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:09.553651 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14b340-3912-4bf2-8520-67004e6c2092 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:09.553926 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b14b340-3912-4bf2-8520-67004e6c2092 None admin] PATH_INFO: `/v3/projects/0b616213eaea4a22afee15d4cbe5a3c5/users/a386d326dc634cbd943ac30f6e8d08bc/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:09.555821 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b14b340-3912-4bf2-8520-67004e6c2092 None admin] RBAC: Authorizing `identity:create_grant(project_id=0b616213eaea4a22afee15d4cbe5a3c5, user_id=a386d326dc634cbd943ac30f6e8d08bc, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:09.557249 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b14b340-3912-4bf2-8520-67004e6c2092 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:09.569781 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 640/1273] 10.222.0.40 () {58 vars in 1439 bytes} [Wed Jul 27 15:15:09 2022] PUT /identity/v3/projects/0b616213eaea4a22afee15d4cbe5a3c5/users/a386d326dc634cbd943ac30f6e8d08bc/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:15:11.551020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3250b-72ed-4807-a071-e91c9a06d8cb None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:11.551549 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3250b-72ed-4807-a071-e91c9a06d8cb None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:11.551549 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf3250b-72ed-4807-a071-e91c9a06d8cb None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:11.552941 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 634/1274] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:15:11.559096 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65904471-8a01-46cb-be17-c1c514e01cd2 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:11.559494 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65904471-8a01-46cb-be17-c1c514e01cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:11.559655 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65904471-8a01-46cb-be17-c1c514e01cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:11.578383 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-65904471-8a01-46cb-be17-c1c514e01cd2 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:15:11.579565 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-65904471-8a01-46cb-be17-c1c514e01cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:15:11.643956 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 641/1275] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:15:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:15:11.667017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3250b-72ed-4807-a071-e91c9a06d8cb None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:11.764741 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf3250b-72ed-4807-a071-e91c9a06d8cb None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:11.781011 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:11.797944 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61834f-e26f-4084-a9ee-37c5b4a2f395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:11.798563 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61834f-e26f-4084-a9ee-37c5b4a2f395 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:11.798845 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61834f-e26f-4084-a9ee-37c5b4a2f395 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:11.799119 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61834f-e26f-4084-a9ee-37c5b4a2f395 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:11.808894 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f61834f-e26f-4084-a9ee-37c5b4a2f395 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 15:15:11.814441 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-5f61834f-e26f-4084-a9ee-37c5b4a2f395 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:15:11.814441 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:15:11.814441 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:15:11.814441 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:15:11.814441 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:15:11.814441 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:15:11.814441 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:15:11.814441 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:15:11.814441 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:15:11.814441 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:15:11.814441 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:15:11.814441 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:15:11.814441 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 15:15:11.814441 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 15:15:11.814441 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 15:15:11.814441 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 15:15:11.815361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 15:15:11.815361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 15:15:11.815361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 15:15:11.815361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 15:15:11.815361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:15:11.815361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:15:11.815361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:15:11.815361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:15:11.815361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:15:11.815361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:15:11.815361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:15:11.815361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:15:11.815361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:15:11.815361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:15:11.815361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:15:11.815361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:15:11.816248 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:15:11.816248 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:15:11.816248 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:15:11.816248 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:15:11.816248 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 15:15:11.816248 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 15:15:11.816248 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 15:15:11.816248 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 15:15:11.816248 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 15:15:11.816248 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 15:15:11.816248 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 15:15:11.816248 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:15:11.816248 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 635/1276] 10.222.0.40 () {56 vars in 1096 bytes} [Wed Jul 27 15:15:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:15:11.821660 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65904471-8a01-46cb-be17-c1c514e01cd2 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:11.898620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:11.917080 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65904471-8a01-46cb-be17-c1c514e01cd2 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:11.949676 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae8cfa-c163-4d54-a5c9-8be4713769df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:11.950273 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae8cfa-c163-4d54-a5c9-8be4713769df None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:11.950552 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae8cfa-c163-4d54-a5c9-8be4713769df None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:11.950821 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae8cfa-c163-4d54-a5c9-8be4713769df None admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:11.951522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae8cfa-c163-4d54-a5c9-8be4713769df None admin] RBAC: Adding query filter params (name=admin) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:15:11.951822 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae8cfa-c163-4d54-a5c9-8be4713769df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:11.953223 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae8cfa-c163-4d54-a5c9-8be4713769df None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:11.960972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 642/1277] 10.222.0.40 () {56 vars in 1099 bytes} [Wed Jul 27 15:15:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:15:11.966536 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61834f-e26f-4084-a9ee-37c5b4a2f395 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:12.063585 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61834f-e26f-4084-a9ee-37c5b4a2f395 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:12.095858 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea9679-a304-4dbd-8d67-4c4a90cb65f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:12.096498 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea9679-a304-4dbd-8d67-4c4a90cb65f6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:12.096780 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea9679-a304-4dbd-8d67-4c4a90cb65f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:12.097050 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea9679-a304-4dbd-8d67-4c4a90cb65f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:12.106621 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea9679-a304-4dbd-8d67-4c4a90cb65f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:12.108084 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fea9679-a304-4dbd-8d67-4c4a90cb65f6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:12.123396 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-9fea9679-a304-4dbd-8d67-4c4a90cb65f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:15:12.123396 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:15:12.123396 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:15:12.123396 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:15:12.123396 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:15:12.123396 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:15:12.123396 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:15:12.123396 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:15:12.123396 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:15:12.123396 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:15:12.123396 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:15:12.123396 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:15:12.123396 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:15:12.123396 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:15:12.123396 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:15:12.124422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:15:12.124422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:15:12.124422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:15:12.124422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:15:12.124422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:15:12.124422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:15:12.124422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:15:12.124422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:15:12.124422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:15:12.124422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:15:12.124422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:15:12.124422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:15:12.124422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:15:12.124422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:15:12.124422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:15:12.124422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:15:12.124422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:15:12.125686 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:15:12.125686 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:15:12.125686 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:15:12.125686 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:15:12.125686 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 636/1278] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:15:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:15:12.130119 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae8cfa-c163-4d54-a5c9-8be4713769df None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:12.229074 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae8cfa-c163-4d54-a5c9-8be4713769df None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:12.261100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb260b-da76-4f04-8260-5d8c448888ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:12.261697 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb260b-da76-4f04-8260-5d8c448888ed None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:12.261980 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb260b-da76-4f04-8260-5d8c448888ed None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:12.262255 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cb260b-da76-4f04-8260-5d8c448888ed None admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:12.262941 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb260b-da76-4f04-8260-5d8c448888ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:15:12.263246 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb260b-da76-4f04-8260-5d8c448888ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:12.264624 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cb260b-da76-4f04-8260-5d8c448888ed None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:12.276414 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 643/1279] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:15:12.282607 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea9679-a304-4dbd-8d67-4c4a90cb65f6 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:12.313201 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:12.392282 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea9679-a304-4dbd-8d67-4c4a90cb65f6 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:12.425347 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433e14f-9925-4239-93af-3efecab72177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:12.425975 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433e14f-9925-4239-93af-3efecab72177 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:12.426260 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433e14f-9925-4239-93af-3efecab72177 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:12.426534 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b433e14f-9925-4239-93af-3efecab72177 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:12.433669 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b433e14f-9925-4239-93af-3efecab72177 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:12.435098 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b433e14f-9925-4239-93af-3efecab72177 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:12.446593 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-b433e14f-9925-4239-93af-3efecab72177 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 15:15:12.446593 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:15:12.446593 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:15:12.446593 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:15:12.446593 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:15:12.446593 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:15:12.446593 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:15:12.446593 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:15:12.446593 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:15:12.446593 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:15:12.446593 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:15:12.446593 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:15:12.446593 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 15:15:12.446593 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 15:15:12.446593 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 15:15:12.446593 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 15:15:12.447782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:15:12.447782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:15:12.447782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 15:15:12.447782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:15:12.447782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 15:15:12.447782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 15:15:12.447782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:15:12.447782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:15:12.447782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:15:12.447782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:15:12.447782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:15:12.447782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:15:12.447782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:15:12.447782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:15:12.447782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:15:12.447782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:15:12.447782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:15:12.447782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:15:12.449122 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:15:12.449122 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:15:12.449122 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 15:15:12.449122 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 15:15:12.449122 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 15:15:12.449122 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 15:15:12.449122 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 15:15:12.449122 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 15:15:12.449122 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 15:15:12.449122 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:15:12.449122 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 637/1280] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:15:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:15:12.453568 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb260b-da76-4f04-8260-5d8c448888ed None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:12.457302 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:12.550492 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cb260b-da76-4f04-8260-5d8c448888ed None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:12.583490 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e45413-24d4-482f-a84e-d09b12044aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:12.584125 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e45413-24d4-482f-a84e-d09b12044aac None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:12.584407 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e45413-24d4-482f-a84e-d09b12044aac None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:12.584682 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e45413-24d4-482f-a84e-d09b12044aac None admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:12.585477 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e45413-24d4-482f-a84e-d09b12044aac None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:15:12.585784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e45413-24d4-482f-a84e-d09b12044aac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:12.587191 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e45413-24d4-482f-a84e-d09b12044aac None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:12.604267 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 644/1281] 10.222.0.40 () {56 vars in 1143 bytes} [Wed Jul 27 15:15:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:15:12.610469 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433e14f-9925-4239-93af-3efecab72177 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:12.697771 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:12.707538 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b433e14f-9925-4239-93af-3efecab72177 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:12.740127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0bd465-8853-4308-887d-fef07615c5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:12.740720 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bd465-8853-4308-887d-fef07615c5ef None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:12.740994 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bd465-8853-4308-887d-fef07615c5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:12.741263 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0bd465-8853-4308-887d-fef07615c5ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:12.804438 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0bd465-8853-4308-887d-fef07615c5ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:12.805854 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0bd465-8853-4308-887d-fef07615c5ef None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:12.889911 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:12.899968 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 638/1282] 10.222.0.40 () {58 vars in 1282 bytes} [Wed Jul 27 15:15:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 15:15:12.906288 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e45413-24d4-482f-a84e-d09b12044aac None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:12.966472 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:13.004342 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e45413-24d4-482f-a84e-d09b12044aac None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:13.037606 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3402a3-a24e-423a-b19d-810b2cd4c25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:13.038228 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3402a3-a24e-423a-b19d-810b2cd4c25f None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:13.038778 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3402a3-a24e-423a-b19d-810b2cd4c25f None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:13.039051 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3402a3-a24e-423a-b19d-810b2cd4c25f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:13.048774 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3402a3-a24e-423a-b19d-810b2cd4c25f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:13.050217 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3402a3-a24e-423a-b19d-810b2cd4c25f None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:13.065172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-1b3402a3-a24e-423a-b19d-810b2cd4c25f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:15:13.065172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:15:13.065172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:15:13.065172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:15:13.065172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:15:13.065172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:15:13.065172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:15:13.065172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:15:13.065172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:15:13.065172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:15:13.065172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:15:13.065172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:15:13.065172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 15:15:13.065172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 15:15:13.065172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 15:15:13.066237 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 15:15:13.066237 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:15:13.066237 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:15:13.066237 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:15:13.066237 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:15:13.066237 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:15:13.066237 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:15:13.066237 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:15:13.066237 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:15:13.066237 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:15:13.066237 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:15:13.066237 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:15:13.066237 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:15:13.066237 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:15:13.066237 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:15:13.066237 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:15:13.066237 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:15:13.067398 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 15:15:13.067398 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 15:15:13.067398 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 15:15:13.067398 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:15:13.067398 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 645/1283] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:15:13.071897 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0bd465-8853-4308-887d-fef07615c5ef None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:13.168757 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0bd465-8853-4308-887d-fef07615c5ef None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:13.200223 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53476f1-53ff-4446-9ae8-abd9b983e92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:13.200820 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53476f1-53ff-4446-9ae8-abd9b983e92d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:13.201096 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53476f1-53ff-4446-9ae8-abd9b983e92d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:13.201368 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53476f1-53ff-4446-9ae8-abd9b983e92d None admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:13.202044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53476f1-53ff-4446-9ae8-abd9b983e92d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:15:13.202873 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53476f1-53ff-4446-9ae8-abd9b983e92d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:13.204237 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53476f1-53ff-4446-9ae8-abd9b983e92d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:13.214887 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 639/1284] 10.222.0.40 () {56 vars in 1109 bytes} [Wed Jul 27 15:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:15:13.221139 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3402a3-a24e-423a-b19d-810b2cd4c25f None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:13.322603 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3402a3-a24e-423a-b19d-810b2cd4c25f None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:13.337046 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:13.356400 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54c2b5-b61e-4eae-a2ed-619a485d549c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:13.357029 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54c2b5-b61e-4eae-a2ed-619a485d549c None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:13.357309 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54c2b5-b61e-4eae-a2ed-619a485d549c None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:13.357581 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54c2b5-b61e-4eae-a2ed-619a485d549c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:13.364004 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b54c2b5-b61e-4eae-a2ed-619a485d549c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:13.365432 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b54c2b5-b61e-4eae-a2ed-619a485d549c None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:13.376846 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application [None req-2b54c2b5-b61e-4eae-a2ed-619a485d549c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:15:13.376846 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:15:13.376846 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:15:13.376846 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:15:13.376846 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:15:13.376846 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:15:13.376846 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:15:13.376846 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:15:13.376846 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:15:13.376846 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:15:13.376846 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:15:13.376846 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:15:13.376846 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 15:15:13.376846 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 15:15:13.376846 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 15:15:13.377876 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 15:15:13.377876 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:15:13.377876 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:15:13.377876 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:15:13.377876 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:15:13.377876 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:15:13.377876 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:15:13.377876 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:15:13.377876 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application with Lock( Jul 27 15:15:13.377876 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:15:13.377876 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:15:13.377876 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:15:13.377876 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:15:13.377876 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:15:13.377876 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:15:13.377876 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:15:13.377876 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:15:13.378968 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 15:15:13.378968 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 15:15:13.378968 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 15:15:13.378968 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 15:15:13.378968 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 15:15:13.378968 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 15:15:13.378968 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 15:15:13.378968 dv-cinder-841315-2-smb devstack@keystone.service[80058]: ERROR keystone.server.flask.application Jul 27 15:15:13.378968 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 646/1285] 10.222.0.40 () {56 vars in 1111 bytes} [Wed Jul 27 15:15:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:15:13.383749 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53476f1-53ff-4446-9ae8-abd9b983e92d None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:13.432157 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:13.481203 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53476f1-53ff-4446-9ae8-abd9b983e92d None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:13.513345 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798968ae-cd3f-469f-978b-45ea6cc519be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:13.513947 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798968ae-cd3f-469f-978b-45ea6cc519be None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:13.514231 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798968ae-cd3f-469f-978b-45ea6cc519be None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:13.514506 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798968ae-cd3f-469f-978b-45ea6cc519be None admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:13.515859 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798968ae-cd3f-469f-978b-45ea6cc519be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:15:13.516196 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798968ae-cd3f-469f-978b-45ea6cc519be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:13.517605 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798968ae-cd3f-469f-978b-45ea6cc519be None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:13.529109 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 640/1286] 10.222.0.40 () {56 vars in 1148 bytes} [Wed Jul 27 15:15:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:15:13.535102 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54c2b5-b61e-4eae-a2ed-619a485d549c None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:13.632511 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54c2b5-b61e-4eae-a2ed-619a485d549c None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:13.665928 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248cfac-edd6-448e-9515-b14cf5705e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:13.666590 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248cfac-edd6-448e-9515-b14cf5705e81 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:13.666926 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248cfac-edd6-448e-9515-b14cf5705e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:13.667230 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248cfac-edd6-448e-9515-b14cf5705e81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:13.668034 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248cfac-edd6-448e-9515-b14cf5705e81 None admin] RBAC: Adding query filter params (role.id=6535f8b98008471dba33e89bd460880d, scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5, user.id=a386d326dc634cbd943ac30f6e8d08bc) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:15:13.668350 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248cfac-edd6-448e-9515-b14cf5705e81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:13.669767 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248cfac-edd6-448e-9515-b14cf5705e81 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:13.675931 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 647/1287] 10.222.0.40 () {56 vars in 1374 bytes} [Wed Jul 27 15:15:13 2022] GET /identity/v3/role_assignments?user.id=a386d326dc634cbd943ac30f6e8d08bc&scope.project.id=0b616213eaea4a22afee15d4cbe5a3c5&role.id=6535f8b98008471dba33e89bd460880d => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:15:15.656136 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065f84b-61a0-41e1-94db-655fe80a5fcf None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:15.656892 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065f84b-61a0-41e1-94db-655fe80a5fcf None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:15.656892 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6065f84b-61a0-41e1-94db-655fe80a5fcf None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:15.658087 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 641/1288] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:15:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:15:15.663077 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745962e2-f99a-4de7-bce3-20033dd08bb1 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:15.663757 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745962e2-f99a-4de7-bce3-20033dd08bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:15.663885 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745962e2-f99a-4de7-bce3-20033dd08bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:15.682090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-745962e2-f99a-4de7-bce3-20033dd08bb1 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:15:15.683257 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-745962e2-f99a-4de7-bce3-20033dd08bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:15:15.711336 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:15.748055 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 648/1289] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:15:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:15:15.774850 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065f84b-61a0-41e1-94db-655fe80a5fcf None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:15.882906 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6065f84b-61a0-41e1-94db-655fe80a5fcf None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:15.893061 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:15.915712 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52267a1-2c71-4a85-b652-be0830442e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:15.916364 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52267a1-2c71-4a85-b652-be0830442e42 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:15.916643 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52267a1-2c71-4a85-b652-be0830442e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:15.916915 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52267a1-2c71-4a85-b652-be0830442e42 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:15.917526 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52267a1-2c71-4a85-b652-be0830442e42 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:15.918877 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52267a1-2c71-4a85-b652-be0830442e42 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:15.927825 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-d52267a1-2c71-4a85-b652-be0830442e42 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 15:15:15.927825 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:15:15.927825 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 15:15:15.927825 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 15:15:15.927825 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 15:15:15.927825 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 15:15:15.927825 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 15:15:15.927825 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:15:15.927825 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 15:15:15.927825 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:15:15.927825 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 15:15:15.927825 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:15:15.927825 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:15:15.927825 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:15:15.927825 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:15:15.927825 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:15:15.927825 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:15:15.929084 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:15:15.929084 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:15:15.929084 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:15:15.929084 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:15:15.929084 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:15:15.929084 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:15:15.929084 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 15:15:15.929084 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 15:15:15.929084 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 15:15:15.929084 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 15:15:15.929084 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:15:15.929084 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:15:15.929084 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:15:15.929084 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:15:15.929084 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:15:15.929084 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:15:15.930022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:15:15.930022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:15:15.930022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:15:15.930022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:15:15.930022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:15:15.930022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:15:15.930022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:15:15.930022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:15:15.930022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:15:15.930022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:15:15.930022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 15:15:15.930022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:15:15.930022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 15:15:15.930022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:15:15.930022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 642/1290] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Jul 27 15:15:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:15:15.935026 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745962e2-f99a-4de7-bce3-20033dd08bb1 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:16.030066 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745962e2-f99a-4de7-bce3-20033dd08bb1 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:16.063861 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4cc7a3-1df9-4220-aa06-06402123bee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:16.064488 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cc7a3-1df9-4220-aa06-06402123bee8 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:16.064771 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cc7a3-1df9-4220-aa06-06402123bee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:16.065040 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4cc7a3-1df9-4220-aa06-06402123bee8 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:16.065702 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4cc7a3-1df9-4220-aa06-06402123bee8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:15:16.066004 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4cc7a3-1df9-4220-aa06-06402123bee8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:16.067344 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4cc7a3-1df9-4220-aa06-06402123bee8 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:16.071984 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 649/1291] 10.222.0.40 () {56 vars in 1116 bytes} [Wed Jul 27 15:15:15 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:15:16.077710 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52267a1-2c71-4a85-b652-be0830442e42 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:16.174180 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52267a1-2c71-4a85-b652-be0830442e42 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:16.205448 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a7a1c2-8a49-490e-911a-2389618afafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:16.206028 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7a1c2-8a49-490e-911a-2389618afafd None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:16.206306 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7a1c2-8a49-490e-911a-2389618afafd None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:16.206575 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a7a1c2-8a49-490e-911a-2389618afafd None admin] PATH_INFO: `/v3/services` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:16.207231 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7a1c2-8a49-490e-911a-2389618afafd None admin] RBAC: Adding query filter params (type=placement) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:15:16.207531 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7a1c2-8a49-490e-911a-2389618afafd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:16.208885 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a7a1c2-8a49-490e-911a-2389618afafd None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:16.213135 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 643/1292] 10.222.0.40 () {56 vars in 1116 bytes} [Wed Jul 27 15:15:16 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:15:18.192443 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc7ee8-fbc3-4f09-a60e-bd1308035410 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:18.193003 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc7ee8-fbc3-4f09-a60e-bd1308035410 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:18.193003 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc7ee8-fbc3-4f09-a60e-bd1308035410 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:18.194341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 650/1293] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:15:18.199300 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d193c51-2147-4619-aad7-305133a80282 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:18.199744 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d193c51-2147-4619-aad7-305133a80282 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:18.199838 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d193c51-2147-4619-aad7-305133a80282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:18.217432 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-8d193c51-2147-4619-aad7-305133a80282 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:15:18.219125 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8d193c51-2147-4619-aad7-305133a80282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:15:18.247318 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:18.282872 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 644/1294] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:15:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 15:15:18.305988 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc7ee8-fbc3-4f09-a60e-bd1308035410 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:18.344049 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:18.420699 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc7ee8-fbc3-4f09-a60e-bd1308035410 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:18.453171 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92149ebd-c10e-4b41-a7b2-48b1da2201f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:18.453714 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92149ebd-c10e-4b41-a7b2-48b1da2201f2 None admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:18.453993 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92149ebd-c10e-4b41-a7b2-48b1da2201f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:18.454263 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92149ebd-c10e-4b41-a7b2-48b1da2201f2 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:18.454942 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92149ebd-c10e-4b41-a7b2-48b1da2201f2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:18.456349 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92149ebd-c10e-4b41-a7b2-48b1da2201f2 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:18.470590 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 651/1295] 10.222.0.40 () {60 vars in 1141 bytes} [Wed Jul 27 15:15:18 2022] POST /identity/v3/services => generated 246 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:15:20.474708 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc47419-b28a-4011-89c8-b573fcd81d8f None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:20.475282 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc47419-b28a-4011-89c8-b573fcd81d8f None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:20.475282 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc47419-b28a-4011-89c8-b573fcd81d8f None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:20.476644 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 645/1296] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:15:20.481786 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f599a-300b-45b7-9ec1-0d88fff33190 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:20.482150 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f599a-300b-45b7-9ec1-0d88fff33190 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:20.482336 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858f599a-300b-45b7-9ec1-0d88fff33190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:20.501069 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-858f599a-300b-45b7-9ec1-0d88fff33190 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:15:20.502233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-858f599a-300b-45b7-9ec1-0d88fff33190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:15:20.578109 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 652/1297] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:15:20 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:15:20.600839 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc47419-b28a-4011-89c8-b573fcd81d8f None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:20.697143 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc47419-b28a-4011-89c8-b573fcd81d8f None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:20.729690 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db613f-e606-4763-a081-9ae40e89a4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:20.730250 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db613f-e606-4763-a081-9ae40e89a4a6 None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:20.730527 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db613f-e606-4763-a081-9ae40e89a4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:20.730800 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db613f-e606-4763-a081-9ae40e89a4a6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:20.731409 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db613f-e606-4763-a081-9ae40e89a4a6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:20.732781 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db613f-e606-4763-a081-9ae40e89a4a6 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:20.741358 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-43db613f-e606-4763-a081-9ae40e89a4a6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 15:15:20.741358 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:15:20.741358 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 15:15:20.741358 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 15:15:20.741358 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 15:15:20.741358 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 15:15:20.741358 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 15:15:20.741358 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:15:20.741358 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 15:15:20.741358 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:15:20.741358 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 15:15:20.741358 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:15:20.741358 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:15:20.741358 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:15:20.741358 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:15:20.741358 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:15:20.741358 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:15:20.742516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:15:20.742516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:15:20.742516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:15:20.742516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:15:20.742516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:15:20.742516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:15:20.742516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 15:15:20.742516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 15:15:20.742516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 15:15:20.742516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 15:15:20.742516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:15:20.742516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:15:20.742516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:15:20.742516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:15:20.742516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:15:20.742516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:15:20.743400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:15:20.743400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:15:20.743400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:15:20.743400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:15:20.743400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:15:20.743400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:15:20.743400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:15:20.743400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:15:20.743400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:15:20.743400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:15:20.743400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 15:15:20.743400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:15:20.743400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 15:15:20.743400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:15:20.743400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 646/1298] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Jul 27 15:15:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 142 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:15:20.748377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f599a-300b-45b7-9ec1-0d88fff33190 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:20.767078 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:20.845581 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858f599a-300b-45b7-9ec1-0d88fff33190 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:20.878569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55d371-d39c-4425-a5f3-634bb10f8199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:20.879165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55d371-d39c-4425-a5f3-634bb10f8199 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:20.879444 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55d371-d39c-4425-a5f3-634bb10f8199 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:20.879715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f55d371-d39c-4425-a5f3-634bb10f8199 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:20.880414 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55d371-d39c-4425-a5f3-634bb10f8199 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:15:20.880718 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55d371-d39c-4425-a5f3-634bb10f8199 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:20.882059 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f55d371-d39c-4425-a5f3-634bb10f8199 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:20.886989 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 653/1299] 10.222.0.40 () {56 vars in 1116 bytes} [Wed Jul 27 15:15:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:15:20.892907 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db613f-e606-4763-a081-9ae40e89a4a6 None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:20.924225 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:20.991438 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db613f-e606-4763-a081-9ae40e89a4a6 None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:21.023751 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb58311-beb3-4bd1-90f5-8be3838e017d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:21.024381 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb58311-beb3-4bd1-90f5-8be3838e017d None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:21.024666 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb58311-beb3-4bd1-90f5-8be3838e017d None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:21.024940 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb58311-beb3-4bd1-90f5-8be3838e017d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:21.025686 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb58311-beb3-4bd1-90f5-8be3838e017d None admin] RBAC: Adding query filter params (interface=public, service_id=4b2a6c7a401e4a3c885816fbc364b1e1, region_id=RegionOne) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:15:21.025996 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb58311-beb3-4bd1-90f5-8be3838e017d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:21.027354 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb58311-beb3-4bd1-90f5-8be3838e017d None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:21.032358 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 647/1300] 10.222.0.40 () {56 vars in 1251 bytes} [Wed Jul 27 15:15:20 2022] GET /identity/v3/endpoints?service_id=4b2a6c7a401e4a3c885816fbc364b1e1&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:15:21.037808 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55d371-d39c-4425-a5f3-634bb10f8199 None admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:21.116723 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:21.135131 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f55d371-d39c-4425-a5f3-634bb10f8199 None admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:21.173351 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e660ac-5699-4bc3-ae91-e9cd93557253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:21.173947 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e660ac-5699-4bc3-ae91-e9cd93557253 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:21.174225 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e660ac-5699-4bc3-ae91-e9cd93557253 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:21.174495 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e660ac-5699-4bc3-ae91-e9cd93557253 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:21.175138 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e660ac-5699-4bc3-ae91-e9cd93557253 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:21.176517 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e660ac-5699-4bc3-ae91-e9cd93557253 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:21.183054 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 654/1301] 10.222.0.40 () {56 vars in 1087 bytes} [Wed Jul 27 15:15:21 2022] GET /identity/v3/services => generated 2191 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:15:23.131068 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce667661-f4da-42a9-ad45-e57c00dfdd31 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:23.131614 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce667661-f4da-42a9-ad45-e57c00dfdd31 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:23.131614 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce667661-f4da-42a9-ad45-e57c00dfdd31 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:23.132982 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 648/1302] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:15:23.138027 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43814884-3c52-4748-8ad9-18e75264b217 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:23.138439 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43814884-3c52-4748-8ad9-18e75264b217 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:23.138574 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43814884-3c52-4748-8ad9-18e75264b217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:23.156434 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-43814884-3c52-4748-8ad9-18e75264b217 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:15:23.158004 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-43814884-3c52-4748-8ad9-18e75264b217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:15:23.225717 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 655/1303] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:15:23 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 15:15:23.248131 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce667661-f4da-42a9-ad45-e57c00dfdd31 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:23.349082 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:23.356585 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce667661-f4da-42a9-ad45-e57c00dfdd31 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:23.389982 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21155eec-b269-470d-8e56-5c939108a5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:23.390548 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21155eec-b269-470d-8e56-5c939108a5ca None admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:23.390824 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21155eec-b269-470d-8e56-5c939108a5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:23.391094 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21155eec-b269-470d-8e56-5c939108a5ca None admin] PATH_INFO: `/v3/services/placement` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:23.391703 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21155eec-b269-470d-8e56-5c939108a5ca None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:23.393094 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21155eec-b269-470d-8e56-5c939108a5ca None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:23.401622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application [None req-21155eec-b269-470d-8e56-5c939108a5ca None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 15:15:23.401622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:15:23.401622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 15:15:23.401622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 15:15:23.401622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 15:15:23.401622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 15:15:23.401622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 15:15:23.401622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:15:23.401622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 15:15:23.401622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:15:23.401622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 15:15:23.401622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:15:23.401622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 15:15:23.401622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 15:15:23.401622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 15:15:23.401622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 15:15:23.401622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 15:15:23.402772 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 15:15:23.402772 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 15:15:23.402772 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 15:15:23.402772 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 15:15:23.402772 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 15:15:23.402772 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 15:15:23.402772 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 15:15:23.402772 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 15:15:23.402772 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 15:15:23.402772 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 15:15:23.402772 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 15:15:23.402772 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 15:15:23.402772 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 15:15:23.402772 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 15:15:23.402772 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 15:15:23.402772 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 15:15:23.404024 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 15:15:23.404024 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application with Lock( Jul 27 15:15:23.404024 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 15:15:23.404024 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self._enter() Jul 27 15:15:23.404024 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 15:15:23.404024 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 15:15:23.404024 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 15:15:23.404024 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application return self.creator() Jul 27 15:15:23.404024 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 15:15:23.404024 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application created_value = creator( Jul 27 15:15:23.404024 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 15:15:23.404024 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 15:15:23.404024 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 15:15:23.404024 dv-cinder-841315-2-smb devstack@keystone.service[80057]: ERROR keystone.server.flask.application Jul 27 15:15:23.404024 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 649/1304] 10.222.0.40 () {56 vars in 1117 bytes} [Wed Jul 27 15:15:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 15:15:23.408778 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43814884-3c52-4748-8ad9-18e75264b217 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:23.481344 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:23.503687 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43814884-3c52-4748-8ad9-18e75264b217 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:23.535917 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b96c3b-5c67-447a-8d7f-d20582c8b4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:23.536537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b96c3b-5c67-447a-8d7f-d20582c8b4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:23.536821 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b96c3b-5c67-447a-8d7f-d20582c8b4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:23.537090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b96c3b-5c67-447a-8d7f-d20582c8b4a0 None admin] PATH_INFO: `/v3/services` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:23.537750 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b96c3b-5c67-447a-8d7f-d20582c8b4a0 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:15:23.538048 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b96c3b-5c67-447a-8d7f-d20582c8b4a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:23.539643 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b96c3b-5c67-447a-8d7f-d20582c8b4a0 None admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:23.544569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 656/1305] 10.222.0.40 () {56 vars in 1116 bytes} [Wed Jul 27 15:15:23 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:15:23.550873 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21155eec-b269-470d-8e56-5c939108a5ca None admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:15:23.659806 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21155eec-b269-470d-8e56-5c939108a5ca None admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:15:23.693162 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b269c37-4d57-4224-929a-b7d98a041080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:15:23.693770 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b269c37-4d57-4224-929a-b7d98a041080 None admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:15:23.694052 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b269c37-4d57-4224-929a-b7d98a041080 None admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:15:23.694326 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b269c37-4d57-4224-929a-b7d98a041080 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:15:23.695029 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b269c37-4d57-4224-929a-b7d98a041080 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:15:23.696430 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b269c37-4d57-4224-929a-b7d98a041080 None admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:15:23.714890 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 650/1306] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:15:23 2022] POST /identity/v3/endpoints => generated 331 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:15:33.541832 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=30 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:15:33.710735 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:16:26.170962 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873fd35-cc0d-49e4-b8a6-eeee4dd40e9d None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:26.172059 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873fd35-cc0d-49e4-b8a6-eeee4dd40e9d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:26.172567 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873fd35-cc0d-49e4-b8a6-eeee4dd40e9d None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:26.177905 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 657/1307] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:16:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:16:26.179324 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf21a5-7e99-45f3-bc1b-eebcaa4db805 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:26.179738 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf21a5-7e99-45f3-bc1b-eebcaa4db805 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:26.179976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cf21a5-7e99-45f3-bc1b-eebcaa4db805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:26.265125 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-d3cf21a5-7e99-45f3-bc1b-eebcaa4db805 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:16:26.266229 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d3cf21a5-7e99-45f3-bc1b-eebcaa4db805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:16:26.380362 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 651/1308] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:16:26.431042 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082848ac-e84b-4da9-89c8-334b5376db6f None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:26.431429 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082848ac-e84b-4da9-89c8-334b5376db6f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:26.431842 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082848ac-e84b-4da9-89c8-334b5376db6f None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:26.433633 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 658/1309] 10.222.0.40 () {54 vars in 965 bytes} [Wed Jul 27 15:16:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:16:26.441005 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63647f6f-75d6-4459-8e30-ec6ceaf0165a None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:26.441373 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63647f6f-75d6-4459-8e30-ec6ceaf0165a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:26.441709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63647f6f-75d6-4459-8e30-ec6ceaf0165a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:26.543634 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-63647f6f-75d6-4459-8e30-ec6ceaf0165a None None] MFA Rules not processed for user `227dac1eaefc4d0a8d3cc8a6dee2ecba`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:16:26.545149 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-63647f6f-75d6-4459-8e30-ec6ceaf0165a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:16:26.580154 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:16:26.651827 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 652/1310] 10.222.0.40 () {58 vars in 1062 bytes} [Wed Jul 27 15:16:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:16:26.661193 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082848ac-e84b-4da9-89c8-334b5376db6f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:16:26.662749 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-082848ac-e84b-4da9-89c8-334b5376db6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:16:26.782908 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082848ac-e84b-4da9-89c8-334b5376db6f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:16:26.859799 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5509d9-26a5-4b93-8b38-a62444323265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:16:26.860537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5509d9-26a5-4b93-8b38-a62444323265 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:26.860880 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5509d9-26a5-4b93-8b38-a62444323265 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:26.861216 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5509d9-26a5-4b93-8b38-a62444323265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:26.862887 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1c5509d9-26a5-4b93-8b38-a62444323265 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:16:26.918093 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:16:26.976021 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5509d9-26a5-4b93-8b38-a62444323265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:16:26.977573 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5509d9-26a5-4b93-8b38-a62444323265 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:16:26.996986 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 659/1311] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:16:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:16:29.297870 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84877e0c-0e0b-4149-9939-42250a53e98a None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:29.298416 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84877e0c-0e0b-4149-9939-42250a53e98a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:29.298416 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84877e0c-0e0b-4149-9939-42250a53e98a None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:29.303441 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 653/1312] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:16:29.305122 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bae97b-6b55-4a29-b022-d64684a0f11a None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:29.305540 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bae97b-6b55-4a29-b022-d64684a0f11a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:29.305731 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bae97b-6b55-4a29-b022-d64684a0f11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:29.392549 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f6bae97b-6b55-4a29-b022-d64684a0f11a None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:16:29.393652 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f6bae97b-6b55-4a29-b022-d64684a0f11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:16:29.492596 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 660/1313] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:16:29.531021 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84877e0c-0e0b-4149-9939-42250a53e98a None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:16:29.532696 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-84877e0c-0e0b-4149-9939-42250a53e98a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:16:29.652880 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84877e0c-0e0b-4149-9939-42250a53e98a None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:16:29.738648 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:16:29.742057 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03834a8a-39ec-4802-872f-8875225a6862 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:16:29.742730 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03834a8a-39ec-4802-872f-8875225a6862 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:29.743033 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03834a8a-39ec-4802-872f-8875225a6862 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:29.743327 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03834a8a-39ec-4802-872f-8875225a6862 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:29.745895 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-03834a8a-39ec-4802-872f-8875225a6862 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:16:29.867022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03834a8a-39ec-4802-872f-8875225a6862 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:16:29.868486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03834a8a-39ec-4802-872f-8875225a6862 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:16:29.887844 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 654/1314] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:16:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:16:32.191258 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd3309-fec9-42a9-a81a-77d5f476a5a3 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:32.191777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd3309-fec9-42a9-a81a-77d5f476a5a3 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:32.191866 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd3309-fec9-42a9-a81a-77d5f476a5a3 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:32.193161 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 661/1315] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:16:32.198184 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ff720-893e-42a3-b400-4055dd2c1e6c None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:32.198617 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ff720-893e-42a3-b400-4055dd2c1e6c None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:32.198764 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6ff720-893e-42a3-b400-4055dd2c1e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:32.262739 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-ac6ff720-893e-42a3-b400-4055dd2c1e6c None None] MFA Rules not processed for user `ba54789172a447cfa1bd06445f4610b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:16:32.264493 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ac6ff720-893e-42a3-b400-4055dd2c1e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:16:32.316373 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:16:32.360841 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 655/1316] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:16:32 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:16:32.403041 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd3309-fec9-42a9-a81a-77d5f476a5a3 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:16:32.405286 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-94fd3309-fec9-42a9-a81a-77d5f476a5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:16:32.415248 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:16:32.507204 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd3309-fec9-42a9-a81a-77d5f476a5a3 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:16:32.577563 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f248b26-50ff-4e13-b66b-040aad6faef7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:16:32.578120 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f248b26-50ff-4e13-b66b-040aad6faef7 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:32.578405 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f248b26-50ff-4e13-b66b-040aad6faef7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:32.578704 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f248b26-50ff-4e13-b66b-040aad6faef7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:32.580436 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9f248b26-50ff-4e13-b66b-040aad6faef7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:16:32.642681 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:16:32.694125 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f248b26-50ff-4e13-b66b-040aad6faef7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:16:32.695563 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f248b26-50ff-4e13-b66b-040aad6faef7 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:16:32.714563 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 662/1317] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:16:32 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:16:35.231211 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce3658-6d22-485d-8c38-250cb8300d42 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:35.231750 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce3658-6d22-485d-8c38-250cb8300d42 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:35.231750 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce3658-6d22-485d-8c38-250cb8300d42 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:35.233132 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 656/1318] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:16:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:16:35.238099 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93d964-552b-4d49-82a4-016ae5e28167 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:35.238524 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93d964-552b-4d49-82a4-016ae5e28167 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:35.238659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93d964-552b-4d49-82a4-016ae5e28167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:35.304939 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-ab93d964-552b-4d49-82a4-016ae5e28167 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:16:35.306139 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ab93d964-552b-4d49-82a4-016ae5e28167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:16:35.400904 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 663/1319] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:16:35 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:16:35.439683 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce3658-6d22-485d-8c38-250cb8300d42 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:16:35.441254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-0dce3658-6d22-485d-8c38-250cb8300d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:16:35.540617 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce3658-6d22-485d-8c38-250cb8300d42 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:16:35.613667 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0fab90-170c-4038-bde3-e04c45930ad9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:16:35.614275 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fab90-170c-4038-bde3-e04c45930ad9 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:35.614551 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fab90-170c-4038-bde3-e04c45930ad9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:35.614821 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0fab90-170c-4038-bde3-e04c45930ad9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:35.616460 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8d0fab90-170c-4038-bde3-e04c45930ad9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:16:35.623600 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:16:35.726040 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0fab90-170c-4038-bde3-e04c45930ad9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:16:35.727457 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0fab90-170c-4038-bde3-e04c45930ad9 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:16:35.748351 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 657/1320] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:16:35 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:16:38.433788 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9ee68-b47b-4f26-8d19-39108fa7ec53 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:38.434359 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9ee68-b47b-4f26-8d19-39108fa7ec53 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:38.434359 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec9ee68-b47b-4f26-8d19-39108fa7ec53 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:38.436379 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 664/1321] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:16:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:16:38.441416 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06431bf5-4c9f-4b01-b33c-430f56beab07 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:38.441799 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06431bf5-4c9f-4b01-b33c-430f56beab07 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:38.441971 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06431bf5-4c9f-4b01-b33c-430f56beab07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:38.507247 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-06431bf5-4c9f-4b01-b33c-430f56beab07 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:16:38.508477 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-06431bf5-4c9f-4b01-b33c-430f56beab07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:16:38.567984 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:16:38.613238 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 658/1322] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:16:38.648845 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9ee68-b47b-4f26-8d19-39108fa7ec53 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:16:38.650390 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5ec9ee68-b47b-4f26-8d19-39108fa7ec53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:16:38.671340 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:16:38.757446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec9ee68-b47b-4f26-8d19-39108fa7ec53 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:16:38.833501 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a49e2-30f7-416e-a3d0-c0ff46e41ddd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:16:38.834116 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a49e2-30f7-416e-a3d0-c0ff46e41ddd service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:38.834395 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a49e2-30f7-416e-a3d0-c0ff46e41ddd service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:38.834668 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a49e2-30f7-416e-a3d0-c0ff46e41ddd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:38.836327 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9a0a49e2-30f7-416e-a3d0-c0ff46e41ddd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:16:38.910884 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:16:38.952727 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a49e2-30f7-416e-a3d0-c0ff46e41ddd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:16:38.954172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a49e2-30f7-416e-a3d0-c0ff46e41ddd service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:16:38.973704 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 665/1323] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:16:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:16:41.087883 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d163a-47a6-4892-9d3d-a750f29c60a8 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:41.088481 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d163a-47a6-4892-9d3d-a750f29c60a8 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:41.088481 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107d163a-47a6-4892-9d3d-a750f29c60a8 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:41.089800 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 659/1324] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:16:41.095689 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87d6ac-902b-4b18-9000-f3f4b8136998 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:41.096216 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87d6ac-902b-4b18-9000-f3f4b8136998 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:41.096310 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b87d6ac-902b-4b18-9000-f3f4b8136998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:41.164742 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-2b87d6ac-902b-4b18-9000-f3f4b8136998 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:16:41.165949 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2b87d6ac-902b-4b18-9000-f3f4b8136998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:16:41.266451 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 666/1325] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:16:41.303867 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d163a-47a6-4892-9d3d-a750f29c60a8 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:16:41.305462 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-107d163a-47a6-4892-9d3d-a750f29c60a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:16:41.417739 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107d163a-47a6-4892-9d3d-a750f29c60a8 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:16:41.496043 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19287167-bff4-46ae-aa07-69ab6a541145 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:16:41.496668 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19287167-bff4-46ae-aa07-69ab6a541145 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:41.497840 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19287167-bff4-46ae-aa07-69ab6a541145 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:41.497995 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19287167-bff4-46ae-aa07-69ab6a541145 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:41.501068 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-19287167-bff4-46ae-aa07-69ab6a541145 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:16:41.536230 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:16:41.632623 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19287167-bff4-46ae-aa07-69ab6a541145 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:16:41.634067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19287167-bff4-46ae-aa07-69ab6a541145 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:16:41.653936 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 660/1326] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:16:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:16:43.715130 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4336b1-f0f6-4d55-b6a2-ad6ebbf07f50 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:43.716247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4336b1-f0f6-4d55-b6a2-ad6ebbf07f50 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:43.716247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4336b1-f0f6-4d55-b6a2-ad6ebbf07f50 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:43.717556 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 667/1327] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:16:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:16:43.722761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf14475-398c-4233-acc5-6a2eb6345dad None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:43.723166 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf14475-398c-4233-acc5-6a2eb6345dad None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:43.723315 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf14475-398c-4233-acc5-6a2eb6345dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:43.788352 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-1cf14475-398c-4233-acc5-6a2eb6345dad None None] MFA Rules not processed for user `ba54789172a447cfa1bd06445f4610b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:16:43.789510 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-1cf14475-398c-4233-acc5-6a2eb6345dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:16:43.854468 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:16:43.886464 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 661/1328] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:16:43 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:16:43.939674 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e347a3a-5652-4338-a249-ed214bb9e360 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:43.939964 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e347a3a-5652-4338-a249-ed214bb9e360 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:43.940274 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e347a3a-5652-4338-a249-ed214bb9e360 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:43.941625 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 668/1329] 10.222.0.40 () {54 vars in 965 bytes} [Wed Jul 27 15:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:16:43.947588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cbffa-3442-470c-a32b-2a5b6dedfa4c None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:43.947943 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cbffa-3442-470c-a32b-2a5b6dedfa4c None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:43.948353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cbffa-3442-470c-a32b-2a5b6dedfa4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:44.023480 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-790cbffa-3442-470c-a32b-2a5b6dedfa4c None None] MFA Rules not processed for user `227dac1eaefc4d0a8d3cc8a6dee2ecba`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:16:44.024736 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-790cbffa-3442-470c-a32b-2a5b6dedfa4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:16:44.103549 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 662/1330] 10.222.0.40 () {58 vars in 1062 bytes} [Wed Jul 27 15:16:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:16:44.112617 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e347a3a-5652-4338-a249-ed214bb9e360 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:16:44.114165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9e347a3a-5652-4338-a249-ed214bb9e360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:16:44.146046 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:16:44.232944 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e347a3a-5652-4338-a249-ed214bb9e360 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:16:44.307704 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e3f415-68aa-4d08-b650-8dfcea3b30e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:16:44.308352 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3f415-68aa-4d08-b650-8dfcea3b30e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:44.308635 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3f415-68aa-4d08-b650-8dfcea3b30e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:44.308905 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3f415-68aa-4d08-b650-8dfcea3b30e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:44.310520 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-36e3f415-68aa-4d08-b650-8dfcea3b30e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:16:44.401696 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:16:44.436498 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3f415-68aa-4d08-b650-8dfcea3b30e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:16:44.437931 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e3f415-68aa-4d08-b650-8dfcea3b30e1 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:16:44.456339 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 669/1331] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:16:44 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:16:47.103646 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720881e2-7dce-4377-990c-6cde57b542ea None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:47.104242 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720881e2-7dce-4377-990c-6cde57b542ea None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:47.104242 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720881e2-7dce-4377-990c-6cde57b542ea None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:47.105564 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 663/1332] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:16:47.110852 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf619e-1107-483f-ae73-df0e3d29ff9f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:47.111254 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf619e-1107-483f-ae73-df0e3d29ff9f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:47.111448 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bf619e-1107-483f-ae73-df0e3d29ff9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:47.177822 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-73bf619e-1107-483f-ae73-df0e3d29ff9f None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:16:47.179041 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-73bf619e-1107-483f-ae73-df0e3d29ff9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:16:47.273232 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 670/1333] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:16:47.309729 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720881e2-7dce-4377-990c-6cde57b542ea None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:16:47.311293 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-720881e2-7dce-4377-990c-6cde57b542ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:16:47.384070 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:16:47.418904 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720881e2-7dce-4377-990c-6cde57b542ea None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:16:47.489516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3491a-5ced-4235-be1c-20014c0f5337 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:16:47.490123 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3491a-5ced-4235-be1c-20014c0f5337 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:47.490400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3491a-5ced-4235-be1c-20014c0f5337 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:47.490670 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3491a-5ced-4235-be1c-20014c0f5337 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:47.492309 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-dec3491a-5ced-4235-be1c-20014c0f5337 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:16:47.598336 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3491a-5ced-4235-be1c-20014c0f5337 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:16:47.599770 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3491a-5ced-4235-be1c-20014c0f5337 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:16:47.609623 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:16:47.618875 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 664/1334] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:16:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:16:49.671173 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973d529-5402-4b84-af52-e8b3e08e3560 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:49.671694 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973d529-5402-4b84-af52-e8b3e08e3560 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:49.671822 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973d529-5402-4b84-af52-e8b3e08e3560 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:49.673133 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 671/1335] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:16:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:16:49.678185 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca51064-24b0-4c73-8059-ad382286d0fc None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:49.678613 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca51064-24b0-4c73-8059-ad382286d0fc None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:49.678710 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca51064-24b0-4c73-8059-ad382286d0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:49.745175 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-2ca51064-24b0-4c73-8059-ad382286d0fc None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:16:49.746370 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-2ca51064-24b0-4c73-8059-ad382286d0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:16:49.840953 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 665/1336] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:16:49.888634 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973d529-5402-4b84-af52-e8b3e08e3560 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:16:49.890757 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0973d529-5402-4b84-af52-e8b3e08e3560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:16:49.934070 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:16:49.995325 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973d529-5402-4b84-af52-e8b3e08e3560 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:16:50.065600 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acf2ed9-835f-499b-90b6-96d0a34f23cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:16:50.066202 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf2ed9-835f-499b-90b6-96d0a34f23cd service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:50.066478 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf2ed9-835f-499b-90b6-96d0a34f23cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:50.066747 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acf2ed9-835f-499b-90b6-96d0a34f23cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:50.068361 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3acf2ed9-835f-499b-90b6-96d0a34f23cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:16:50.147910 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:16:50.174476 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf2ed9-835f-499b-90b6-96d0a34f23cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:16:50.175901 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acf2ed9-835f-499b-90b6-96d0a34f23cd service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:16:50.195498 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 672/1337] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:16:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:16:52.695546 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922ef52-d277-4ef9-a60f-4ef6e910772f None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:52.696125 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922ef52-d277-4ef9-a60f-4ef6e910772f None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:52.696125 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f922ef52-d277-4ef9-a60f-4ef6e910772f None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:52.697473 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 666/1338] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:16:52.703201 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296b2f6-b6ba-4d1e-a61f-760caf26a828 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:52.703616 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296b2f6-b6ba-4d1e-a61f-760caf26a828 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:52.703750 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a296b2f6-b6ba-4d1e-a61f-760caf26a828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:52.768514 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a296b2f6-b6ba-4d1e-a61f-760caf26a828 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:16:52.769699 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a296b2f6-b6ba-4d1e-a61f-760caf26a828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:16:52.863483 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 673/1339] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:16:52 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:16:52.900791 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922ef52-d277-4ef9-a60f-4ef6e910772f None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:16:52.902315 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f922ef52-d277-4ef9-a60f-4ef6e910772f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:16:52.977007 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:16:53.004872 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f922ef52-d277-4ef9-a60f-4ef6e910772f None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:16:53.075513 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f015110-8bd3-4e23-8c50-89b37b4f7036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:16:53.076150 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f015110-8bd3-4e23-8c50-89b37b4f7036 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:53.076430 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f015110-8bd3-4e23-8c50-89b37b4f7036 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:53.076698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f015110-8bd3-4e23-8c50-89b37b4f7036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:53.078288 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-4f015110-8bd3-4e23-8c50-89b37b4f7036 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:16:53.183029 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f015110-8bd3-4e23-8c50-89b37b4f7036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:16:53.185026 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f015110-8bd3-4e23-8c50-89b37b4f7036 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:16:53.202848 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 667/1340] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:16:52 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:16:57.172581 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4c236-ba65-416b-a0a7-298892a8c95b None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:57.173011 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4c236-ba65-416b-a0a7-298892a8c95b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:57.173275 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc4c236-ba65-416b-a0a7-298892a8c95b None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:57.174845 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 674/1341] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:16:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:16:57.180372 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4c8a7-e940-4344-a636-ddb855126c89 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:57.180800 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4c8a7-e940-4344-a636-ddb855126c89 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:57.181076 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4c8a7-e940-4344-a636-ddb855126c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:57.187290 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:16:57.248618 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-b5e4c8a7-e940-4344-a636-ddb855126c89 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:16:57.249726 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b5e4c8a7-e940-4344-a636-ddb855126c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:16:57.353729 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 668/1342] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:16:57.392537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4c236-ba65-416b-a0a7-298892a8c95b None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:16:57.394063 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9bc4c236-ba65-416b-a0a7-298892a8c95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:16:57.441623 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:16:57.497271 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc4c236-ba65-416b-a0a7-298892a8c95b None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:16:57.571564 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eaa551-9b6d-4e00-a731-a835f228b4a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:16:57.572245 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eaa551-9b6d-4e00-a731-a835f228b4a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:16:57.572530 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eaa551-9b6d-4e00-a731-a835f228b4a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:16:57.572803 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eaa551-9b6d-4e00-a731-a835f228b4a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:16:57.574448 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d0eaa551-9b6d-4e00-a731-a835f228b4a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:16:57.667868 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:16:57.685524 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eaa551-9b6d-4e00-a731-a835f228b4a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:16:57.686952 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eaa551-9b6d-4e00-a731-a835f228b4a7 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:16:57.705442 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 675/1343] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:16:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:17:00.296092 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8800f89-6454-4d76-982f-a8773e24f7ac None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:00.296635 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8800f89-6454-4d76-982f-a8773e24f7ac None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:00.296635 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8800f89-6454-4d76-982f-a8773e24f7ac None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:00.298069 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 669/1344] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:17:00.303013 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850b54c-5ef6-4057-8538-bbd8fbc6f5e5 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:00.303492 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850b54c-5ef6-4057-8538-bbd8fbc6f5e5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:00.303603 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5850b54c-5ef6-4057-8538-bbd8fbc6f5e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:00.380213 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-5850b54c-5ef6-4057-8538-bbd8fbc6f5e5 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:17:00.381444 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5850b54c-5ef6-4057-8538-bbd8fbc6f5e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:00.485938 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 676/1345] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:17:00 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:17:00.524326 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8800f89-6454-4d76-982f-a8773e24f7ac None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:17:00.525862 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b8800f89-6454-4d76-982f-a8773e24f7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:00.616248 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:00.634020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8800f89-6454-4d76-982f-a8773e24f7ac None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:17:00.705544 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9e528-7923-4cd3-8fdb-91c7351a7ae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:17:00.706158 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9e528-7923-4cd3-8fdb-91c7351a7ae1 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:00.706436 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9e528-7923-4cd3-8fdb-91c7351a7ae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:00.706707 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9e528-7923-4cd3-8fdb-91c7351a7ae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:00.708328 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-0cb9e528-7923-4cd3-8fdb-91c7351a7ae1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:00.815219 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9e528-7923-4cd3-8fdb-91c7351a7ae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:17:00.816734 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9e528-7923-4cd3-8fdb-91c7351a7ae1 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:17:00.834841 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 670/1346] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:17:00 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:17:04.753030 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27a55a-52f1-45a9-81e4-2a4d011c1d8b None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:04.753540 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27a55a-52f1-45a9-81e4-2a4d011c1d8b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:04.753540 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec27a55a-52f1-45a9-81e4-2a4d011c1d8b None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:04.754832 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 677/1347] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:17:04.759829 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d3750-0fd6-4ab7-96b3-3edef027383c None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:04.760263 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d3750-0fd6-4ab7-96b3-3edef027383c None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:04.760417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207d3750-0fd6-4ab7-96b3-3edef027383c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:04.775404 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:04.826721 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-207d3750-0fd6-4ab7-96b3-3edef027383c None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:17:04.827909 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-207d3750-0fd6-4ab7-96b3-3edef027383c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:04.927263 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 671/1348] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:17:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:17:04.964428 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27a55a-52f1-45a9-81e4-2a4d011c1d8b None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:17:04.966512 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ec27a55a-52f1-45a9-81e4-2a4d011c1d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:05.025188 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:05.077251 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec27a55a-52f1-45a9-81e4-2a4d011c1d8b None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:17:05.163731 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af5c269-9d1c-4d51-b9fd-9fd8df756cdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:17:05.164384 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5c269-9d1c-4d51-b9fd-9fd8df756cdb service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:05.164667 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5c269-9d1c-4d51-b9fd-9fd8df756cdb service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:05.164945 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af5c269-9d1c-4d51-b9fd-9fd8df756cdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:05.166582 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7af5c269-9d1c-4d51-b9fd-9fd8df756cdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:05.277307 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:05.281742 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5c269-9d1c-4d51-b9fd-9fd8df756cdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:17:05.283189 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af5c269-9d1c-4d51-b9fd-9fd8df756cdb service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:17:05.303091 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 678/1349] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:17:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:17:10.274949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6ccf9-9ce5-4214-aff7-82f9018caf10 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:10.275436 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6ccf9-9ce5-4214-aff7-82f9018caf10 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:10.275436 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee6ccf9-9ce5-4214-aff7-82f9018caf10 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:10.277695 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 672/1350] 10.222.0.40 () {54 vars in 921 bytes} [Wed Jul 27 15:17:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:17:10.282429 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35463b-9fe6-4939-8161-e8113b9f9363 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:10.282870 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35463b-9fe6-4939-8161-e8113b9f9363 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:10.283018 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a35463b-9fe6-4939-8161-e8113b9f9363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:10.413923 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-2a35463b-9fe6-4939-8161-e8113b9f9363 None None] MFA Rules not processed for user `a386d326dc634cbd943ac30f6e8d08bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:17:10.415247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2a35463b-9fe6-4939-8161-e8113b9f9363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:10.536308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 679/1351] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Jul 27 15:17:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:17:14.843324 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5721e-b75b-4cfc-a458-2a48ca8f202e None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:14.843815 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5721e-b75b-4cfc-a458-2a48ca8f202e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:14.843815 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5721e-b75b-4cfc-a458-2a48ca8f202e None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:14.845172 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 673/1352] 10.222.0.40 () {54 vars in 921 bytes} [Wed Jul 27 15:17:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:17:14.850345 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20e755-298d-426b-8404-e87375ef08d5 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:14.850790 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20e755-298d-426b-8404-e87375ef08d5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:14.850899 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20e755-298d-426b-8404-e87375ef08d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:14.911180 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:14.925490 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=59 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:14.937474 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-dc20e755-298d-426b-8404-e87375ef08d5 None None] MFA Rules not processed for user `a386d326dc634cbd943ac30f6e8d08bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:17:14.939190 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-dc20e755-298d-426b-8404-e87375ef08d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:15.063712 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 680/1353] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Jul 27 15:17:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:17:16.228214 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72039f6-def6-4707-bf2e-554124277575 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:16.228835 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72039f6-def6-4707-bf2e-554124277575 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:16.228835 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72039f6-def6-4707-bf2e-554124277575 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:16.230198 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 674/1354] 10.222.0.40 () {54 vars in 921 bytes} [Wed Jul 27 15:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:17:16.234957 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0644a08-c0ef-4c18-8692-a06b3c8bfac2 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:16.235409 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0644a08-c0ef-4c18-8692-a06b3c8bfac2 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:16.235563 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0644a08-c0ef-4c18-8692-a06b3c8bfac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:16.312777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a0644a08-c0ef-4c18-8692-a06b3c8bfac2 None None] MFA Rules not processed for user `a386d326dc634cbd943ac30f6e8d08bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:17:16.313999 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a0644a08-c0ef-4c18-8692-a06b3c8bfac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:16.356036 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:16.424565 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 681/1355] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Jul 27 15:17:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:17:19.856811 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc98bb-3718-44fe-960c-15ae0a499bfa None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:19.857293 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc98bb-3718-44fe-960c-15ae0a499bfa None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:19.857293 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bc98bb-3718-44fe-960c-15ae0a499bfa None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:19.858634 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 675/1356] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:17:19.865492 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ff2d4-2748-4f92-a9fb-0b5e6339f4b8 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:19.865962 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ff2d4-2748-4f92-a9fb-0b5e6339f4b8 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:19.866041 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ff2d4-2748-4f92-a9fb-0b5e6339f4b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:19.943296 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-e19ff2d4-2748-4f92-a9fb-0b5e6339f4b8 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:17:19.944944 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e19ff2d4-2748-4f92-a9fb-0b5e6339f4b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:20.048713 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 682/1357] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:17:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:17:20.102862 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424d779-b7c6-4001-8658-7f239b7549fc None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:20.103343 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424d779-b7c6-4001-8658-7f239b7549fc None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:20.103951 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a424d779-b7c6-4001-8658-7f239b7549fc None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:20.106739 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 676/1358] 10.222.0.40 () {54 vars in 962 bytes} [Wed Jul 27 15:17:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:17:20.115668 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930a3f8-6136-4ce2-8247-95db90a97581 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:20.116515 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930a3f8-6136-4ce2-8247-95db90a97581 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:20.117914 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7930a3f8-6136-4ce2-8247-95db90a97581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:20.137270 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:20.205749 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-7930a3f8-6136-4ce2-8247-95db90a97581 None None] MFA Rules not processed for user `d3e01aa0ef1340cbba7170bac4a82783`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:17:20.207065 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7930a3f8-6136-4ce2-8247-95db90a97581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:20.324053 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 683/1359] 10.222.0.40 () {58 vars in 1059 bytes} [Wed Jul 27 15:17:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:17:20.331650 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424d779-b7c6-4001-8658-7f239b7549fc None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:17:20.333179 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a424d779-b7c6-4001-8658-7f239b7549fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:20.485028 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a424d779-b7c6-4001-8658-7f239b7549fc None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:17:20.560407 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:20.610210 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202fee89-0849-4d74-8e63-81e9c3eafa45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:17:20.610948 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202fee89-0849-4d74-8e63-81e9c3eafa45 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:20.611696 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202fee89-0849-4d74-8e63-81e9c3eafa45 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:20.611984 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202fee89-0849-4d74-8e63-81e9c3eafa45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:20.613659 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-202fee89-0849-4d74-8e63-81e9c3eafa45 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:20.707328 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202fee89-0849-4d74-8e63-81e9c3eafa45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:17:20.709166 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202fee89-0849-4d74-8e63-81e9c3eafa45 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:17:20.728654 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 677/1360] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:17:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:17:22.940695 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d2a30-30c6-485c-9543-c8dece1cf9ff None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:22.941185 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d2a30-30c6-485c-9543-c8dece1cf9ff None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:22.941265 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d2a30-30c6-485c-9543-c8dece1cf9ff None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:22.942644 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 684/1361] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:17:22.947787 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f1eae-0ad0-4129-9b9f-e1c9a37f45c2 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:22.948244 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f1eae-0ad0-4129-9b9f-e1c9a37f45c2 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:22.948934 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f1eae-0ad0-4129-9b9f-e1c9a37f45c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:23.016409 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-e64f1eae-0ad0-4129-9b9f-e1c9a37f45c2 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:17:23.017601 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e64f1eae-0ad0-4129-9b9f-e1c9a37f45c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:23.055588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:23.128031 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 678/1362] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:17:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:17:23.172077 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d2a30-30c6-485c-9543-c8dece1cf9ff None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:17:23.173587 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-be5d2a30-30c6-485c-9543-c8dece1cf9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:23.246474 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:23.343692 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d2a30-30c6-485c-9543-c8dece1cf9ff None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:17:23.480605 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c376a2c-4654-40e8-af43-02addade1cc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:17:23.481222 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c376a2c-4654-40e8-af43-02addade1cc1 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:23.481507 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c376a2c-4654-40e8-af43-02addade1cc1 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:23.481780 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c376a2c-4654-40e8-af43-02addade1cc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:23.483438 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2c376a2c-4654-40e8-af43-02addade1cc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:23.507250 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:23.587508 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c376a2c-4654-40e8-af43-02addade1cc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:17:23.589671 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c376a2c-4654-40e8-af43-02addade1cc1 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:17:23.626276 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 685/1363] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:17:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:17:25.968758 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedbc66a-f0e0-4bee-b30b-9a7cd45a67d9 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:25.969753 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedbc66a-f0e0-4bee-b30b-9a7cd45a67d9 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:25.970262 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedbc66a-f0e0-4bee-b30b-9a7cd45a67d9 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:25.971840 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 679/1364] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:17:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:17:25.977279 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74de81-7d72-4efb-95e1-1690e8160452 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:25.977703 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74de81-7d72-4efb-95e1-1690e8160452 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:25.977819 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74de81-7d72-4efb-95e1-1690e8160452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:26.054986 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-2d74de81-7d72-4efb-95e1-1690e8160452 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:17:26.056173 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2d74de81-7d72-4efb-95e1-1690e8160452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:26.174979 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:26.184444 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 686/1365] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:17:26.226514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686784c6-a61a-409b-9b9f-49288b4c88ad None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:26.227122 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686784c6-a61a-409b-9b9f-49288b4c88ad None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:26.227628 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686784c6-a61a-409b-9b9f-49288b4c88ad None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:26.229439 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 680/1366] 10.222.0.40 () {54 vars in 962 bytes} [Wed Jul 27 15:17:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:17:26.238433 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac8d1a-f80c-4307-ae39-cb6be38bc147 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:26.238433 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac8d1a-f80c-4307-ae39-cb6be38bc147 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:26.238433 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac8d1a-f80c-4307-ae39-cb6be38bc147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:26.333661 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-90ac8d1a-f80c-4307-ae39-cb6be38bc147 None None] MFA Rules not processed for user `d3e01aa0ef1340cbba7170bac4a82783`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:17:26.334974 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-90ac8d1a-f80c-4307-ae39-cb6be38bc147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:26.457509 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 687/1367] 10.222.0.40 () {58 vars in 1059 bytes} [Wed Jul 27 15:17:26 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:17:26.465302 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686784c6-a61a-409b-9b9f-49288b4c88ad None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:17:26.466924 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-686784c6-a61a-409b-9b9f-49288b4c88ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:26.634260 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686784c6-a61a-409b-9b9f-49288b4c88ad None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:17:26.662222 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:26.768940 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea306d-64ea-4093-b275-f259a40b7f49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:17:26.769564 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea306d-64ea-4093-b275-f259a40b7f49 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:26.769839 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea306d-64ea-4093-b275-f259a40b7f49 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:26.770106 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea306d-64ea-4093-b275-f259a40b7f49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:26.771869 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-3eea306d-64ea-4093-b275-f259a40b7f49 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:26.867865 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea306d-64ea-4093-b275-f259a40b7f49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:17:26.869528 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea306d-64ea-4093-b275-f259a40b7f49 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:17:26.889073 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 681/1368] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:17:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:17:28.087534 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ab1af-bfa5-4a9f-94ec-99c36f4a7856 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:28.088130 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ab1af-bfa5-4a9f-94ec-99c36f4a7856 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:28.088130 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8ab1af-bfa5-4a9f-94ec-99c36f4a7856 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:28.094370 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 688/1369] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:17:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:17:28.096039 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de854590-ab09-4c82-b784-f9e982bba4d7 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:28.097245 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de854590-ab09-4c82-b784-f9e982bba4d7 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:28.098201 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de854590-ab09-4c82-b784-f9e982bba4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:28.144631 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:28.183116 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-de854590-ab09-4c82-b784-f9e982bba4d7 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:17:28.184379 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-de854590-ab09-4c82-b784-f9e982bba4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:28.286482 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 682/1370] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:17:28.638582 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd80c6-b7a3-4488-979a-b4c4a78edae5 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:28.638870 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd80c6-b7a3-4488-979a-b4c4a78edae5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:28.639147 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd80c6-b7a3-4488-979a-b4c4a78edae5 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:28.640994 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 689/1371] 10.222.0.40 () {54 vars in 964 bytes} [Wed Jul 27 15:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:17:28.647228 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1a582-c9aa-4776-a81f-7285f0e55383 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:28.647630 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1a582-c9aa-4776-a81f-7285f0e55383 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:28.648031 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1a582-c9aa-4776-a81f-7285f0e55383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:28.733320 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-e8b1a582-c9aa-4776-a81f-7285f0e55383 None None] MFA Rules not processed for user `20aa56e1154649cb8b440dae788c922c`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:17:28.734859 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e8b1a582-c9aa-4776-a81f-7285f0e55383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:28.786065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:28.819950 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 683/1372] 10.222.0.40 () {58 vars in 1061 bytes} [Wed Jul 27 15:17:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:17:28.828644 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd80c6-b7a3-4488-979a-b4c4a78edae5 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:17:28.830307 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-04fd80c6-b7a3-4488-979a-b4c4a78edae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:28.887643 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:28.948721 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd80c6-b7a3-4488-979a-b4c4a78edae5 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:17:28.999568 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05086e75-ed3d-494c-bfd3-f5f5dd95afc9 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:28.999984 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05086e75-ed3d-494c-bfd3-f5f5dd95afc9 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:29.000361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05086e75-ed3d-494c-bfd3-f5f5dd95afc9 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:29.001793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 684/1373] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:17:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:17:29.007243 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a8dce-be04-4ce4-a6df-af76e22feba4 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:29.007665 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a8dce-be04-4ce4-a6df-af76e22feba4 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:29.007953 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441a8dce-be04-4ce4-a6df-af76e22feba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:29.029360 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d48ba79-524f-417a-8938-9c80add89331 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:17:29.030556 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48ba79-524f-417a-8938-9c80add89331 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:29.030941 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48ba79-524f-417a-8938-9c80add89331 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:29.031321 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d48ba79-524f-417a-8938-9c80add89331 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:29.033827 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9d48ba79-524f-417a-8938-9c80add89331 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:29.081931 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-441a8dce-be04-4ce4-a6df-af76e22feba4 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:17:29.083454 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-441a8dce-be04-4ce4-a6df-af76e22feba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:29.151731 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:29.172368 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48ba79-524f-417a-8938-9c80add89331 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:17:29.173820 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d48ba79-524f-417a-8938-9c80add89331 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:17:29.193955 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 685/1374] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:17:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:17:29.197242 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 690/1375] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:17:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 15:17:29.237580 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a8dce-be04-4ce4-a6df-af76e22feba4 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:17:29.238722 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-441a8dce-be04-4ce4-a6df-af76e22feba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:29.304345 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:29.376186 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441a8dce-be04-4ce4-a6df-af76e22feba4 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:17:29.498535 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4950a-fed7-4e2e-b413-c45e3eb927df service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:17:29.499173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4950a-fed7-4e2e-b413-c45e3eb927df service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:29.499451 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4950a-fed7-4e2e-b413-c45e3eb927df service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:29.499725 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4950a-fed7-4e2e-b413-c45e3eb927df service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:29.501401 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-83a4950a-fed7-4e2e-b413-c45e3eb927df service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:29.556843 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:29.604447 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4950a-fed7-4e2e-b413-c45e3eb927df service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:17:29.606042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4950a-fed7-4e2e-b413-c45e3eb927df service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:17:29.624423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 686/1376] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:17:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:17:31.651736 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51da94-6bb7-4eab-aa77-eb43a092fe62 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:31.652196 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51da94-6bb7-4eab-aa77-eb43a092fe62 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:31.652381 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a51da94-6bb7-4eab-aa77-eb43a092fe62 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:31.653998 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 691/1377] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:17:31.659813 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e30031-e9b9-462a-b90f-863ced1cbc5b None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:31.660307 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e30031-e9b9-462a-b90f-863ced1cbc5b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:31.660514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e30031-e9b9-462a-b90f-863ced1cbc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:31.732761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-51e30031-e9b9-462a-b90f-863ced1cbc5b None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:17:31.733955 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-51e30031-e9b9-462a-b90f-863ced1cbc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:31.848506 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 687/1378] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:17:31.892408 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51da94-6bb7-4eab-aa77-eb43a092fe62 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:17:31.893915 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6a51da94-6bb7-4eab-aa77-eb43a092fe62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:32.044064 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a51da94-6bb7-4eab-aa77-eb43a092fe62 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:17:32.103385 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:32.167583 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d179887-451c-4bfd-899a-8b4b474a1875 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:17:32.168667 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d179887-451c-4bfd-899a-8b4b474a1875 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:32.168667 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d179887-451c-4bfd-899a-8b4b474a1875 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:32.168667 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d179887-451c-4bfd-899a-8b4b474a1875 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:32.170313 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3d179887-451c-4bfd-899a-8b4b474a1875 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:32.271442 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d179887-451c-4bfd-899a-8b4b474a1875 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:17:32.272985 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d179887-451c-4bfd-899a-8b4b474a1875 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:17:32.291542 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 692/1379] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:17:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:17:34.363557 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463c550-4815-43f2-b265-92c861cfada3 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:34.364058 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463c550-4815-43f2-b265-92c861cfada3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:34.364170 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463c550-4815-43f2-b265-92c861cfada3 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:34.365648 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 688/1380] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:17:34.370798 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bc1de-5e1b-4539-84de-05bdbd639641 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:34.371232 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bc1de-5e1b-4539-84de-05bdbd639641 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:34.371357 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63bc1de-5e1b-4539-84de-05bdbd639641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:34.439901 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b63bc1de-5e1b-4539-84de-05bdbd639641 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:17:34.441145 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b63bc1de-5e1b-4539-84de-05bdbd639641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:34.456483 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:34.548044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 693/1381] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:17:34.595746 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463c550-4815-43f2-b265-92c861cfada3 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:17:34.597364 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e463c550-4815-43f2-b265-92c861cfada3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:34.623541 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:34.765171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463c550-4815-43f2-b265-92c861cfada3 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:17:34.864799 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:34.885802 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b0eab3-9fe3-4412-8d1f-a2566ad7c10b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:17:34.886421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0eab3-9fe3-4412-8d1f-a2566ad7c10b service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:34.886702 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0eab3-9fe3-4412-8d1f-a2566ad7c10b service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:34.886976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b0eab3-9fe3-4412-8d1f-a2566ad7c10b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:34.888593 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-04b0eab3-9fe3-4412-8d1f-a2566ad7c10b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:34.984793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b0eab3-9fe3-4412-8d1f-a2566ad7c10b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:17:34.986481 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b0eab3-9fe3-4412-8d1f-a2566ad7c10b service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:17:35.008290 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 689/1382] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:17:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:17:37.059687 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a071b-b612-4cc5-95f6-492502a29eff None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:37.060308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a071b-b612-4cc5-95f6-492502a29eff None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:37.060308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a071b-b612-4cc5-95f6-492502a29eff None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:37.061612 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 694/1383] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:17:37.066690 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d324a-b63c-43f0-bfc1-878e3afd48ad None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:37.067162 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d324a-b63c-43f0-bfc1-878e3afd48ad None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:37.067333 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d324a-b63c-43f0-bfc1-878e3afd48ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:37.288366 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-9a6d324a-b63c-43f0-bfc1-878e3afd48ad None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:17:37.289579 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9a6d324a-b63c-43f0-bfc1-878e3afd48ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:37.347912 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:37.392592 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 690/1384] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:17:37.434452 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a071b-b612-4cc5-95f6-492502a29eff None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:17:37.435978 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a60a071b-b612-4cc5-95f6-492502a29eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:37.591188 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:37.594004 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a071b-b612-4cc5-95f6-492502a29eff None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:17:37.717729 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1275dbd-dbeb-4f89-a518-83cc3baf1687 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:17:37.718271 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1275dbd-dbeb-4f89-a518-83cc3baf1687 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:37.718553 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1275dbd-dbeb-4f89-a518-83cc3baf1687 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:37.718832 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1275dbd-dbeb-4f89-a518-83cc3baf1687 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:37.720491 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e1275dbd-dbeb-4f89-a518-83cc3baf1687 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:37.819336 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1275dbd-dbeb-4f89-a518-83cc3baf1687 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:17:37.823346 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1275dbd-dbeb-4f89-a518-83cc3baf1687 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:17:37.851844 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 695/1385] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:17:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:17:39.875121 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cf284-6467-4849-b6b1-1ca2973f3ad8 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:39.875667 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cf284-6467-4849-b6b1-1ca2973f3ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:39.875667 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cf284-6467-4849-b6b1-1ca2973f3ad8 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:39.877047 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 691/1386] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:17:39.884115 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592bf82b-2a03-40fb-bd49-50a0d5732393 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:39.885569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592bf82b-2a03-40fb-bd49-50a0d5732393 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:39.886017 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592bf82b-2a03-40fb-bd49-50a0d5732393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:39.891200 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:39.955023 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-592bf82b-2a03-40fb-bd49-50a0d5732393 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:17:39.956277 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-592bf82b-2a03-40fb-bd49-50a0d5732393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:40.070007 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 696/1387] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:17:40.115331 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0cf284-6467-4849-b6b1-1ca2973f3ad8 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:17:40.116903 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-1e0cf284-6467-4849-b6b1-1ca2973f3ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:40.282046 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0cf284-6467-4849-b6b1-1ca2973f3ad8 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:17:40.332435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:40.414554 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e2035-db50-401a-83f3-4dfd88b9ed71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:17:40.415188 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e2035-db50-401a-83f3-4dfd88b9ed71 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:40.415517 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e2035-db50-401a-83f3-4dfd88b9ed71 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:40.415740 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e2035-db50-401a-83f3-4dfd88b9ed71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:40.418404 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-180e2035-db50-401a-83f3-4dfd88b9ed71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:40.530008 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e2035-db50-401a-83f3-4dfd88b9ed71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:17:40.532172 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e2035-db50-401a-83f3-4dfd88b9ed71 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:17:40.554380 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 692/1388] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:17:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:17:42.583464 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0c39b-19bd-454c-9cd7-8e314349db93 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:42.584039 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0c39b-19bd-454c-9cd7-8e314349db93 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:42.584039 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e0c39b-19bd-454c-9cd7-8e314349db93 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:42.585560 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 697/1389] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:17:42.591370 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37187b4e-ee19-4d0f-8b7c-0d4a1c5be462 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:42.591749 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37187b4e-ee19-4d0f-8b7c-0d4a1c5be462 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:42.591923 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37187b4e-ee19-4d0f-8b7c-0d4a1c5be462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:42.650069 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:42.658125 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-37187b4e-ee19-4d0f-8b7c-0d4a1c5be462 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:17:42.659586 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-37187b4e-ee19-4d0f-8b7c-0d4a1c5be462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:42.756060 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 693/1390] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:17:42.801094 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e0c39b-19bd-454c-9cd7-8e314349db93 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:17:42.802651 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-35e0c39b-19bd-454c-9cd7-8e314349db93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:42.881159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:42.945955 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e0c39b-19bd-454c-9cd7-8e314349db93 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:17:43.061177 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa08ea7-9e01-4ad3-84f1-ea63b81e4645 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:17:43.061795 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa08ea7-9e01-4ad3-84f1-ea63b81e4645 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:43.062082 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa08ea7-9e01-4ad3-84f1-ea63b81e4645 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:43.062358 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa08ea7-9e01-4ad3-84f1-ea63b81e4645 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:43.064006 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-dfa08ea7-9e01-4ad3-84f1-ea63b81e4645 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:43.106016 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:43.152908 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa08ea7-9e01-4ad3-84f1-ea63b81e4645 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:17:43.154419 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa08ea7-9e01-4ad3-84f1-ea63b81e4645 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:17:43.172270 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 698/1391] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:17:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:17:44.242240 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b673264-f69a-4003-9257-37c94a79e30c None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:44.242767 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b673264-f69a-4003-9257-37c94a79e30c None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:44.242767 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b673264-f69a-4003-9257-37c94a79e30c None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:44.244161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 694/1392] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:17:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:17:44.249982 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139959e-5f8e-4c5f-bfd4-995e21c1b587 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:44.250396 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139959e-5f8e-4c5f-bfd4-995e21c1b587 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:44.250571 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0139959e-5f8e-4c5f-bfd4-995e21c1b587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:44.318239 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-0139959e-5f8e-4c5f-bfd4-995e21c1b587 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:17:44.319386 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0139959e-5f8e-4c5f-bfd4-995e21c1b587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:44.419740 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 699/1393] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:17:44.477852 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf1493-e4b9-498f-bec8-0a9b78026021 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:44.478227 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf1493-e4b9-498f-bec8-0a9b78026021 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:44.478566 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaf1493-e4b9-498f-bec8-0a9b78026021 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:44.480564 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 695/1394] 10.222.0.40 () {54 vars in 966 bytes} [Wed Jul 27 15:17:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:17:44.485910 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dd723-d2b9-4d15-8d01-2ad1c9ef5ed1 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:44.486232 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dd723-d2b9-4d15-8d01-2ad1c9ef5ed1 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:44.486511 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933dd723-d2b9-4d15-8d01-2ad1c9ef5ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:44.511134 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:44.563775 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-933dd723-d2b9-4d15-8d01-2ad1c9ef5ed1 None None] MFA Rules not processed for user `2f71721ca75a461d92044091564de424`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:17:44.565015 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-933dd723-d2b9-4d15-8d01-2ad1c9ef5ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:44.642898 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 700/1395] 10.222.0.40 () {58 vars in 1063 bytes} [Wed Jul 27 15:17:44 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:17:44.651045 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf1493-e4b9-498f-bec8-0a9b78026021 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:17:44.652672 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-edaf1493-e4b9-498f-bec8-0a9b78026021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:44.754396 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaf1493-e4b9-498f-bec8-0a9b78026021 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:17:44.781022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:44.828823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b4e4c-34bb-4242-a722-95e6454ecfb0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f71721ca75a461d92044091564de424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:17:44.829443 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b4e4c-34bb-4242-a722-95e6454ecfb0 service glance] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:44.829727 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b4e4c-34bb-4242-a722-95e6454ecfb0 service glance] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:44.830003 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b4e4c-34bb-4242-a722-95e6454ecfb0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:44.831620 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-799b4e4c-34bb-4242-a722-95e6454ecfb0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:44.938992 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b4e4c-34bb-4242-a722-95e6454ecfb0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:17:44.940357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b4e4c-34bb-4242-a722-95e6454ecfb0 service glance] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:17:44.960436 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 696/1396] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:17:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:17:45.275097 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68defb88-8f12-4402-9063-4b5b922c2d59 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:45.275780 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68defb88-8f12-4402-9063-4b5b922c2d59 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:45.275780 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68defb88-8f12-4402-9063-4b5b922c2d59 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:45.277024 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 701/1397] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:17:45.282161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706be0be-9938-479b-8f37-1f257afa26b1 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:45.282613 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706be0be-9938-479b-8f37-1f257afa26b1 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:45.282724 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706be0be-9938-479b-8f37-1f257afa26b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:45.354368 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-706be0be-9938-479b-8f37-1f257afa26b1 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:17:45.355574 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-706be0be-9938-479b-8f37-1f257afa26b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:45.362495 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:45.458417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 697/1398] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:17:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:17:45.503981 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68defb88-8f12-4402-9063-4b5b922c2d59 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:17:45.505584 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-68defb88-8f12-4402-9063-4b5b922c2d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:45.630838 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:45.683437 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68defb88-8f12-4402-9063-4b5b922c2d59 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:17:45.697330 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b7063-6dfc-4985-8c95-ac76f0e13444 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:45.697619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b7063-6dfc-4985-8c95-ac76f0e13444 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:45.697889 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088b7063-6dfc-4985-8c95-ac76f0e13444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:45.766145 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-088b7063-6dfc-4985-8c95-ac76f0e13444 None None] MFA Rules not processed for user `b470b4c2ca1a4d1a8a864789bf603d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:17:45.767395 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-088b7063-6dfc-4985-8c95-ac76f0e13444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:45.811039 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9fa5c-1c8b-440c-8b17-6e0a2861ab81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:17:45.811854 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9fa5c-1c8b-440c-8b17-6e0a2861ab81 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:45.812340 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9fa5c-1c8b-440c-8b17-6e0a2861ab81 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:45.812775 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9fa5c-1c8b-440c-8b17-6e0a2861ab81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:45.814555 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3cb9fa5c-1c8b-440c-8b17-6e0a2861ab81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:45.858844 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:45.862027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 698/1399] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Jul 27 15:17:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:17:45.890494 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:45.905935 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875bc98-4169-44ca-b8e0-1a3fc7e9b04f None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:45.906254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875bc98-4169-44ca-b8e0-1a3fc7e9b04f None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:45.906531 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4875bc98-4169-44ca-b8e0-1a3fc7e9b04f None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:45.907400 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9fa5c-1c8b-440c-8b17-6e0a2861ab81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:17:45.907888 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 699/1400] 10.222.0.40 () {54 vars in 943 bytes} [Wed Jul 27 15:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:17:45.909028 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9fa5c-1c8b-440c-8b17-6e0a2861ab81 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:17:45.914081 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843c2b4-5a74-475e-a77a-fca4c56e4a73 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:45.914368 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843c2b4-5a74-475e-a77a-fca4c56e4a73 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:45.914647 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0843c2b4-5a74-475e-a77a-fca4c56e4a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:45.933153 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 702/1401] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:17:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:17:45.993569 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-0843c2b4-5a74-475e-a77a-fca4c56e4a73 None None] MFA Rules not processed for user `68bbf8bb59a84829afacd9677c9639a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:17:45.994814 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-0843c2b4-5a74-475e-a77a-fca4c56e4a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:46.111824 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 700/1402] 10.222.0.40 () {58 vars in 1040 bytes} [Wed Jul 27 15:17:45 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:17:46.122513 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9fa5c-1c8b-440c-8b17-6e0a2861ab81 service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:17:46.123861 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3cb9fa5c-1c8b-440c-8b17-6e0a2861ab81 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:46.215917 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9fa5c-1c8b-440c-8b17-6e0a2861ab81 service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:17:46.319302 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0229a55d-485a-46d9-8ceb-bee44f8641d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68bbf8bb59a84829afacd9677c9639a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:17:46.319973 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229a55d-485a-46d9-8ceb-bee44f8641d1 service swift] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:46.320138 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229a55d-485a-46d9-8ceb-bee44f8641d1 service swift] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:46.320411 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0229a55d-485a-46d9-8ceb-bee44f8641d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:46.322837 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0229a55d-485a-46d9-8ceb-bee44f8641d1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:46.332024 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:46.408208 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229a55d-485a-46d9-8ceb-bee44f8641d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:17:46.409801 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0229a55d-485a-46d9-8ceb-bee44f8641d1 service swift] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:17:46.418653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 703/1403] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Jul 27 15:17:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 15:17:47.992594 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8e0ba-638b-453d-90e2-b8b1daf1736a None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:47.993156 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8e0ba-638b-453d-90e2-b8b1daf1736a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:47.993156 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f8e0ba-638b-453d-90e2-b8b1daf1736a None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:47.995399 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 701/1404] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:17:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:17:48.000757 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce243d-fac0-47d1-aa34-9b21089e6039 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:48.001273 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce243d-fac0-47d1-aa34-9b21089e6039 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:48.001362 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ce243d-fac0-47d1-aa34-9b21089e6039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:48.075691 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-19ce243d-fac0-47d1-aa34-9b21089e6039 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:17:48.077115 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-19ce243d-fac0-47d1-aa34-9b21089e6039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:48.184115 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:48.187520 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 704/1405] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:17:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:17:48.234027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8e0ba-638b-453d-90e2-b8b1daf1736a None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:17:48.235572 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-72f8e0ba-638b-453d-90e2-b8b1daf1736a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:48.308447 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:48.397756 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f8e0ba-638b-453d-90e2-b8b1daf1736a None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:17:48.527872 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193d3ab0-2323-45ed-ab66-367e54503287 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:17:48.528539 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d3ab0-2323-45ed-ab66-367e54503287 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:48.528830 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d3ab0-2323-45ed-ab66-367e54503287 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:48.529108 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193d3ab0-2323-45ed-ab66-367e54503287 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:48.530755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-193d3ab0-2323-45ed-ab66-367e54503287 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:48.554211 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:48.636395 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d3ab0-2323-45ed-ab66-367e54503287 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:17:48.638030 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193d3ab0-2323-45ed-ab66-367e54503287 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:17:48.656620 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 702/1406] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:17:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:17:50.716583 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3567b-d9ca-4c7c-88ed-35dd8b867a75 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:50.717140 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3567b-d9ca-4c7c-88ed-35dd8b867a75 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:50.717140 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d3567b-d9ca-4c7c-88ed-35dd8b867a75 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:50.718618 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 705/1407] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:17:50.723766 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b8ffe-244c-42ca-b042-a3d5ee1367ac None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:50.724314 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b8ffe-244c-42ca-b042-a3d5ee1367ac None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:50.724406 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b8ffe-244c-42ca-b042-a3d5ee1367ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:50.795956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-1e0b8ffe-244c-42ca-b042-a3d5ee1367ac None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:17:50.797567 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-1e0b8ffe-244c-42ca-b042-a3d5ee1367ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:50.899602 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:50.908038 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 703/1408] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:17:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:17:50.949143 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3567b-d9ca-4c7c-88ed-35dd8b867a75 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:17:50.950689 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a8d3567b-d9ca-4c7c-88ed-35dd8b867a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:51.119513 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d3567b-d9ca-4c7c-88ed-35dd8b867a75 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:17:51.199160 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:17:51.245382 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c5f7e-1a21-4550-8011-6941db847a25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:17:51.246308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c5f7e-1a21-4550-8011-6941db847a25 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:17:51.246754 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c5f7e-1a21-4550-8011-6941db847a25 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:17:51.247191 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c5f7e-1a21-4550-8011-6941db847a25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:17:51.248996 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5b7c5f7e-1a21-4550-8011-6941db847a25 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:17:51.352408 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c5f7e-1a21-4550-8011-6941db847a25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:17:51.354047 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c5f7e-1a21-4550-8011-6941db847a25 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:17:51.391131 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 706/1409] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:17:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:18:00.905378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:01.389069 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=62 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:08.514581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9375d59-0364-4c3f-8098-9526c7668ea3 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:08.515178 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9375d59-0364-4c3f-8098-9526c7668ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:08.515178 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9375d59-0364-4c3f-8098-9526c7668ea3 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:08.516489 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 704/1410] 10.222.0.40 () {54 vars in 918 bytes} [Wed Jul 27 15:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:18:08.521480 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349c49a-c4c7-49e7-9245-3aa629742780 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:08.521942 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349c49a-c4c7-49e7-9245-3aa629742780 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:08.522045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b349c49a-c4c7-49e7-9245-3aa629742780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:08.600448 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b349c49a-c4c7-49e7-9245-3aa629742780 None None] MFA Rules not processed for user `a386d326dc634cbd943ac30f6e8d08bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:18:08.601654 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b349c49a-c4c7-49e7-9245-3aa629742780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:08.710599 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 707/1411] 10.222.0.40 () {58 vars in 1015 bytes} [Wed Jul 27 15:18:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:18:08.724776 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de83f81-ebc1-47a5-8bec-296eb716fe86 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:08.725060 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de83f81-ebc1-47a5-8bec-296eb716fe86 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:08.725335 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de83f81-ebc1-47a5-8bec-296eb716fe86 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:08.726665 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 705/1412] 10.222.0.40 () {54 vars in 918 bytes} [Wed Jul 27 15:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:18:08.731118 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb29fac-73ec-4ef9-a84e-ea0634a05029 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:08.731405 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb29fac-73ec-4ef9-a84e-ea0634a05029 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:08.731677 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb29fac-73ec-4ef9-a84e-ea0634a05029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:08.804812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:08.808514 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-1eb29fac-73ec-4ef9-a84e-ea0634a05029 None None] MFA Rules not processed for user `d3e01aa0ef1340cbba7170bac4a82783`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:18:08.810315 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1eb29fac-73ec-4ef9-a84e-ea0634a05029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:08.926368 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 708/1413] 10.222.0.40 () {58 vars in 1015 bytes} [Wed Jul 27 15:18:08 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:18:11.414288 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc45e5-1f67-4987-90c9-ac62e2c96bc7 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:11.414812 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc45e5-1f67-4987-90c9-ac62e2c96bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:11.414812 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccc45e5-1f67-4987-90c9-ac62e2c96bc7 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:11.416120 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 15:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:18:11.421501 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee232b6-fc85-4b27-a8d2-afb662d0c3ab None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:11.421952 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee232b6-fc85-4b27-a8d2-afb662d0c3ab None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:11.422035 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee232b6-fc85-4b27-a8d2-afb662d0c3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:11.491648 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-eee232b6-fc85-4b27-a8d2-afb662d0c3ab None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:18:11.494539 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-eee232b6-fc85-4b27-a8d2-afb662d0c3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:11.549849 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:11.600743 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 15:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:18:11.645697 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc45e5-1f67-4987-90c9-ac62e2c96bc7 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:18:11.647360 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-bccc45e5-1f67-4987-90c9-ac62e2c96bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:11.791172 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccc45e5-1f67-4987-90c9-ac62e2c96bc7 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:18:11.865598 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:11.905181 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f119c-4ee8-4927-832b-7c2253c1ccf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:18:11.905789 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f119c-4ee8-4927-832b-7c2253c1ccf7 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:11.906067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f119c-4ee8-4927-832b-7c2253c1ccf7 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:11.906334 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f119c-4ee8-4927-832b-7c2253c1ccf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:11.907949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6b9f119c-4ee8-4927-832b-7c2253c1ccf7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:11.997134 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f119c-4ee8-4927-832b-7c2253c1ccf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:18:11.998716 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f119c-4ee8-4927-832b-7c2253c1ccf7 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:18:12.016964 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 707/1416] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:18:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:18:12.938103 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ee3c5-397b-4c10-b533-2805ffff2c24 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:12.938668 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ee3c5-397b-4c10-b533-2805ffff2c24 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:12.938840 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ee3c5-397b-4c10-b533-2805ffff2c24 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:12.940976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 15:18:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:18:12.945850 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8f34e-b754-401a-b6e5-edd6962a4986 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:12.946309 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8f34e-b754-401a-b6e5-edd6962a4986 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:12.946477 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8f34e-b754-401a-b6e5-edd6962a4986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:13.020830 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-bca8f34e-b754-401a-b6e5-edd6962a4986 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:18:13.022039 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-bca8f34e-b754-401a-b6e5-edd6962a4986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:13.049361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:13.119513 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 15:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:18:13.267001 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ee3c5-397b-4c10-b533-2805ffff2c24 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:18:13.268503 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0f2ee3c5-397b-4c10-b533-2805ffff2c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:13.411714 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ee3c5-397b-4c10-b533-2805ffff2c24 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:18:13.452414 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:13.523725 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c6ac2-c332-4f28-8470-6cfc3fb2efa5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:18:13.524302 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c6ac2-c332-4f28-8470-6cfc3fb2efa5 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:13.525160 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c6ac2-c332-4f28-8470-6cfc3fb2efa5 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:13.525431 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c6ac2-c332-4f28-8470-6cfc3fb2efa5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:13.527037 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ec8c6ac2-c332-4f28-8470-6cfc3fb2efa5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:13.618423 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c6ac2-c332-4f28-8470-6cfc3fb2efa5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:18:13.620042 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c6ac2-c332-4f28-8470-6cfc3fb2efa5 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:18:13.638188 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 711/1419] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:18:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:18:14.513906 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf373ae-93d3-4466-b24e-631586ea8dfd None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:14.514433 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf373ae-93d3-4466-b24e-631586ea8dfd None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:14.514433 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf373ae-93d3-4466-b24e-631586ea8dfd None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:14.515743 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 15:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:18:14.520825 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b93e0b-c73e-4364-bbab-9c457fe60ba5 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:14.521285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b93e0b-c73e-4364-bbab-9c457fe60ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:14.521396 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b93e0b-c73e-4364-bbab-9c457fe60ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:14.575325 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:14.597379 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-54b93e0b-c73e-4364-bbab-9c457fe60ba5 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:18:14.598587 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-54b93e0b-c73e-4364-bbab-9c457fe60ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:14.695486 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 15:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:18:14.848169 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf373ae-93d3-4466-b24e-631586ea8dfd None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:18:14.849671 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8cf373ae-93d3-4466-b24e-631586ea8dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:14.992131 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf373ae-93d3-4466-b24e-631586ea8dfd None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:18:15.004291 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:15.103562 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d88c0-9f48-447d-8f54-0a8ccf787759 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:18:15.104121 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d88c0-9f48-447d-8f54-0a8ccf787759 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:15.104405 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d88c0-9f48-447d-8f54-0a8ccf787759 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:15.104677 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d88c0-9f48-447d-8f54-0a8ccf787759 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:15.106455 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-652d88c0-9f48-447d-8f54-0a8ccf787759 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:15.193462 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d88c0-9f48-447d-8f54-0a8ccf787759 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:18:15.195035 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d88c0-9f48-447d-8f54-0a8ccf787759 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:18:15.220687 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 710/1422] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:18:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:18:16.080503 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de7450-09ad-4955-9547-c883718e2612 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:16.081055 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de7450-09ad-4955-9547-c883718e2612 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:16.081055 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69de7450-09ad-4955-9547-c883718e2612 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:16.082400 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 15:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:18:16.087389 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17738e48-da28-45f2-9019-5ed7d6fd033e None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:16.087932 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17738e48-da28-45f2-9019-5ed7d6fd033e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:16.087932 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17738e48-da28-45f2-9019-5ed7d6fd033e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:16.107199 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:16.164794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-17738e48-da28-45f2-9019-5ed7d6fd033e None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:18:16.166021 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-17738e48-da28-45f2-9019-5ed7d6fd033e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:16.261457 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 15:18:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:18:16.412278 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de7450-09ad-4955-9547-c883718e2612 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:18:16.413975 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-69de7450-09ad-4955-9547-c883718e2612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:16.525642 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:16.563014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69de7450-09ad-4955-9547-c883718e2612 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:18:16.675155 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d9214b-9d02-4472-ba94-6baf0a9a7551 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:18:16.675694 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9214b-9d02-4472-ba94-6baf0a9a7551 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:16.675975 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9214b-9d02-4472-ba94-6baf0a9a7551 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:16.676277 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d9214b-9d02-4472-ba94-6baf0a9a7551 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:16.677913 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-99d9214b-9d02-4472-ba94-6baf0a9a7551 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:16.753592 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:16.766969 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9214b-9d02-4472-ba94-6baf0a9a7551 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:18:16.768631 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d9214b-9d02-4472-ba94-6baf0a9a7551 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:18:16.786649 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 714/1425] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:18:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:18:17.634668 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b129a-605b-46a7-b6d2-db9a54f1cbed None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:17.635171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b129a-605b-46a7-b6d2-db9a54f1cbed None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:17.635314 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291b129a-605b-46a7-b6d2-db9a54f1cbed None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:17.636648 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 15:18:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:18:17.641606 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01af929-764e-4a86-b23e-913c7dfd3cfb None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:17.642019 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01af929-764e-4a86-b23e-913c7dfd3cfb None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:17.642165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01af929-764e-4a86-b23e-913c7dfd3cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:17.716724 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-c01af929-764e-4a86-b23e-913c7dfd3cfb None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:18:17.717937 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c01af929-764e-4a86-b23e-913c7dfd3cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:17.813450 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 15:18:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:18:17.960699 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b129a-605b-46a7-b6d2-db9a54f1cbed None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:18:17.962163 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-291b129a-605b-46a7-b6d2-db9a54f1cbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:18.044334 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:18.106218 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291b129a-605b-46a7-b6d2-db9a54f1cbed None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:18:18.216043 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576df86-c2c6-48de-aec8-fe6c7897cfc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:18:18.216597 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576df86-c2c6-48de-aec8-fe6c7897cfc1 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:18.216879 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576df86-c2c6-48de-aec8-fe6c7897cfc1 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:18.217155 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576df86-c2c6-48de-aec8-fe6c7897cfc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:18.218779 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9576df86-c2c6-48de-aec8-fe6c7897cfc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:18.265946 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:18.307101 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9576df86-c2c6-48de-aec8-fe6c7897cfc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:18:18.308964 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9576df86-c2c6-48de-aec8-fe6c7897cfc1 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:18:18.330710 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 713/1428] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:18:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:18:19.144878 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781733c-7a05-4d13-a4c8-49816b61f3de None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:19.145456 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781733c-7a05-4d13-a4c8-49816b61f3de None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:19.145456 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781733c-7a05-4d13-a4c8-49816b61f3de None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:19.146792 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 15:18:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:18:19.151794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b214d7f-54e8-48c3-9556-6487a277890a None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:19.152246 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b214d7f-54e8-48c3-9556-6487a277890a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:19.152355 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b214d7f-54e8-48c3-9556-6487a277890a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:19.226691 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-7b214d7f-54e8-48c3-9556-6487a277890a None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:18:19.227876 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-7b214d7f-54e8-48c3-9556-6487a277890a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:19.323101 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 15:18:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:18:19.473107 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c781733c-7a05-4d13-a4c8-49816b61f3de None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:18:19.474552 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c781733c-7a05-4d13-a4c8-49816b61f3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:19.523510 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:19.624198 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c781733c-7a05-4d13-a4c8-49816b61f3de None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:18:19.736313 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf40ecbd-f8ca-460c-ade3-4416bd319625 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:18:19.736855 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40ecbd-f8ca-460c-ade3-4416bd319625 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:19.737137 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40ecbd-f8ca-460c-ade3-4416bd319625 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:19.737414 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf40ecbd-f8ca-460c-ade3-4416bd319625 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:19.739042 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bf40ecbd-f8ca-460c-ade3-4416bd319625 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:19.746419 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:19.828415 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf40ecbd-f8ca-460c-ade3-4416bd319625 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:18:19.830050 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf40ecbd-f8ca-460c-ade3-4416bd319625 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:18:19.847887 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 717/1431] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:18:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:18:20.650086 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0af2fb-577a-4c24-a506-c7fbfc5a8421 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:20.650635 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0af2fb-577a-4c24-a506-c7fbfc5a8421 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:20.650635 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0af2fb-577a-4c24-a506-c7fbfc5a8421 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:20.652011 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 15:18:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:18:20.657037 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71fa28a-efda-46b1-8d9a-1ea8421d3a89 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:20.657464 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71fa28a-efda-46b1-8d9a-1ea8421d3a89 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:20.657619 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71fa28a-efda-46b1-8d9a-1ea8421d3a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:20.737642 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d71fa28a-efda-46b1-8d9a-1ea8421d3a89 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:18:20.738854 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d71fa28a-efda-46b1-8d9a-1ea8421d3a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:20.805991 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:20.834671 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 15:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:18:20.984530 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0af2fb-577a-4c24-a506-c7fbfc5a8421 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:18:20.986049 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-3d0af2fb-577a-4c24-a506-c7fbfc5a8421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:21.003031 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:21.127514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0af2fb-577a-4c24-a506-c7fbfc5a8421 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:18:21.214984 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:21.240934 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ca3dd-f03f-46a0-b6b4-40aa3efb459e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:18:21.241548 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ca3dd-f03f-46a0-b6b4-40aa3efb459e service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:21.241827 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ca3dd-f03f-46a0-b6b4-40aa3efb459e service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:21.242096 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ca3dd-f03f-46a0-b6b4-40aa3efb459e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:21.243732 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f88ca3dd-f03f-46a0-b6b4-40aa3efb459e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:21.331548 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ca3dd-f03f-46a0-b6b4-40aa3efb459e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:18:21.333200 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ca3dd-f03f-46a0-b6b4-40aa3efb459e service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:18:21.351268 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 716/1434] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:18:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 15:18:22.156930 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba3dd9-bcd0-4a34-9a1e-e9d54c9b847e None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:22.157429 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba3dd9-bcd0-4a34-9a1e-e9d54c9b847e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:22.157534 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba3dd9-bcd0-4a34-9a1e-e9d54c9b847e None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:22.158863 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 15:18:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:18:22.164112 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0f5a9-102d-4ff8-826e-69c9a66d7f81 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:22.164539 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0f5a9-102d-4ff8-826e-69c9a66d7f81 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:22.164692 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0f5a9-102d-4ff8-826e-69c9a66d7f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:22.243277 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-19c0f5a9-102d-4ff8-826e-69c9a66d7f81 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:18:22.244439 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-19c0f5a9-102d-4ff8-826e-69c9a66d7f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:22.285277 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:22.342809 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 15:18:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:18:22.492379 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba3dd9-bcd0-4a34-9a1e-e9d54c9b847e None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:18:22.494605 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e4ba3dd9-bcd0-4a34-9a1e-e9d54c9b847e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:22.637099 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba3dd9-bcd0-4a34-9a1e-e9d54c9b847e None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:18:22.691797 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:22.756639 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8278ad00-0a0e-4686-babb-0ffc5e26a7f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:18:22.757174 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278ad00-0a0e-4686-babb-0ffc5e26a7f8 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:22.757458 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278ad00-0a0e-4686-babb-0ffc5e26a7f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:22.757734 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8278ad00-0a0e-4686-babb-0ffc5e26a7f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:22.759399 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8278ad00-0a0e-4686-babb-0ffc5e26a7f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:22.846882 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278ad00-0a0e-4686-babb-0ffc5e26a7f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:18:22.848497 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8278ad00-0a0e-4686-babb-0ffc5e26a7f8 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:18:22.866848 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 720/1437] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:18:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:18:23.683644 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa06fe9-607e-48f6-8b1c-324c656305d8 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:23.684229 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa06fe9-607e-48f6-8b1c-324c656305d8 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:23.684229 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa06fe9-607e-48f6-8b1c-324c656305d8 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:23.685603 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 15:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:18:23.690488 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bce69-5974-4f96-80f9-3ba5603e4a7d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:23.690876 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bce69-5974-4f96-80f9-3ba5603e4a7d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:23.691033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0bce69-5974-4f96-80f9-3ba5603e4a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:23.765594 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-da0bce69-5974-4f96-80f9-3ba5603e4a7d None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:18:23.766784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-da0bce69-5974-4f96-80f9-3ba5603e4a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:23.768792 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:23.863753 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 15:18:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:18:24.011922 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa06fe9-607e-48f6-8b1c-324c656305d8 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:18:24.013483 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-daa06fe9-607e-48f6-8b1c-324c656305d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:24.157391 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa06fe9-607e-48f6-8b1c-324c656305d8 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:18:24.183779 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:24.268249 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d21942-4648-47d9-b424-902cdb12c435 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:18:24.268865 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d21942-4648-47d9-b424-902cdb12c435 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:24.269146 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d21942-4648-47d9-b424-902cdb12c435 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:24.269418 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d21942-4648-47d9-b424-902cdb12c435 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:24.271040 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a5d21942-4648-47d9-b424-902cdb12c435 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:24.371453 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d21942-4648-47d9-b424-902cdb12c435 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:18:24.373053 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d21942-4648-47d9-b424-902cdb12c435 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:18:24.391185 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 719/1440] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:18:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:18:26.277060 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d822ab-6634-477c-9f8d-2d92b3a7019a None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:26.277641 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d822ab-6634-477c-9f8d-2d92b3a7019a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:26.277641 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d822ab-6634-477c-9f8d-2d92b3a7019a None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:26.278951 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 15:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:18:26.284286 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394938f9-9986-472f-a3b6-2708676b7145 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:26.284713 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394938f9-9986-472f-a3b6-2708676b7145 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:26.284822 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394938f9-9986-472f-a3b6-2708676b7145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:26.325118 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:26.350444 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-394938f9-9986-472f-a3b6-2708676b7145 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:18:26.351574 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-394938f9-9986-472f-a3b6-2708676b7145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:26.445976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 15:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:18:26.483888 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d822ab-6634-477c-9f8d-2d92b3a7019a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:18:26.485494 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e4d822ab-6634-477c-9f8d-2d92b3a7019a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:26.593889 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d822ab-6634-477c-9f8d-2d92b3a7019a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:18:26.626086 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:26.667818 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d2870-79aa-4e6a-847b-b134da175bbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:18:26.668465 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d2870-79aa-4e6a-847b-b134da175bbb service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:26.668751 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d2870-79aa-4e6a-847b-b134da175bbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:26.669025 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d2870-79aa-4e6a-847b-b134da175bbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:26.670659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b62d2870-79aa-4e6a-847b-b134da175bbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:26.780793 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d2870-79aa-4e6a-847b-b134da175bbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:18:26.782226 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d2870-79aa-4e6a-847b-b134da175bbb service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:18:26.800782 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 723/1443] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:18:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:18:28.924339 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2117e-0006-47c5-920e-696c51d06a45 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:28.924897 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2117e-0006-47c5-920e-696c51d06a45 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:28.924995 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2117e-0006-47c5-920e-696c51d06a45 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:28.926312 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 15:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:18:28.932120 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b52a2-ac97-45b9-84b2-35d8ddf6b3c4 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:28.932504 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b52a2-ac97-45b9-84b2-35d8ddf6b3c4 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:28.932692 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48b52a2-ac97-45b9-84b2-35d8ddf6b3c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:28.997612 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f48b52a2-ac97-45b9-84b2-35d8ddf6b3c4 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:18:28.998825 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f48b52a2-ac97-45b9-84b2-35d8ddf6b3c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:29.012117 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:29.098152 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 15:18:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:18:29.136571 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2117e-0006-47c5-920e-696c51d06a45 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:18:29.138091 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-97d2117e-0006-47c5-920e-696c51d06a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:29.238572 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2117e-0006-47c5-920e-696c51d06a45 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:18:29.250648 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:29.310649 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0ee25-a5ff-4a0c-916b-0410f40c3264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:18:29.311257 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0ee25-a5ff-4a0c-916b-0410f40c3264 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:29.311537 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0ee25-a5ff-4a0c-916b-0410f40c3264 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:29.311809 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0ee25-a5ff-4a0c-916b-0410f40c3264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:29.313457 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-14f0ee25-a5ff-4a0c-916b-0410f40c3264 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:29.424409 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f0ee25-a5ff-4a0c-916b-0410f40c3264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:18:29.425849 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f0ee25-a5ff-4a0c-916b-0410f40c3264 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:18:29.444618 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 722/1446] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:18:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:18:31.749074 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce57ba-43c3-4fc4-82ac-fb8635e60265 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:31.749636 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce57ba-43c3-4fc4-82ac-fb8635e60265 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:31.749636 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ce57ba-43c3-4fc4-82ac-fb8635e60265 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:31.751030 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 15:18:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:18:31.756332 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db962a-0386-43e1-9575-1ad66138949e None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:31.756762 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db962a-0386-43e1-9575-1ad66138949e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:31.756884 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db962a-0386-43e1-9575-1ad66138949e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:31.806725 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:31.824875 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-65db962a-0386-43e1-9575-1ad66138949e None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:18:31.826072 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-65db962a-0386-43e1-9575-1ad66138949e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:31.921674 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 15:18:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:18:31.959672 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce57ba-43c3-4fc4-82ac-fb8635e60265 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:18:31.961258 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a1ce57ba-43c3-4fc4-82ac-fb8635e60265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:32.064961 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ce57ba-43c3-4fc4-82ac-fb8635e60265 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:18:32.105664 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:32.140570 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64511c0-22a1-4a20-a0db-9a43c49fab0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:18:32.141182 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64511c0-22a1-4a20-a0db-9a43c49fab0e service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:32.141467 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64511c0-22a1-4a20-a0db-9a43c49fab0e service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:32.141745 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64511c0-22a1-4a20-a0db-9a43c49fab0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:32.143369 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a64511c0-22a1-4a20-a0db-9a43c49fab0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:32.252219 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64511c0-22a1-4a20-a0db-9a43c49fab0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:18:32.253576 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64511c0-22a1-4a20-a0db-9a43c49fab0e service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:18:32.271366 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 726/1449] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:18:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:18:34.366179 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77420449-0031-4643-9514-58937bb25358 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:34.366707 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77420449-0031-4643-9514-58937bb25358 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:34.366707 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77420449-0031-4643-9514-58937bb25358 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:34.368652 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 15:18:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:18:34.373915 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f54a73-f47d-49d3-989c-81d53376141d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:34.374341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f54a73-f47d-49d3-989c-81d53376141d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:34.374452 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f54a73-f47d-49d3-989c-81d53376141d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:34.559597 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-83f54a73-f47d-49d3-989c-81d53376141d None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:18:34.560828 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-83f54a73-f47d-49d3-989c-81d53376141d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:34.581051 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:34.656306 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 15:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:18:34.695283 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77420449-0031-4643-9514-58937bb25358 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:18:34.696908 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-77420449-0031-4643-9514-58937bb25358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:34.803814 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77420449-0031-4643-9514-58937bb25358 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:18:34.823264 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:34.876625 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c4c509-7cfa-475c-b8fc-0fe251cd4580 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:18:34.877241 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4c509-7cfa-475c-b8fc-0fe251cd4580 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:34.877528 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4c509-7cfa-475c-b8fc-0fe251cd4580 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:34.877800 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c4c509-7cfa-475c-b8fc-0fe251cd4580 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:34.879420 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-c0c4c509-7cfa-475c-b8fc-0fe251cd4580 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:34.985906 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4c509-7cfa-475c-b8fc-0fe251cd4580 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:18:34.987271 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c4c509-7cfa-475c-b8fc-0fe251cd4580 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:18:35.005319 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 725/1452] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:18:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:18:37.024577 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5771f-98c9-4f82-81aa-11cba862ef9a None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:37.025124 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5771f-98c9-4f82-81aa-11cba862ef9a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:37.025124 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e5771f-98c9-4f82-81aa-11cba862ef9a None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:37.026384 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 15:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:18:37.032096 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5096b-3489-4cca-8d9b-92a7f9ee41d5 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:37.032760 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5096b-3489-4cca-8d9b-92a7f9ee41d5 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:37.032760 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5096b-3489-4cca-8d9b-92a7f9ee41d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:37.097076 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:37.100202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-dff5096b-3489-4cca-8d9b-92a7f9ee41d5 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:18:37.101888 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-dff5096b-3489-4cca-8d9b-92a7f9ee41d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:37.198510 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 15:18:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:18:37.236464 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5771f-98c9-4f82-81aa-11cba862ef9a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:18:37.237985 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c3e5771f-98c9-4f82-81aa-11cba862ef9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:37.339238 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e5771f-98c9-4f82-81aa-11cba862ef9a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:18:37.392186 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:37.418178 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3119558-240c-4024-a775-94955131525e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:18:37.418784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3119558-240c-4024-a775-94955131525e service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:37.419060 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3119558-240c-4024-a775-94955131525e service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:37.419330 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3119558-240c-4024-a775-94955131525e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:37.420963 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b3119558-240c-4024-a775-94955131525e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:37.527885 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3119558-240c-4024-a775-94955131525e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:18:37.529328 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3119558-240c-4024-a775-94955131525e service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:18:37.547165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 729/1455] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:18:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:18:39.632743 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68431d-8902-4873-80d2-19923d87d9c5 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:39.633831 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68431d-8902-4873-80d2-19923d87d9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:39.633831 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e68431d-8902-4873-80d2-19923d87d9c5 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:39.635202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 15:18:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:18:39.640551 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269b02b-db72-4aff-8c56-bfd0d2ee49b8 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:39.640981 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269b02b-db72-4aff-8c56-bfd0d2ee49b8 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:39.641094 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6269b02b-db72-4aff-8c56-bfd0d2ee49b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:39.707772 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-6269b02b-db72-4aff-8c56-bfd0d2ee49b8 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:18:39.709052 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6269b02b-db72-4aff-8c56-bfd0d2ee49b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:39.738908 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:39.807812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 15:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:18:39.844896 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68431d-8902-4873-80d2-19923d87d9c5 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:18:39.846372 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-7e68431d-8902-4873-80d2-19923d87d9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:39.948332 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e68431d-8902-4873-80d2-19923d87d9c5 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:18:39.976567 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:40.020284 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b23fa-abc4-4daf-b790-f962f4e3a5af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:18:40.020895 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b23fa-abc4-4daf-b790-f962f4e3a5af service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:40.021172 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b23fa-abc4-4daf-b790-f962f4e3a5af service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:40.021438 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b23fa-abc4-4daf-b790-f962f4e3a5af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:40.023037 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a40b23fa-abc4-4daf-b790-f962f4e3a5af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:40.143315 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b23fa-abc4-4daf-b790-f962f4e3a5af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:18:40.144773 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b23fa-abc4-4daf-b790-f962f4e3a5af service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:18:40.163862 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 728/1458] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:18:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:18:42.209496 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3129b05-98e3-41c3-9152-7ac325e69b2f None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:42.210047 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3129b05-98e3-41c3-9152-7ac325e69b2f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:42.210047 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3129b05-98e3-41c3-9152-7ac325e69b2f None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:42.211407 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 15:18:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:18:42.216639 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf22fa-9626-465e-bda7-9c847c97a265 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:42.217064 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf22fa-9626-465e-bda7-9c847c97a265 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:42.217197 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecf22fa-9626-465e-bda7-9c847c97a265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:42.281362 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-6ecf22fa-9626-465e-bda7-9c847c97a265 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:18:42.282558 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6ecf22fa-9626-465e-bda7-9c847c97a265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:42.290907 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:42.377724 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 15:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:18:42.416172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3129b05-98e3-41c3-9152-7ac325e69b2f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:18:42.417720 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c3129b05-98e3-41c3-9152-7ac325e69b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:42.519267 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3129b05-98e3-41c3-9152-7ac325e69b2f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:18:42.574524 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:42.593764 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aff67c-002d-4667-93d6-5a3167f3de9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:18:42.594385 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aff67c-002d-4667-93d6-5a3167f3de9a service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:42.594668 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aff67c-002d-4667-93d6-5a3167f3de9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:42.594940 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aff67c-002d-4667-93d6-5a3167f3de9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:42.596594 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b6aff67c-002d-4667-93d6-5a3167f3de9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:42.703258 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aff67c-002d-4667-93d6-5a3167f3de9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:18:42.704643 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aff67c-002d-4667-93d6-5a3167f3de9a service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:18:42.722875 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 732/1461] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:18:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:18:44.852465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3052f-31a4-4cee-9334-94b47a7f7942 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:44.852994 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3052f-31a4-4cee-9334-94b47a7f7942 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:44.853321 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a3052f-31a4-4cee-9334-94b47a7f7942 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:44.855472 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 15:18:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:18:44.861857 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da6238-4c68-4bd7-a799-a36c9590ae2d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:44.862304 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da6238-4c68-4bd7-a799-a36c9590ae2d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:44.862417 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da6238-4c68-4bd7-a799-a36c9590ae2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:44.940327 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f9da6238-4c68-4bd7-a799-a36c9590ae2d None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:18:44.941569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f9da6238-4c68-4bd7-a799-a36c9590ae2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:44.981886 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:45.039287 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 15:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:18:45.076955 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3052f-31a4-4cee-9334-94b47a7f7942 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:18:45.078506 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e3a3052f-31a4-4cee-9334-94b47a7f7942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:45.179525 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a3052f-31a4-4cee-9334-94b47a7f7942 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:18:45.224196 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:45.260006 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb46f7-95f6-4d57-a3d8-e0523999ca43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:18:45.260638 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb46f7-95f6-4d57-a3d8-e0523999ca43 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:45.260919 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb46f7-95f6-4d57-a3d8-e0523999ca43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:45.261188 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb46f7-95f6-4d57-a3d8-e0523999ca43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:45.262798 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-4fdb46f7-95f6-4d57-a3d8-e0523999ca43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:45.367348 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb46f7-95f6-4d57-a3d8-e0523999ca43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:18:45.369336 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdb46f7-95f6-4d57-a3d8-e0523999ca43 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:18:45.387392 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 731/1464] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:18:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:18:47.388367 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4a6ed-311b-4501-b703-7069ce279d51 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:47.388914 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4a6ed-311b-4501-b703-7069ce279d51 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:47.388914 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4a6ed-311b-4501-b703-7069ce279d51 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:47.390270 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 15:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:18:47.395567 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8a387-d3e5-4d34-8eac-99647020d5bb None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:47.396029 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8a387-d3e5-4d34-8eac-99647020d5bb None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:47.396184 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae8a387-d3e5-4d34-8eac-99647020d5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:47.461491 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-2ae8a387-d3e5-4d34-8eac-99647020d5bb None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:18:47.462679 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-2ae8a387-d3e5-4d34-8eac-99647020d5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:47.480575 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:47.559798 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 15:18:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:18:47.597144 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4a6ed-311b-4501-b703-7069ce279d51 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:18:47.598753 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4fe4a6ed-311b-4501-b703-7069ce279d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:47.701146 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4a6ed-311b-4501-b703-7069ce279d51 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:18:47.767973 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:47.775377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7a1e6-d59d-4278-b0e3-ae967fd04ec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:18:47.776005 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7a1e6-d59d-4278-b0e3-ae967fd04ec3 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:47.776306 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7a1e6-d59d-4278-b0e3-ae967fd04ec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:47.776580 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7a1e6-d59d-4278-b0e3-ae967fd04ec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:47.778214 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5bc7a1e6-d59d-4278-b0e3-ae967fd04ec3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:47.887258 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7a1e6-d59d-4278-b0e3-ae967fd04ec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:18:47.888715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7a1e6-d59d-4278-b0e3-ae967fd04ec3 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:18:47.906360 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 735/1467] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:18:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:18:49.917267 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748485d0-3bad-40a4-bca2-7474afc0853d None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:49.917873 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748485d0-3bad-40a4-bca2-7474afc0853d None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:49.917873 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748485d0-3bad-40a4-bca2-7474afc0853d None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:49.919067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 15:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:18:49.924333 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51903221-22e9-45c8-bec4-fe708c384498 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:49.924747 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51903221-22e9-45c8-bec4-fe708c384498 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:49.924886 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51903221-22e9-45c8-bec4-fe708c384498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:49.989639 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-51903221-22e9-45c8-bec4-fe708c384498 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:18:49.990834 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-51903221-22e9-45c8-bec4-fe708c384498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:50.038204 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:50.088707 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 15:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:18:50.126076 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748485d0-3bad-40a4-bca2-7474afc0853d None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:18:50.127649 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-748485d0-3bad-40a4-bca2-7474afc0853d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:50.229420 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748485d0-3bad-40a4-bca2-7474afc0853d None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:18:50.276974 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:18:50.302878 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a7df42-f080-4c45-9715-6652254ba86e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:18:50.303489 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7df42-f080-4c45-9715-6652254ba86e service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:18:50.303772 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7df42-f080-4c45-9715-6652254ba86e service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:18:50.304082 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7df42-f080-4c45-9715-6652254ba86e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:18:50.305721 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-87a7df42-f080-4c45-9715-6652254ba86e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:18:50.415191 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a7df42-f080-4c45-9715-6652254ba86e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:18:50.416677 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a7df42-f080-4c45-9715-6652254ba86e service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:18:50.434684 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 734/1470] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:18:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:19:00.086937 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=22 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:19:00.432552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=66 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:19:10.108353 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83c760-8ca9-43a5-b210-4f25a8f60f2e None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:19:10.108960 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83c760-8ca9-43a5-b210-4f25a8f60f2e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:19:10.108960 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83c760-8ca9-43a5-b210-4f25a8f60f2e None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:19:10.110243 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 737/1471] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:19:10.115562 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17350afe-ce34-4fef-bfb2-40b85d7b0cc3 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:19:10.115955 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17350afe-ce34-4fef-bfb2-40b85d7b0cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:19:10.116208 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17350afe-ce34-4fef-bfb2-40b85d7b0cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:19:10.181235 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-17350afe-ce34-4fef-bfb2-40b85d7b0cc3 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:19:10.182418 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-17350afe-ce34-4fef-bfb2-40b85d7b0cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:19:10.275232 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 735/1472] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:19:10.357583 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e56f4-166a-485a-a488-b9e9ee55dd48 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:19:10.357863 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e56f4-166a-485a-a488-b9e9ee55dd48 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:19:10.358133 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e56f4-166a-485a-a488-b9e9ee55dd48 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:19:10.359475 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 738/1473] 10.222.0.40 () {54 vars in 966 bytes} [Wed Jul 27 15:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:19:10.364441 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325aba2-08e3-4424-91e6-7186ed5db285 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:19:10.364729 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325aba2-08e3-4424-91e6-7186ed5db285 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:19:10.365007 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325aba2-08e3-4424-91e6-7186ed5db285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:19:10.439278 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-0325aba2-08e3-4424-91e6-7186ed5db285 None None] MFA Rules not processed for user `2f71721ca75a461d92044091564de424`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:19:10.440506 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-0325aba2-08e3-4424-91e6-7186ed5db285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:19:10.460944 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:19:10.516111 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 736/1474] 10.222.0.40 () {58 vars in 1063 bytes} [Wed Jul 27 15:19:10 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:19:10.523579 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e56f4-166a-485a-a488-b9e9ee55dd48 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:19:10.525117 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d81e56f4-166a-485a-a488-b9e9ee55dd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:19:10.629010 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e56f4-166a-485a-a488-b9e9ee55dd48 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:19:10.701099 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1087d-bd75-4867-8632-7d8787650143 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f71721ca75a461d92044091564de424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:19:10.701711 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1087d-bd75-4867-8632-7d8787650143 service glance] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:19:10.701992 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1087d-bd75-4867-8632-7d8787650143 service glance] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:19:10.702263 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1087d-bd75-4867-8632-7d8787650143 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:19:10.703914 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-78b1087d-bd75-4867-8632-7d8787650143 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:19:10.757057 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:19:10.811759 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1087d-bd75-4867-8632-7d8787650143 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:19:10.813203 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1087d-bd75-4867-8632-7d8787650143 service glance] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:19:10.831616 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 739/1475] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:19:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:19:12.948049 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd23955-e975-4af5-887d-406a383fd37f None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:19:12.948580 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd23955-e975-4af5-887d-406a383fd37f None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:19:12.948580 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd23955-e975-4af5-887d-406a383fd37f None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:19:12.949859 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 737/1476] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:19:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:19:12.955111 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853df2a-d91f-4b6f-a5ec-358e1f645f1a None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:19:12.955586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853df2a-d91f-4b6f-a5ec-358e1f645f1a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:19:12.955694 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4853df2a-d91f-4b6f-a5ec-358e1f645f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:19:13.020475 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4853df2a-d91f-4b6f-a5ec-358e1f645f1a None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:19:13.021658 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4853df2a-d91f-4b6f-a5ec-358e1f645f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:19:13.116439 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 740/1477] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:19:13.140354 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd23955-e975-4af5-887d-406a383fd37f None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:19:13.141865 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-7fd23955-e975-4af5-887d-406a383fd37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:19:13.264933 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd23955-e975-4af5-887d-406a383fd37f None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:19:13.313314 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:19:13.358074 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2afbb6-ed04-4e4e-a360-26eae12a2387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:19:13.358684 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2afbb6-ed04-4e4e-a360-26eae12a2387 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:19:13.358970 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2afbb6-ed04-4e4e-a360-26eae12a2387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:19:13.359242 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2afbb6-ed04-4e4e-a360-26eae12a2387 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:19:13.359930 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2afbb6-ed04-4e4e-a360-26eae12a2387 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:19:13.361724 dv-cinder-841315-2-smb devstack@keystone.service[80057]: WARNING py.warnings [None req-1b2afbb6-ed04-4e4e-a360-26eae12a2387 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:19:13.361724 dv-cinder-841315-2-smb devstack@keystone.service[80057]: warnings.warn(msg) Jul 27 15:19:13.361724 dv-cinder-841315-2-smb devstack@keystone.service[80057]: Jul 27 15:19:13.362857 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2afbb6-ed04-4e4e-a360-26eae12a2387 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:19:13.381139 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 738/1478] 10.222.0.40 () {56 vars in 1108 bytes} [Wed Jul 27 15:19:13 2022] GET /identity/v3/projects => generated 2553 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 15:19:15.375406 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f374447-26de-4544-8c99-adc710251d11 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:19:15.376018 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f374447-26de-4544-8c99-adc710251d11 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:19:15.376018 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f374447-26de-4544-8c99-adc710251d11 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:19:15.377289 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 741/1479] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:19:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:19:15.382368 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf613c2-26c9-4afc-877c-c101a8970ef5 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:19:15.382796 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf613c2-26c9-4afc-877c-c101a8970ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:19:15.382921 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf613c2-26c9-4afc-877c-c101a8970ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:19:15.447419 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-3cf613c2-26c9-4afc-877c-c101a8970ef5 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:19:15.448653 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-3cf613c2-26c9-4afc-877c-c101a8970ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:19:15.545619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 739/1480] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:19:15.589320 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f374447-26de-4544-8c99-adc710251d11 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:19:15.591326 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0f374447-26de-4544-8c99-adc710251d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:19:15.601226 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:19:15.736387 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f374447-26de-4544-8c99-adc710251d11 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:19:15.814003 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:19:15.846850 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55208eab-ff49-4a0c-98ff-36265d149902 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:19:15.847454 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55208eab-ff49-4a0c-98ff-36265d149902 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:19:15.847731 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55208eab-ff49-4a0c-98ff-36265d149902 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:19:15.848017 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55208eab-ff49-4a0c-98ff-36265d149902 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:19:15.849665 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-55208eab-ff49-4a0c-98ff-36265d149902 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:19:15.946160 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55208eab-ff49-4a0c-98ff-36265d149902 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:19:15.947746 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55208eab-ff49-4a0c-98ff-36265d149902 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:19:15.966054 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 742/1481] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:19:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:19:18.122017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bf3d5-27cc-430a-9ad9-7b5323cb6f27 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:19:18.122427 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bf3d5-27cc-430a-9ad9-7b5323cb6f27 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:19:18.122608 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bf3d5-27cc-430a-9ad9-7b5323cb6f27 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:19:18.123910 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 740/1482] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:19:18.129100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017f69a-edc8-4103-ac59-dce324131060 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:19:18.129585 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017f69a-edc8-4103-ac59-dce324131060 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:19:18.129683 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0017f69a-edc8-4103-ac59-dce324131060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:19:18.195634 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-0017f69a-edc8-4103-ac59-dce324131060 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:19:18.196841 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0017f69a-edc8-4103-ac59-dce324131060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:19:18.241215 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:19:18.291467 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 743/1483] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:19:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:19:18.328146 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bf3d5-27cc-430a-9ad9-7b5323cb6f27 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:19:18.329663 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f26bf3d5-27cc-430a-9ad9-7b5323cb6f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:19:18.353354 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:19:18.432309 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bf3d5-27cc-430a-9ad9-7b5323cb6f27 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:19:18.503410 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6871bad4-5416-44e4-811d-bc3b7f1c9b32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:19:18.504038 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871bad4-5416-44e4-811d-bc3b7f1c9b32 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:19:18.504319 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871bad4-5416-44e4-811d-bc3b7f1c9b32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:19:18.504607 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871bad4-5416-44e4-811d-bc3b7f1c9b32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:19:18.506247 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6871bad4-5416-44e4-811d-bc3b7f1c9b32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:19:18.580679 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:19:18.617844 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6871bad4-5416-44e4-811d-bc3b7f1c9b32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:19:18.619318 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6871bad4-5416-44e4-811d-bc3b7f1c9b32 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:19:18.638116 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 741/1484] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:19:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:19:20.657218 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207ab87-3e2b-49af-b0c5-51e9f2e1349b None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:19:20.657840 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207ab87-3e2b-49af-b0c5-51e9f2e1349b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:19:20.657840 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4207ab87-3e2b-49af-b0c5-51e9f2e1349b None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:19:20.659106 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 744/1485] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:19:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:19:20.664398 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201d261-bf31-470b-8bef-64b0b698b1cb None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:19:20.664869 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201d261-bf31-470b-8bef-64b0b698b1cb None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:19:20.664973 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201d261-bf31-470b-8bef-64b0b698b1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:19:20.729393 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-0201d261-bf31-470b-8bef-64b0b698b1cb None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:19:20.730619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-0201d261-bf31-470b-8bef-64b0b698b1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:19:20.826008 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 742/1486] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:19:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:19:20.863515 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207ab87-3e2b-49af-b0c5-51e9f2e1349b None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:19:20.865071 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4207ab87-3e2b-49af-b0c5-51e9f2e1349b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:19:20.967813 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4207ab87-3e2b-49af-b0c5-51e9f2e1349b None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:19:21.037197 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:19:21.039148 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29c2d2-e538-4128-8f4b-9957e0b0f7b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:19:21.039757 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29c2d2-e538-4128-8f4b-9957e0b0f7b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:19:21.040251 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29c2d2-e538-4128-8f4b-9957e0b0f7b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:19:21.040734 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29c2d2-e538-4128-8f4b-9957e0b0f7b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:19:21.042518 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ce29c2d2-e538-4128-8f4b-9957e0b0f7b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:19:21.152423 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29c2d2-e538-4128-8f4b-9957e0b0f7b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:19:21.153769 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29c2d2-e538-4128-8f4b-9957e0b0f7b3 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:19:21.171614 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 745/1487] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:19:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:19:23.289148 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786f1f2-5010-4582-ad6e-da3ecb1aa68e None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:19:23.289693 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786f1f2-5010-4582-ad6e-da3ecb1aa68e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:19:23.289693 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e786f1f2-5010-4582-ad6e-da3ecb1aa68e None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:19:23.291121 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 743/1488] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:19:23.296490 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb139c5b-5695-4652-930b-0112694f3563 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:19:23.296905 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb139c5b-5695-4652-930b-0112694f3563 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:19:23.297052 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb139c5b-5695-4652-930b-0112694f3563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:19:23.363403 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-bb139c5b-5695-4652-930b-0112694f3563 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:19:23.364658 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bb139c5b-5695-4652-930b-0112694f3563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:19:23.418797 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:19:23.463740 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 746/1489] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:19:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:19:23.514648 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786f1f2-5010-4582-ad6e-da3ecb1aa68e None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:19:23.516229 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e786f1f2-5010-4582-ad6e-da3ecb1aa68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:19:23.555247 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:19:23.624324 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e786f1f2-5010-4582-ad6e-da3ecb1aa68e None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:19:23.695980 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba13452a-0f70-4ccd-b335-7f086a3d3d7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:19:23.696642 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13452a-0f70-4ccd-b335-7f086a3d3d7a service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:19:23.696922 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13452a-0f70-4ccd-b335-7f086a3d3d7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:19:23.697195 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba13452a-0f70-4ccd-b335-7f086a3d3d7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:19:23.698870 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ba13452a-0f70-4ccd-b335-7f086a3d3d7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:19:23.777417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:19:23.806347 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13452a-0f70-4ccd-b335-7f086a3d3d7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:19:23.807769 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba13452a-0f70-4ccd-b335-7f086a3d3d7a service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:19:23.826317 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 744/1490] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:19:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:19:26.013941 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7575c-b693-45d2-a405-f4113e6c87f3 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:19:26.014472 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7575c-b693-45d2-a405-f4113e6c87f3 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:19:26.014472 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7575c-b693-45d2-a405-f4113e6c87f3 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:19:26.015763 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 747/1491] 10.222.0.40 () {54 vars in 926 bytes} [Wed Jul 27 15:19:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:19:26.021269 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d316a26-56e7-439d-9ff2-f5b96880d19a None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:19:26.021674 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d316a26-56e7-439d-9ff2-f5b96880d19a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:19:26.021814 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d316a26-56e7-439d-9ff2-f5b96880d19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:19:26.088354 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-6d316a26-56e7-439d-9ff2-f5b96880d19a None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:19:26.089547 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6d316a26-56e7-439d-9ff2-f5b96880d19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:19:26.188262 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 745/1492] 10.222.0.40 () {58 vars in 1023 bytes} [Wed Jul 27 15:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:19:26.228944 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7575c-b693-45d2-a405-f4113e6c87f3 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:19:26.230481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-98d7575c-b693-45d2-a405-f4113e6c87f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:19:26.352457 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7575c-b693-45d2-a405-f4113e6c87f3 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:19:26.424810 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb50a591-c12d-468b-9816-382dc3e3ece6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:19:26.425420 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50a591-c12d-468b-9816-382dc3e3ece6 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:19:26.425697 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50a591-c12d-468b-9816-382dc3e3ece6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:19:26.425966 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb50a591-c12d-468b-9816-382dc3e3ece6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:19:26.427578 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bb50a591-c12d-468b-9816-382dc3e3ece6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:19:26.438161 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:19:26.537663 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50a591-c12d-468b-9816-382dc3e3ece6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:19:26.539653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb50a591-c12d-468b-9816-382dc3e3ece6 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:19:26.558004 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 748/1493] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:19:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:19:36.186438 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=82 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:19:36.556394 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=50 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:21:00.546110 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc4843-a236-4905-8fda-0a3679aa5655 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:21:00.546681 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc4843-a236-4905-8fda-0a3679aa5655 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:21:00.546681 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdc4843-a236-4905-8fda-0a3679aa5655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:21:00.622144 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-bcdc4843-a236-4905-8fda-0a3679aa5655 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:21:00.623343 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-bcdc4843-a236-4905-8fda-0a3679aa5655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:21:00.717462 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 746/1494] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:21:00.725495 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f084d1-39e1-4da3-b01e-ba3d24536313 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:21:00.726003 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f084d1-39e1-4da3-b01e-ba3d24536313 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:21:00.726107 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f084d1-39e1-4da3-b01e-ba3d24536313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:21:00.799620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-55f084d1-39e1-4da3-b01e-ba3d24536313 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:21:00.800759 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-55f084d1-39e1-4da3-b01e-ba3d24536313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:21:00.894156 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 749/1495] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:21:00.899442 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc4843-a236-4905-8fda-0a3679aa5655 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:21:00.900718 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-bcdc4843-a236-4905-8fda-0a3679aa5655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:21:00.912067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdc4843-a236-4905-8fda-0a3679aa5655 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:21:00.972241 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:21:01.009470 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcf275-18b6-4aff-9efb-805eebe3b880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:21:01.010087 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcf275-18b6-4aff-9efb-805eebe3b880 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:21:01.010370 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcf275-18b6-4aff-9efb-805eebe3b880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:21:01.010647 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcf275-18b6-4aff-9efb-805eebe3b880 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:21:01.011334 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dcf275-18b6-4aff-9efb-805eebe3b880 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:21:01.011637 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dcf275-18b6-4aff-9efb-805eebe3b880 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:21:01.012682 dv-cinder-841315-2-smb devstack@keystone.service[80057]: WARNING py.warnings [None req-16dcf275-18b6-4aff-9efb-805eebe3b880 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:21:01.012682 dv-cinder-841315-2-smb devstack@keystone.service[80057]: warnings.warn(msg) Jul 27 15:21:01.012682 dv-cinder-841315-2-smb devstack@keystone.service[80057]: Jul 27 15:21:01.013564 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dcf275-18b6-4aff-9efb-805eebe3b880 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:21:01.024482 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 747/1496] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:21:01.032721 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f084d1-39e1-4da3-b01e-ba3d24536313 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:21:01.042013 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f084d1-39e1-4da3-b01e-ba3d24536313 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:21:01.102637 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:21:01.136422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b2002-3cc5-4243-a311-4408a979d0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:21:01.137025 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b2002-3cc5-4243-a311-4408a979d0b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:21:01.137305 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b2002-3cc5-4243-a311-4408a979d0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:21:01.137574 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b2002-3cc5-4243-a311-4408a979d0b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:21:01.138235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b2002-3cc5-4243-a311-4408a979d0b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:21:01.139940 dv-cinder-841315-2-smb devstack@keystone.service[80058]: WARNING py.warnings [None req-b39b2002-3cc5-4243-a311-4408a979d0b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:21:01.139940 dv-cinder-841315-2-smb devstack@keystone.service[80058]: warnings.warn(msg) Jul 27 15:21:01.139940 dv-cinder-841315-2-smb devstack@keystone.service[80058]: Jul 27 15:21:01.141162 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b2002-3cc5-4243-a311-4408a979d0b0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:21:01.195816 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 750/1497] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:21:01 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:21:01.199980 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcf275-18b6-4aff-9efb-805eebe3b880 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:21:01.201519 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-16dcf275-18b6-4aff-9efb-805eebe3b880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:21:01.234201 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcf275-18b6-4aff-9efb-805eebe3b880 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:21:01.328377 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee948d65-7c5b-4c4a-8b4e-aac96164e994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:21:01.328986 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee948d65-7c5b-4c4a-8b4e-aac96164e994 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:21:01.329266 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee948d65-7c5b-4c4a-8b4e-aac96164e994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:21:01.329540 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee948d65-7c5b-4c4a-8b4e-aac96164e994 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:21:01.330192 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee948d65-7c5b-4c4a-8b4e-aac96164e994 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:21:01.331204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: WARNING py.warnings [None req-ee948d65-7c5b-4c4a-8b4e-aac96164e994 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:21:01.331204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: warnings.warn(msg) Jul 27 15:21:01.331204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: Jul 27 15:21:01.332436 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee948d65-7c5b-4c4a-8b4e-aac96164e994 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:21:01.374078 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 748/1498] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:21:01 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:21:01.378195 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b2002-3cc5-4243-a311-4408a979d0b0 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:21:01.379772 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b39b2002-3cc5-4243-a311-4408a979d0b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:21:01.443277 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b2002-3cc5-4243-a311-4408a979d0b0 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:21:01.530529 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:21:01.541501 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac5dd4-03fd-41ef-bd42-692177fb2baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:21:01.542108 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac5dd4-03fd-41ef-bd42-692177fb2baf admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:21:01.542388 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac5dd4-03fd-41ef-bd42-692177fb2baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:21:01.542659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac5dd4-03fd-41ef-bd42-692177fb2baf admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:21:01.543344 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac5dd4-03fd-41ef-bd42-692177fb2baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:21:01.544379 dv-cinder-841315-2-smb devstack@keystone.service[80058]: WARNING py.warnings [None req-efac5dd4-03fd-41ef-bd42-692177fb2baf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:21:01.544379 dv-cinder-841315-2-smb devstack@keystone.service[80058]: warnings.warn(msg) Jul 27 15:21:01.544379 dv-cinder-841315-2-smb devstack@keystone.service[80058]: Jul 27 15:21:01.545267 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac5dd4-03fd-41ef-bd42-692177fb2baf admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:21:01.557298 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 751/1499] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:21:01.561334 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee948d65-7c5b-4c4a-8b4e-aac96164e994 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:21:01.562869 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ee948d65-7c5b-4c4a-8b4e-aac96164e994 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:21:01.574925 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee948d65-7c5b-4c4a-8b4e-aac96164e994 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:21:01.601016 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:21:01.671195 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d48a12f-6f87-49c4-9074-edaa9b3ac1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:21:01.671745 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48a12f-6f87-49c4-9074-edaa9b3ac1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:21:01.672045 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48a12f-6f87-49c4-9074-edaa9b3ac1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:21:01.672320 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d48a12f-6f87-49c4-9074-edaa9b3ac1f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:21:01.673009 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d48a12f-6f87-49c4-9074-edaa9b3ac1f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:21:01.674017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: WARNING py.warnings [None req-1d48a12f-6f87-49c4-9074-edaa9b3ac1f7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:21:01.674017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: warnings.warn(msg) Jul 27 15:21:01.674017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: Jul 27 15:21:01.674894 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d48a12f-6f87-49c4-9074-edaa9b3ac1f7 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:21:01.687438 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 749/1500] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:21:01.691646 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac5dd4-03fd-41ef-bd42-692177fb2baf admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:21:01.693202 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-efac5dd4-03fd-41ef-bd42-692177fb2baf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:21:01.726119 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac5dd4-03fd-41ef-bd42-692177fb2baf admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:21:01.822624 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0b7b63-5cf8-42af-a848-d3dd604e62f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:21:01.823403 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b7b63-5cf8-42af-a848-d3dd604e62f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:21:01.823704 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b7b63-5cf8-42af-a848-d3dd604e62f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:21:01.824076 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0b7b63-5cf8-42af-a848-d3dd604e62f5 admin admin] PATH_INFO: `/v3/projects/b39522ac29b7495990831557e181fe3d/users/ccefeb6534bc4a998d7c2e91897015bb/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:21:01.846859 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b7b63-5cf8-42af-a848-d3dd604e62f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b39522ac29b7495990831557e181fe3d, user_id=ccefeb6534bc4a998d7c2e91897015bb, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:21:01.847876 dv-cinder-841315-2-smb devstack@keystone.service[80058]: WARNING py.warnings [None req-7e0b7b63-5cf8-42af-a848-d3dd604e62f5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:21:01.847876 dv-cinder-841315-2-smb devstack@keystone.service[80058]: warnings.warn(msg) Jul 27 15:21:01.847876 dv-cinder-841315-2-smb devstack@keystone.service[80058]: Jul 27 15:21:01.849884 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0b7b63-5cf8-42af-a848-d3dd604e62f5 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:21:01.873865 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 752/1501] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:21:01 2022] PUT /identity/v3/projects/b39522ac29b7495990831557e181fe3d/users/ccefeb6534bc4a998d7c2e91897015bb/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:21:01.886734 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f54ac-cc29-4888-9902-ba0a7bf53c52 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:21:01.887025 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f54ac-cc29-4888-9902-ba0a7bf53c52 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:21:01.887305 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984f54ac-cc29-4888-9902-ba0a7bf53c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:21:01.943746 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-984f54ac-cc29-4888-9902-ba0a7bf53c52 None None] MFA Rules not processed for user `ccefeb6534bc4a998d7c2e91897015bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:21:01.945453 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-984f54ac-cc29-4888-9902-ba0a7bf53c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:21:02.020843 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 750/1502] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:21:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:21:02.033920 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db13f29-91ca-41fb-af06-d69954662d1c None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:21:02.034209 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db13f29-91ca-41fb-af06-d69954662d1c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:21:02.034483 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db13f29-91ca-41fb-af06-d69954662d1c None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:21:02.035817 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 753/1503] 10.222.0.40 () {54 vars in 964 bytes} [Wed Jul 27 15:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:21:02.041407 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a85ae2-85bc-4f13-99ee-3408b7d5473a None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:21:02.041693 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a85ae2-85bc-4f13-99ee-3408b7d5473a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:21:02.041969 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a85ae2-85bc-4f13-99ee-3408b7d5473a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:21:02.078897 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:21:02.122504 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-c0a85ae2-85bc-4f13-99ee-3408b7d5473a None None] MFA Rules not processed for user `20aa56e1154649cb8b440dae788c922c`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:21:02.123699 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-c0a85ae2-85bc-4f13-99ee-3408b7d5473a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:21:02.197575 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 751/1504] 10.222.0.40 () {58 vars in 1061 bytes} [Wed Jul 27 15:21:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:21:02.205392 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db13f29-91ca-41fb-af06-d69954662d1c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:21:02.206909 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7db13f29-91ca-41fb-af06-d69954662d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:21:02.256508 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:21:02.310645 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db13f29-91ca-41fb-af06-d69954662d1c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:21:02.381001 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd42854-980c-4443-9806-79b721cd75bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:21:02.381619 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd42854-980c-4443-9806-79b721cd75bd service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:21:02.381898 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd42854-980c-4443-9806-79b721cd75bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:21:02.382168 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd42854-980c-4443-9806-79b721cd75bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:21:02.383765 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ffd42854-980c-4443-9806-79b721cd75bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:21:02.480434 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd42854-980c-4443-9806-79b721cd75bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:21:02.481766 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd42854-980c-4443-9806-79b721cd75bd service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:21:02.485203 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:21:02.499207 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 754/1505] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:21:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:21:02.546054 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12f4a0-eedd-4810-be42-43332c23580e None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:21:02.546344 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12f4a0-eedd-4810-be42-43332c23580e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:21:02.546623 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e12f4a0-eedd-4810-be42-43332c23580e None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:21:02.547887 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 752/1506] 10.222.0.40 () {52 vars in 830 bytes} [Wed Jul 27 15:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:21:02.551412 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd42854-980c-4443-9806-79b721cd75bd service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:21:02.552636 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ffd42854-980c-4443-9806-79b721cd75bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:21:02.649316 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd42854-980c-4443-9806-79b721cd75bd service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:21:02.741404 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b4f79-6b2f-4e6d-a293-95ca6f6633ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:21:02.742011 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b4f79-6b2f-4e6d-a293-95ca6f6633ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:21:02.742225 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b4f79-6b2f-4e6d-a293-95ca6f6633ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:21:02.742493 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b4f79-6b2f-4e6d-a293-95ca6f6633ab admin admin] PATH_INFO: `/v3/users/ccefeb6534bc4a998d7c2e91897015bb` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:21:02.754377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b4f79-6b2f-4e6d-a293-95ca6f6633ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=ccefeb6534bc4a998d7c2e91897015bb)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:21:02.755382 dv-cinder-841315-2-smb devstack@keystone.service[80058]: WARNING py.warnings [None req-ec9b4f79-6b2f-4e6d-a293-95ca6f6633ab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:21:02.755382 dv-cinder-841315-2-smb devstack@keystone.service[80058]: warnings.warn(msg) Jul 27 15:21:02.755382 dv-cinder-841315-2-smb devstack@keystone.service[80058]: Jul 27 15:21:02.756628 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b4f79-6b2f-4e6d-a293-95ca6f6633ab admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:21:02.766071 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:21:02.818591 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ec9b4f79-6b2f-4e6d-a293-95ca6f6633ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ccefeb6534bc4a998d7c2e91897015bb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:21:02.819641 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ec9b4f79-6b2f-4e6d-a293-95ca6f6633ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ccefeb6534bc4a998d7c2e91897015bb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:21:02.831658 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ec9b4f79-6b2f-4e6d-a293-95ca6f6633ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ccefeb6534bc4a998d7c2e91897015bb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:21:02.832128 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ec9b4f79-6b2f-4e6d-a293-95ca6f6633ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ccefeb6534bc4a998d7c2e91897015bb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:21:02.849904 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ec9b4f79-6b2f-4e6d-a293-95ca6f6633ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ccefeb6534bc4a998d7c2e91897015bb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:21:02.864783 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 755/1507] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:21:02 2022] DELETE /identity/v3/users/ccefeb6534bc4a998d7c2e91897015bb => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:21:02.869158 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e53ce-fddb-482f-9d74-a05a19f9caf1 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:21:02.869661 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e53ce-fddb-482f-9d74-a05a19f9caf1 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:21:02.869771 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e53ce-fddb-482f-9d74-a05a19f9caf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:21:02.926753 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-3f8e53ce-fddb-482f-9d74-a05a19f9caf1 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:21:02.927946 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-3f8e53ce-fddb-482f-9d74-a05a19f9caf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:21:03.000060 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:21:03.013817 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 753/1508] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:21:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:21:03.023860 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b4f79-6b2f-4e6d-a293-95ca6f6633ab admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:21:03.025147 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ec9b4f79-6b2f-4e6d-a293-95ca6f6633ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:21:03.127528 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b4f79-6b2f-4e6d-a293-95ca6f6633ab admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:21:03.181254 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:21:03.201519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ae9cf-6f8e-4057-86f3-a4b48eb1f207 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:21:03.202131 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ae9cf-6f8e-4057-86f3-a4b48eb1f207 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:21:03.202404 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ae9cf-6f8e-4057-86f3-a4b48eb1f207 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:21:03.202668 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ae9cf-6f8e-4057-86f3-a4b48eb1f207 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:21:03.204296 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-092ae9cf-6f8e-4057-86f3-a4b48eb1f207 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:21:03.315119 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ae9cf-6f8e-4057-86f3-a4b48eb1f207 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:21:03.316589 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ae9cf-6f8e-4057-86f3-a4b48eb1f207 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:21:03.335344 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 756/1509] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:21:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:21:03.661756 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e53ce-fddb-482f-9d74-a05a19f9caf1 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:21:03.663501 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-3f8e53ce-fddb-482f-9d74-a05a19f9caf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:21:03.675299 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e53ce-fddb-482f-9d74-a05a19f9caf1 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:21:03.774347 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e25e1-cb2c-463c-9e79-2b5ed7d53c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:21:03.774988 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e25e1-cb2c-463c-9e79-2b5ed7d53c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:21:03.775266 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e25e1-cb2c-463c-9e79-2b5ed7d53c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:21:03.775539 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e25e1-cb2c-463c-9e79-2b5ed7d53c17 admin admin] PATH_INFO: `/v3/projects/b39522ac29b7495990831557e181fe3d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:21:03.785365 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e25e1-cb2c-463c-9e79-2b5ed7d53c17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b39522ac29b7495990831557e181fe3d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:21:03.786387 dv-cinder-841315-2-smb devstack@keystone.service[80057]: WARNING py.warnings [None req-2b0e25e1-cb2c-463c-9e79-2b5ed7d53c17 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:21:03.786387 dv-cinder-841315-2-smb devstack@keystone.service[80057]: warnings.warn(msg) Jul 27 15:21:03.786387 dv-cinder-841315-2-smb devstack@keystone.service[80057]: Jul 27 15:21:03.787609 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e25e1-cb2c-463c-9e79-2b5ed7d53c17 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:21:03.845776 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2b0e25e1-cb2c-463c-9e79-2b5ed7d53c17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b39522ac29b7495990831557e181fe3d', 'request_id': 'req-2b0e25e1-cb2c-463c-9e79-2b5ed7d53c17'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:21:03.859101 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2b0e25e1-cb2c-463c-9e79-2b5ed7d53c17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b39522ac29b7495990831557e181fe3d', 'request_id': 'req-2b0e25e1-cb2c-463c-9e79-2b5ed7d53c17'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:21:03.865127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2b0e25e1-cb2c-463c-9e79-2b5ed7d53c17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b39522ac29b7495990831557e181fe3d', 'request_id': 'req-2b0e25e1-cb2c-463c-9e79-2b5ed7d53c17'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:21:03.890471 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2b0e25e1-cb2c-463c-9e79-2b5ed7d53c17 admin admin] The token cache is being invalidate because project b39522ac29b7495990831557e181fe3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:21:03.891059 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2b0e25e1-cb2c-463c-9e79-2b5ed7d53c17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:21:03.891163 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2b0e25e1-cb2c-463c-9e79-2b5ed7d53c17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:21:03.892606 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 754/1510] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:21:03 2022] DELETE /identity/v3/projects/b39522ac29b7495990831557e181fe3d => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:21:13.333067 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=62 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:21:13.888575 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:22:49.957614 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e79b7-28f0-45da-b6ac-5bbad3267fdb None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:22:49.958183 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e79b7-28f0-45da-b6ac-5bbad3267fdb None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:22:49.958183 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e79b7-28f0-45da-b6ac-5bbad3267fdb None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:22:49.959426 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 15:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:22:49.964936 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55beceb0-09f0-4011-a9fa-bb98a824d807 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:22:49.965341 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55beceb0-09f0-4011-a9fa-bb98a824d807 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:22:49.965473 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55beceb0-09f0-4011-a9fa-bb98a824d807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:22:50.044822 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-55beceb0-09f0-4011-a9fa-bb98a824d807 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:22:50.046000 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-55beceb0-09f0-4011-a9fa-bb98a824d807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:22:50.145980 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 15:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:22:50.301535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e79b7-28f0-45da-b6ac-5bbad3267fdb None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:22:50.303797 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-728e79b7-28f0-45da-b6ac-5bbad3267fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:22:50.422480 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e79b7-28f0-45da-b6ac-5bbad3267fdb None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:22:50.428184 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03f431-4062-4e2f-b385-f2fa75cde85d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:22:50.428797 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03f431-4062-4e2f-b385-f2fa75cde85d service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:22:50.429081 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03f431-4062-4e2f-b385-f2fa75cde85d service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:22:50.429357 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03f431-4062-4e2f-b385-f2fa75cde85d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:22:50.438241 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03f431-4062-4e2f-b385-f2fa75cde85d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:22:50.439826 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed03f431-4062-4e2f-b385-f2fa75cde85d service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:22:50.449860 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 758/1513] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:22:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:22:51.274175 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fbf23-cbb0-43a6-b588-cce62517a0c5 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:22:51.274745 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fbf23-cbb0-43a6-b588-cce62517a0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:22:51.274745 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64fbf23-cbb0-43a6-b588-cce62517a0c5 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:22:51.276646 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 15:22:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:22:51.282198 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ff50d-9eba-47ad-85fe-5e95a0dda839 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:22:51.282637 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ff50d-9eba-47ad-85fe-5e95a0dda839 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:22:51.282739 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ff50d-9eba-47ad-85fe-5e95a0dda839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:22:51.302679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-2d7ff50d-9eba-47ad-85fe-5e95a0dda839 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:22:51.303870 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2d7ff50d-9eba-47ad-85fe-5e95a0dda839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:22:51.312195 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 15:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:22:51.463045 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fbf23-cbb0-43a6-b588-cce62517a0c5 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:22:51.477887 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64fbf23-cbb0-43a6-b588-cce62517a0c5 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:22:51.483311 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503edbdd-0df1-440d-b79a-a13c40433489 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:22:51.483912 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503edbdd-0df1-440d-b79a-a13c40433489 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:22:51.484223 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503edbdd-0df1-440d-b79a-a13c40433489 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:22:51.484498 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503edbdd-0df1-440d-b79a-a13c40433489 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:22:51.492506 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503edbdd-0df1-440d-b79a-a13c40433489 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:22:51.494082 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503edbdd-0df1-440d-b79a-a13c40433489 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:22:51.503403 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 757/1516] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:22:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:22:51.794129 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006855b-c09d-4534-877f-312b1e54f786 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:22:51.794437 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006855b-c09d-4534-877f-312b1e54f786 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:22:51.794791 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006855b-c09d-4534-877f-312b1e54f786 None None] PATH_INFO: `/v3` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:22:51.796102 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 760/1517] 10.222.0.57 () {54 vars in 925 bytes} [Wed Jul 27 15:22:51 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:22:51.816618 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9a4f5-8793-4be2-b47b-916dffa67d3f None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:22:51.816911 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9a4f5-8793-4be2-b47b-916dffa67d3f None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:22:51.817189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d9a4f5-8793-4be2-b47b-916dffa67d3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:22:51.878395 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-98d9a4f5-8793-4be2-b47b-916dffa67d3f None None] MFA Rules not processed for user `a386d326dc634cbd943ac30f6e8d08bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:22:51.879590 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-98d9a4f5-8793-4be2-b47b-916dffa67d3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:22:51.896834 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:22:51.951441 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 758/1518] 10.222.0.57 () {58 vars in 1015 bytes} [Wed Jul 27 15:22:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:23:01.178727 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88db3e3-a3d0-429c-ad4e-5e8658b4e620 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:23:01.179323 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88db3e3-a3d0-429c-ad4e-5e8658b4e620 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:23:01.179323 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88db3e3-a3d0-429c-ad4e-5e8658b4e620 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:23:01.180555 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 761/1519] 10.222.0.40 () {54 vars in 961 bytes} [Wed Jul 27 15:23:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:23:01.185925 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecd043-c650-4a5e-8ae6-52dfb895bf95 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:23:01.186362 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecd043-c650-4a5e-8ae6-52dfb895bf95 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:23:01.186484 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecd043-c650-4a5e-8ae6-52dfb895bf95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:23:01.205489 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-50ecd043-c650-4a5e-8ae6-52dfb895bf95 None None] MFA Rules not processed for user `a386d326dc634cbd943ac30f6e8d08bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:23:01.206662 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-50ecd043-c650-4a5e-8ae6-52dfb895bf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:23:01.215054 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 759/1520] 10.222.0.40 () {58 vars in 1058 bytes} [Wed Jul 27 15:23:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:23:01.223266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88db3e3-a3d0-429c-ad4e-5e8658b4e620 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:23:01.237165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88db3e3-a3d0-429c-ad4e-5e8658b4e620 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:23:01.242050 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1204d-0818-4a4a-980e-0466d5659371 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a386d326dc634cbd943ac30f6e8d08bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:23:01.242643 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1204d-0818-4a4a-980e-0466d5659371 service placement] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:23:01.242931 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1204d-0818-4a4a-980e-0466d5659371 service placement] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:23:01.243204 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1204d-0818-4a4a-980e-0466d5659371 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:23:01.252124 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1204d-0818-4a4a-980e-0466d5659371 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:23:01.253695 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1204d-0818-4a4a-980e-0466d5659371 service placement] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:23:01.263336 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 762/1521] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:23:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:23:02.738194 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eac53e-c064-4e93-a673-02d36b548bfa None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:23:02.738785 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eac53e-c064-4e93-a673-02d36b548bfa None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:23:02.738785 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eac53e-c064-4e93-a673-02d36b548bfa None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:23:02.740141 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 15:23:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:23:02.744995 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd096e02-ae0e-40f4-9576-b5294b9ff27f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:23:02.745983 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd096e02-ae0e-40f4-9576-b5294b9ff27f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:23:02.746177 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd096e02-ae0e-40f4-9576-b5294b9ff27f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:23:02.765225 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-dd096e02-ae0e-40f4-9576-b5294b9ff27f None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:23:02.766419 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-dd096e02-ae0e-40f4-9576-b5294b9ff27f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:23:02.774263 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 15:23:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:23:02.930581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eac53e-c064-4e93-a673-02d36b548bfa None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:23:02.953380 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eac53e-c064-4e93-a673-02d36b548bfa None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:23:02.959215 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbddbac-b0f4-4ba6-9c65-fd33b0af6479 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:23:02.959828 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbddbac-b0f4-4ba6-9c65-fd33b0af6479 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:23:02.960142 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbddbac-b0f4-4ba6-9c65-fd33b0af6479 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:23:02.960607 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbddbac-b0f4-4ba6-9c65-fd33b0af6479 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:23:02.970709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbddbac-b0f4-4ba6-9c65-fd33b0af6479 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:23:02.972505 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbddbac-b0f4-4ba6-9c65-fd33b0af6479 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:23:02.983027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 761/1524] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:23:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:23:03.848336 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fdb9b-45c6-482a-8e76-79fa1c657f8a None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:23:03.848869 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fdb9b-45c6-482a-8e76-79fa1c657f8a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:23:03.848869 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fdb9b-45c6-482a-8e76-79fa1c657f8a None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:23:03.850160 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 15:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:23:03.854831 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e1ccb-7599-4a29-bd3c-d07c6e9fd4fa None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:23:03.855280 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e1ccb-7599-4a29-bd3c-d07c6e9fd4fa None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:23:03.855386 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568e1ccb-7599-4a29-bd3c-d07c6e9fd4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:23:03.876045 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-568e1ccb-7599-4a29-bd3c-d07c6e9fd4fa None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:23:03.877223 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-568e1ccb-7599-4a29-bd3c-d07c6e9fd4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:23:03.884870 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 15:23:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:23:04.035674 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fdb9b-45c6-482a-8e76-79fa1c657f8a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:23:04.050299 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fdb9b-45c6-482a-8e76-79fa1c657f8a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:23:04.055722 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e9b39-a127-4690-808f-4ef103fba1cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:23:04.056348 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e9b39-a127-4690-808f-4ef103fba1cc service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:23:04.056633 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e9b39-a127-4690-808f-4ef103fba1cc service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:23:04.056912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e9b39-a127-4690-808f-4ef103fba1cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:23:04.065382 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e9b39-a127-4690-808f-4ef103fba1cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:23:04.066957 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e9b39-a127-4690-808f-4ef103fba1cc service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:23:04.076840 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 765/1527] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:23:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:23:07.896042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b5c98-cc12-4d37-a8b9-1a26f037caa4 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:23:07.896585 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b5c98-cc12-4d37-a8b9-1a26f037caa4 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:23:07.896585 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b5c98-cc12-4d37-a8b9-1a26f037caa4 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:23:07.897929 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 15:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:23:07.902978 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebe6df-b22a-49ac-9f08-3af09c2df85f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:23:07.903377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebe6df-b22a-49ac-9f08-3af09c2df85f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:23:07.903563 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebe6df-b22a-49ac-9f08-3af09c2df85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:23:07.923430 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-09ebe6df-b22a-49ac-9f08-3af09c2df85f None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:23:07.924652 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-09ebe6df-b22a-49ac-9f08-3af09c2df85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:23:07.933230 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 15:23:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:23:08.007459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b5c98-cc12-4d37-a8b9-1a26f037caa4 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:23:08.009186 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d48b5c98-cc12-4d37-a8b9-1a26f037caa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:23:08.087355 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b5c98-cc12-4d37-a8b9-1a26f037caa4 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:23:08.091062 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9436d4cf-ec16-403e-9064-64dad100b6a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:23:08.091675 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436d4cf-ec16-403e-9064-64dad100b6a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:23:08.091956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436d4cf-ec16-403e-9064-64dad100b6a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:23:08.092259 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9436d4cf-ec16-403e-9064-64dad100b6a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:23:08.101029 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436d4cf-ec16-403e-9064-64dad100b6a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:23:08.102452 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9436d4cf-ec16-403e-9064-64dad100b6a4 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:23:08.112168 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 764/1530] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:23:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:23:10.067896 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d307781-9a5f-40aa-95dc-584b91aad4cd None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:23:10.068459 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d307781-9a5f-40aa-95dc-584b91aad4cd None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:23:10.068459 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d307781-9a5f-40aa-95dc-584b91aad4cd None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:23:10.069855 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 15:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:23:10.075354 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34488537-a3d8-4eeb-abe4-0adb70183c6d None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:23:10.075784 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34488537-a3d8-4eeb-abe4-0adb70183c6d None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:23:10.075924 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34488537-a3d8-4eeb-abe4-0adb70183c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:23:10.095525 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-34488537-a3d8-4eeb-abe4-0adb70183c6d None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:23:10.096726 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-34488537-a3d8-4eeb-abe4-0adb70183c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:23:10.104378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 15:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:23:10.139805 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d307781-9a5f-40aa-95dc-584b91aad4cd None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:23:10.150662 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d307781-9a5f-40aa-95dc-584b91aad4cd None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:23:10.154697 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87964d1-a912-4ee9-9f42-0c4083ae37fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:23:10.155297 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87964d1-a912-4ee9-9f42-0c4083ae37fe service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:23:10.155582 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87964d1-a912-4ee9-9f42-0c4083ae37fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:23:10.155857 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87964d1-a912-4ee9-9f42-0c4083ae37fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:23:10.164663 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87964d1-a912-4ee9-9f42-0c4083ae37fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:23:10.166337 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87964d1-a912-4ee9-9f42-0c4083ae37fe service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:23:10.175976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 768/1533] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:23:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:23:13.704048 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743a84e-78d8-4d01-8359-ca1a0c33d734 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:23:13.704548 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743a84e-78d8-4d01-8359-ca1a0c33d734 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:23:13.704644 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a743a84e-78d8-4d01-8359-ca1a0c33d734 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:23:13.705959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 15:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:23:13.711132 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5bb2e-4600-497f-a2ed-ea99e997577e None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:23:13.711536 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5bb2e-4600-497f-a2ed-ea99e997577e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:23:13.711675 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b5bb2e-4600-497f-a2ed-ea99e997577e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:23:13.719169 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=81 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:23:13.731642 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a6b5bb2e-4600-497f-a2ed-ea99e997577e None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:23:13.732878 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a6b5bb2e-4600-497f-a2ed-ea99e997577e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:23:13.740543 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 15:23:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:23:14.040737 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743a84e-78d8-4d01-8359-ca1a0c33d734 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:23:14.042664 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a743a84e-78d8-4d01-8359-ca1a0c33d734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:23:14.106024 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:23:14.119369 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a743a84e-78d8-4d01-8359-ca1a0c33d734 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:23:14.122914 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c40d40-2408-4905-b189-e2cd8059ed33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:23:14.123528 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c40d40-2408-4905-b189-e2cd8059ed33 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:23:14.123835 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c40d40-2408-4905-b189-e2cd8059ed33 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:23:14.124150 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c40d40-2408-4905-b189-e2cd8059ed33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:23:14.133158 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c40d40-2408-4905-b189-e2cd8059ed33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:23:14.134566 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c40d40-2408-4905-b189-e2cd8059ed33 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:23:14.144371 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 767/1536] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:23:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:23:16.141361 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca4eec-5e5b-40b9-9a08-fef485ae1e61 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:23:16.141902 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca4eec-5e5b-40b9-9a08-fef485ae1e61 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:23:16.141902 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca4eec-5e5b-40b9-9a08-fef485ae1e61 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:23:16.143228 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 15:23:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:23:16.148444 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a60df2-d6d6-42d0-b110-0f64186f4177 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:23:16.148870 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a60df2-d6d6-42d0-b110-0f64186f4177 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:23:16.149042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a60df2-d6d6-42d0-b110-0f64186f4177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:23:16.168662 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-87a60df2-d6d6-42d0-b110-0f64186f4177 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:23:16.170387 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-87a60df2-d6d6-42d0-b110-0f64186f4177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:23:16.178227 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 15:23:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:23:16.488125 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca4eec-5e5b-40b9-9a08-fef485ae1e61 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:23:16.489811 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-adca4eec-5e5b-40b9-9a08-fef485ae1e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:23:16.502602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca4eec-5e5b-40b9-9a08-fef485ae1e61 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:23:16.506144 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e341a8f4-31ff-49bd-8d43-ff9cf6fd1b57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:23:16.506740 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341a8f4-31ff-49bd-8d43-ff9cf6fd1b57 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:23:16.507024 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341a8f4-31ff-49bd-8d43-ff9cf6fd1b57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:23:16.507301 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e341a8f4-31ff-49bd-8d43-ff9cf6fd1b57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:23:16.516073 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341a8f4-31ff-49bd-8d43-ff9cf6fd1b57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:23:16.517486 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e341a8f4-31ff-49bd-8d43-ff9cf6fd1b57 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:23:16.526774 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 771/1539] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:23:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:23:26.163798 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=11 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:23:26.522738 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=8 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:24:52.807763 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181de723-ab4b-449d-9da2-74d4e0926b98 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:52.810772 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181de723-ab4b-449d-9da2-74d4e0926b98 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:52.811509 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181de723-ab4b-449d-9da2-74d4e0926b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:52.837132 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-181de723-ab4b-449d-9da2-74d4e0926b98 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:24:52.838918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-181de723-ab4b-449d-9da2-74d4e0926b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:24:52.849935 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 769/1540] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:24:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:24:52.859254 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c8586-b1ca-4079-80bb-ccdc3bf57f8b None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:52.860450 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c8586-b1ca-4079-80bb-ccdc3bf57f8b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:52.861020 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c8586-b1ca-4079-80bb-ccdc3bf57f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:52.888710 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4c0c8586-b1ca-4079-80bb-ccdc3bf57f8b None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:24:52.890338 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4c0c8586-b1ca-4079-80bb-ccdc3bf57f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:24:52.902734 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 772/1541] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:24:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:24:52.907669 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181de723-ab4b-449d-9da2-74d4e0926b98 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:52.920333 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181de723-ab4b-449d-9da2-74d4e0926b98 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:52.927745 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ddeca1-a2ab-4e38-be27-ed32372fa50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:52.928664 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddeca1-a2ab-4e38-be27-ed32372fa50f admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:52.929186 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddeca1-a2ab-4e38-be27-ed32372fa50f admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:52.929691 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ddeca1-a2ab-4e38-be27-ed32372fa50f admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:52.930620 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ddeca1-a2ab-4e38-be27-ed32372fa50f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:24:52.931166 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ddeca1-a2ab-4e38-be27-ed32372fa50f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:52.932998 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ddeca1-a2ab-4e38-be27-ed32372fa50f admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:52.955156 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 770/1542] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:24:52.963045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c8586-b1ca-4079-80bb-ccdc3bf57f8b None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:52.973705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c8586-b1ca-4079-80bb-ccdc3bf57f8b None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:52.979677 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cb7a5-2509-441d-9528-b4227a77477b None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:52.980337 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cb7a5-2509-441d-9528-b4227a77477b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:52.982540 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64cb7a5-2509-441d-9528-b4227a77477b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:52.991794 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b720d2-76d4-431e-a7f3-f1f20b4f76e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:52.993576 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b720d2-76d4-431e-a7f3-f1f20b4f76e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:52.994104 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b720d2-76d4-431e-a7f3-f1f20b4f76e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:52.995687 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b720d2-76d4-431e-a7f3-f1f20b4f76e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:52.999230 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b720d2-76d4-431e-a7f3-f1f20b4f76e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:53.002961 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b720d2-76d4-431e-a7f3-f1f20b4f76e1 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:53.027653 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-c64cb7a5-2509-441d-9528-b4227a77477b None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:24:53.030565 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-c64cb7a5-2509-441d-9528-b4227a77477b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:24:53.051016 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 771/1543] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:24:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:24:53.065336 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968220b-4854-405c-a95d-8b31ccac5ad2 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:53.066591 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968220b-4854-405c-a95d-8b31ccac5ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:53.067109 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968220b-4854-405c-a95d-8b31ccac5ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:53.115002 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 773/1544] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:24:52 2022] POST /identity/v3/projects => generated 383 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:24:53.120728 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b720d2-76d4-431e-a7f3-f1f20b4f76e1 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:53.135779 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-e968220b-4854-405c-a95d-8b31ccac5ad2 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:24:53.137372 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e968220b-4854-405c-a95d-8b31ccac5ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:24:53.273282 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b720d2-76d4-431e-a7f3-f1f20b4f76e1 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:53.286267 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc50272a-0fb2-41da-aab9-0b13fb86b516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:53.287791 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50272a-0fb2-41da-aab9-0b13fb86b516 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:53.288428 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50272a-0fb2-41da-aab9-0b13fb86b516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:53.288932 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc50272a-0fb2-41da-aab9-0b13fb86b516 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:53.289829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc50272a-0fb2-41da-aab9-0b13fb86b516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:53.291200 dv-cinder-841315-2-smb devstack@keystone.service[80058]: WARNING py.warnings [None req-cc50272a-0fb2-41da-aab9-0b13fb86b516 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:24:53.291200 dv-cinder-841315-2-smb devstack@keystone.service[80058]: warnings.warn(msg) Jul 27 15:24:53.291200 dv-cinder-841315-2-smb devstack@keystone.service[80058]: Jul 27 15:24:53.293194 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc50272a-0fb2-41da-aab9-0b13fb86b516 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:53.307836 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 772/1545] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jul 27 15:24:53.309818 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37c33e-d019-4d0f-83f3-492b170f7842 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:53.310105 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37c33e-d019-4d0f-83f3-492b170f7842 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:53.310511 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37c33e-d019-4d0f-83f3-492b170f7842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:53.334279 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 774/1546] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:24:53 2022] POST /identity/v3/users => generated 292 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:24:53.334924 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-8d37c33e-d019-4d0f-83f3-492b170f7842 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:24:53.336158 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8d37c33e-d019-4d0f-83f3-492b170f7842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:24:53.336897 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60643611-3334-4db7-9245-5d6957779627 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:53.337844 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60643611-3334-4db7-9245-5d6957779627 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:53.338449 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60643611-3334-4db7-9245-5d6957779627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:53.345822 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 773/1547] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:24:53.347127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56232b-0873-484e-b6ac-c50eef988dc6 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:53.347415 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56232b-0873-484e-b6ac-c50eef988dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:53.347693 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e56232b-0873-484e-b6ac-c50eef988dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:53.369051 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-60643611-3334-4db7-9245-5d6957779627 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:24:53.370457 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-4e56232b-0873-484e-b6ac-c50eef988dc6 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:24:53.370779 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-60643611-3334-4db7-9245-5d6957779627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:24:53.372537 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-4e56232b-0873-484e-b6ac-c50eef988dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:24:53.386718 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 775/1548] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:24:53.386924 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 774/1549] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:24:53.387029 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97cfec-9a3d-42c5-80d1-2865be72e703 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:53.387029 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97cfec-9a3d-42c5-80d1-2865be72e703 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:53.387029 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d97cfec-9a3d-42c5-80d1-2865be72e703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:53.390151 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56232b-0873-484e-b6ac-c50eef988dc6 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:53.401157 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e56232b-0873-484e-b6ac-c50eef988dc6 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:53.406488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceaf949-0772-411c-adba-7624925ac2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:53.407107 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceaf949-0772-411c-adba-7624925ac2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:53.407379 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceaf949-0772-411c-adba-7624925ac2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:53.407659 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceaf949-0772-411c-adba-7624925ac2f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:53.407891 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-1d97cfec-9a3d-42c5-80d1-2865be72e703 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:24:53.408393 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceaf949-0772-411c-adba-7624925ac2f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:24:53.408694 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceaf949-0772-411c-adba-7624925ac2f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:53.409059 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1d97cfec-9a3d-42c5-80d1-2865be72e703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:24:53.410294 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceaf949-0772-411c-adba-7624925ac2f3 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:53.417522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 776/1550] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:24:53.418357 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97cfec-9a3d-42c5-80d1-2865be72e703 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:53.425374 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 775/1551] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:24:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:24:53.426724 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b1433-c25b-44f3-82e5-e89f2fd1a462 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:53.427015 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b1433-c25b-44f3-82e5-e89f2fd1a462 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:53.427287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9b1433-c25b-44f3-82e5-e89f2fd1a462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:53.428434 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d97cfec-9a3d-42c5-80d1-2865be72e703 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:53.433614 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218f75e0-358f-4b0c-9f4a-d0f6de60ed43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:53.434767 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f75e0-358f-4b0c-9f4a-d0f6de60ed43 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:53.435047 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f75e0-358f-4b0c-9f4a-d0f6de60ed43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:53.435323 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218f75e0-358f-4b0c-9f4a-d0f6de60ed43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:53.436043 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f75e0-358f-4b0c-9f4a-d0f6de60ed43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:53.437660 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218f75e0-358f-4b0c-9f4a-d0f6de60ed43 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:53.446960 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-7b9b1433-c25b-44f3-82e5-e89f2fd1a462 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:24:53.447802 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 777/1552] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:24:53.448177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-7b9b1433-c25b-44f3-82e5-e89f2fd1a462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:24:53.449886 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4cff3-37fb-41ba-a53b-d04e9565e15c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:53.449886 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4cff3-37fb-41ba-a53b-d04e9565e15c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:53.449886 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb4cff3-37fb-41ba-a53b-d04e9565e15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:53.458608 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 776/1553] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:24:53.459825 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96c29a-cc57-44cd-81b1-f116439ac79c None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:53.460157 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96c29a-cc57-44cd-81b1-f116439ac79c None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:53.460434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96c29a-cc57-44cd-81b1-f116439ac79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:53.469466 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-cfb4cff3-37fb-41ba-a53b-d04e9565e15c None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:24:53.470667 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-cfb4cff3-37fb-41ba-a53b-d04e9565e15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:24:53.478737 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 778/1554] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:24:53.487263 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-aa96c29a-cc57-44cd-81b1-f116439ac79c None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:24:53.487365 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51549d2-1f2e-42fe-9bc8-12798cb35df6 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:53.487365 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51549d2-1f2e-42fe-9bc8-12798cb35df6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:53.487365 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51549d2-1f2e-42fe-9bc8-12798cb35df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:53.487606 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-aa96c29a-cc57-44cd-81b1-f116439ac79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:24:53.489385 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 777/1555] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:24:53.490584 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8be3d2-16e5-43a5-8198-d6c64432ca36 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:53.490865 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8be3d2-16e5-43a5-8198-d6c64432ca36 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:53.491136 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8be3d2-16e5-43a5-8198-d6c64432ca36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:53.502101 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d51549d2-1f2e-42fe-9bc8-12798cb35df6 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:24:53.503317 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d51549d2-1f2e-42fe-9bc8-12798cb35df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:24:53.510208 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-be8be3d2-16e5-43a5-8198-d6c64432ca36 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:24:53.511383 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-be8be3d2-16e5-43a5-8198-d6c64432ca36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:24:53.511699 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 779/1556] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:24:53.513065 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a4ef4-a37c-48dd-b886-9a2fcf7fde96 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:53.513355 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a4ef4-a37c-48dd-b886-9a2fcf7fde96 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:53.513628 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a4ef4-a37c-48dd-b886-9a2fcf7fde96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:53.524872 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 778/1557] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:24:53.525757 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8be3d2-16e5-43a5-8198-d6c64432ca36 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:53.535036 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8be3d2-16e5-43a5-8198-d6c64432ca36 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:53.539193 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-ba9a4ef4-a37c-48dd-b886-9a2fcf7fde96 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:24:53.539512 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a996b-3588-4d1b-83ea-b23d72c296d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:53.540123 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a996b-3588-4d1b-83ea-b23d72c296d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:53.540421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a996b-3588-4d1b-83ea-b23d72c296d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:53.540529 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ba9a4ef4-a37c-48dd-b886-9a2fcf7fde96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:24:53.540697 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a996b-3588-4d1b-83ea-b23d72c296d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:53.541345 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a996b-3588-4d1b-83ea-b23d72c296d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:53.542599 dv-cinder-841315-2-smb devstack@keystone.service[80057]: WARNING py.warnings [None req-e63a996b-3588-4d1b-83ea-b23d72c296d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:24:53.542599 dv-cinder-841315-2-smb devstack@keystone.service[80057]: warnings.warn(msg) Jul 27 15:24:53.542599 dv-cinder-841315-2-smb devstack@keystone.service[80057]: Jul 27 15:24:53.544345 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63a996b-3588-4d1b-83ea-b23d72c296d3 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:53.549346 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 780/1558] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:24:53.550122 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a4ef4-a37c-48dd-b886-9a2fcf7fde96 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:53.559879 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a4ef4-a37c-48dd-b886-9a2fcf7fde96 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:53.565401 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c6e38c-e0be-4156-9d20-2c3d1104116a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:53.566092 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6e38c-e0be-4156-9d20-2c3d1104116a admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:53.566381 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6e38c-e0be-4156-9d20-2c3d1104116a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:53.566700 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c6e38c-e0be-4156-9d20-2c3d1104116a admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:53.567423 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6e38c-e0be-4156-9d20-2c3d1104116a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:53.569045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c6e38c-e0be-4156-9d20-2c3d1104116a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:53.574437 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 779/1559] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:24:53 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:24:53.577020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a996b-3588-4d1b-83ea-b23d72c296d3 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:53.582534 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 781/1560] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:24:53.583839 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab82842-2f9d-46e1-830a-ae8a46e4878e None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:53.584280 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab82842-2f9d-46e1-830a-ae8a46e4878e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:53.584477 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab82842-2f9d-46e1-830a-ae8a46e4878e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:53.603885 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-eab82842-2f9d-46e1-830a-ae8a46e4878e None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:24:53.605736 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-eab82842-2f9d-46e1-830a-ae8a46e4878e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:24:53.643769 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a996b-3588-4d1b-83ea-b23d72c296d3 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:53.648725 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd963a-23b3-4269-a596-0ff53518c461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:53.649343 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd963a-23b3-4269-a596-0ff53518c461 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:53.649630 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd963a-23b3-4269-a596-0ff53518c461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:53.649907 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bd963a-23b3-4269-a596-0ff53518c461 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:53.650601 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd963a-23b3-4269-a596-0ff53518c461 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:24:53.650909 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd963a-23b3-4269-a596-0ff53518c461 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:53.652550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bd963a-23b3-4269-a596-0ff53518c461 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:53.657284 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:24:53.661264 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:24:53.668169 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 780/1561] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:24:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:24:53.669730 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd963a-23b3-4269-a596-0ff53518c461 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:53.671011 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 782/1562] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:24:53.672346 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52f3ab-c108-406a-b003-0eb149e4d338 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:53.672878 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52f3ab-c108-406a-b003-0eb149e4d338 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:53.673177 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52f3ab-c108-406a-b003-0eb149e4d338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:53.682085 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bd963a-23b3-4269-a596-0ff53518c461 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:53.687228 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773992d-95eb-41fc-b9c6-ab1ebb5cb363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:53.687849 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773992d-95eb-41fc-b9c6-ab1ebb5cb363 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:53.688161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773992d-95eb-41fc-b9c6-ab1ebb5cb363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:53.688438 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4773992d-95eb-41fc-b9c6-ab1ebb5cb363 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:53.689125 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773992d-95eb-41fc-b9c6-ab1ebb5cb363 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:24:53.689428 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773992d-95eb-41fc-b9c6-ab1ebb5cb363 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:53.691004 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4773992d-95eb-41fc-b9c6-ab1ebb5cb363 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:53.692459 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-7f52f3ab-c108-406a-b003-0eb149e4d338 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:24:53.693612 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7f52f3ab-c108-406a-b003-0eb149e4d338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:24:53.701302 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 783/1563] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:24:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:24:53.702160 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52f3ab-c108-406a-b003-0eb149e4d338 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:53.710019 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 781/1564] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:24:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:24:53.710019 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773992d-95eb-41fc-b9c6-ab1ebb5cb363 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:53.711978 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52f3ab-c108-406a-b003-0eb149e4d338 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:53.716623 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3527f28-9dc4-43a9-a3a5-aa8590fe5358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:53.717217 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3527f28-9dc4-43a9-a3a5-aa8590fe5358 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:53.717496 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3527f28-9dc4-43a9-a3a5-aa8590fe5358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:53.717765 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3527f28-9dc4-43a9-a3a5-aa8590fe5358 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:53.718446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3527f28-9dc4-43a9-a3a5-aa8590fe5358 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:24:53.718746 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3527f28-9dc4-43a9-a3a5-aa8590fe5358 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:53.719122 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4773992d-95eb-41fc-b9c6-ab1ebb5cb363 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:53.719777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: WARNING py.warnings [None req-e3527f28-9dc4-43a9-a3a5-aa8590fe5358 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:24:53.719777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: warnings.warn(msg) Jul 27 15:24:53.719777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: Jul 27 15:24:53.720671 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3527f28-9dc4-43a9-a3a5-aa8590fe5358 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:53.724038 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958815e0-26eb-4590-8ccc-c7fbb0eb05f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:53.724631 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958815e0-26eb-4590-8ccc-c7fbb0eb05f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:53.724919 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958815e0-26eb-4590-8ccc-c7fbb0eb05f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:53.725195 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958815e0-26eb-4590-8ccc-c7fbb0eb05f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:53.726025 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958815e0-26eb-4590-8ccc-c7fbb0eb05f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:24:53.726335 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958815e0-26eb-4590-8ccc-c7fbb0eb05f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:53.727901 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958815e0-26eb-4590-8ccc-c7fbb0eb05f1 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:53.733014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 784/1565] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:24:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:24:53.734097 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3527f28-9dc4-43a9-a3a5-aa8590fe5358 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:53.743756 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3527f28-9dc4-43a9-a3a5-aa8590fe5358 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:53.752578 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 782/1566] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:24:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:24:53.752578 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958815e0-26eb-4590-8ccc-c7fbb0eb05f1 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:53.752835 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d808e-8f86-4a92-bc63-e287fa24f3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:53.752835 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d808e-8f86-4a92-bc63-e287fa24f3f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:53.752835 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d808e-8f86-4a92-bc63-e287fa24f3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:53.752835 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d808e-8f86-4a92-bc63-e287fa24f3f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:53.753199 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d808e-8f86-4a92-bc63-e287fa24f3f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:53.753199 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8d808e-8f86-4a92-bc63-e287fa24f3f3 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:53.756731 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958815e0-26eb-4590-8ccc-c7fbb0eb05f1 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:53.761271 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75762187-0a64-41b8-960f-4ca49b24c1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:53.761945 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75762187-0a64-41b8-960f-4ca49b24c1c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:53.762265 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75762187-0a64-41b8-960f-4ca49b24c1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:53.762544 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75762187-0a64-41b8-960f-4ca49b24c1c5 admin admin] PATH_INFO: `/v3/projects/8d7c82e18db745e78b8b5f22d6080294/users/0b92ad58e5484bc796e1b61fa9f788dd/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:53.776675 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 785/1567] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:24:53 2022] POST /identity/v3/users => generated 288 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:24:53.777471 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d808e-8f86-4a92-bc63-e287fa24f3f3 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:53.778471 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75762187-0a64-41b8-960f-4ca49b24c1c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d7c82e18db745e78b8b5f22d6080294, user_id=0b92ad58e5484bc796e1b61fa9f788dd, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:53.779520 dv-cinder-841315-2-smb devstack@keystone.service[80057]: WARNING py.warnings [None req-75762187-0a64-41b8-960f-4ca49b24c1c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:24:53.779520 dv-cinder-841315-2-smb devstack@keystone.service[80057]: warnings.warn(msg) Jul 27 15:24:53.779520 dv-cinder-841315-2-smb devstack@keystone.service[80057]: Jul 27 15:24:53.781508 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75762187-0a64-41b8-960f-4ca49b24c1c5 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:53.787498 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d808e-8f86-4a92-bc63-e287fa24f3f3 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:53.792912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7530d54-4891-4029-ab12-e1886592259f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:53.794021 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7530d54-4891-4029-ab12-e1886592259f admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:53.794310 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7530d54-4891-4029-ab12-e1886592259f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:53.794582 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7530d54-4891-4029-ab12-e1886592259f admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:53.795237 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7530d54-4891-4029-ab12-e1886592259f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:53.796372 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 783/1568] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:24:53 2022] PUT /identity/v3/projects/8d7c82e18db745e78b8b5f22d6080294/users/0b92ad58e5484bc796e1b61fa9f788dd/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:24:53.797162 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7530d54-4891-4029-ab12-e1886592259f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:53.797295 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75762187-0a64-41b8-960f-4ca49b24c1c5 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:53.829042 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 786/1569] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:24:53 2022] POST /identity/v3/projects => generated 403 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:24:53.829042 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7530d54-4891-4029-ab12-e1886592259f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:53.860532 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75762187-0a64-41b8-960f-4ca49b24c1c5 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:53.889411 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7530d54-4891-4029-ab12-e1886592259f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:53.893862 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db4a8d-9a70-4ad6-a193-b0c152e0081f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:53.894412 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db4a8d-9a70-4ad6-a193-b0c152e0081f admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:53.894695 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db4a8d-9a70-4ad6-a193-b0c152e0081f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:53.894967 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9db4a8d-9a70-4ad6-a193-b0c152e0081f admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:53.895660 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db4a8d-9a70-4ad6-a193-b0c152e0081f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:24:53.895966 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db4a8d-9a70-4ad6-a193-b0c152e0081f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:53.897591 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9db4a8d-9a70-4ad6-a193-b0c152e0081f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:53.909697 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 787/1570] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:24:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:24:53.910503 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db4a8d-9a70-4ad6-a193-b0c152e0081f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:53.920701 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bb342-0272-4fbe-b69b-06bb65699bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:53.921328 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bb342-0272-4fbe-b69b-06bb65699bbf admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:53.921602 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bb342-0272-4fbe-b69b-06bb65699bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:53.921832 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9db4a8d-9a70-4ad6-a193-b0c152e0081f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:53.921951 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bb342-0272-4fbe-b69b-06bb65699bbf admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:53.922548 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66bb342-0272-4fbe-b69b-06bb65699bbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:24:53.922853 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66bb342-0272-4fbe-b69b-06bb65699bbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:53.924473 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66bb342-0272-4fbe-b69b-06bb65699bbf admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:53.926630 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5b23b-9063-4992-91f8-97686c369935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:53.927234 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5b23b-9063-4992-91f8-97686c369935 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:53.927520 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5b23b-9063-4992-91f8-97686c369935 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:53.927795 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5b23b-9063-4992-91f8-97686c369935 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:53.928527 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b5b23b-9063-4992-91f8-97686c369935 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:53.930395 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b5b23b-9063-4992-91f8-97686c369935 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:53.936685 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 784/1571] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:24:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:24:53.937647 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bb342-0272-4fbe-b69b-06bb65699bbf admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:53.948374 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bb342-0272-4fbe-b69b-06bb65699bbf admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:53.953557 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe095fea-3236-4184-8284-e666c9834ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:53.954170 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe095fea-3236-4184-8284-e666c9834ece admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:53.954440 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe095fea-3236-4184-8284-e666c9834ece admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:53.954714 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe095fea-3236-4184-8284-e666c9834ece admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:53.955376 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe095fea-3236-4184-8284-e666c9834ece admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:53.957355 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe095fea-3236-4184-8284-e666c9834ece admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:53.961215 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 788/1572] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:24:53 2022] POST /identity/v3/projects => generated 393 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:24:53.961215 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5b23b-9063-4992-91f8-97686c369935 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:53.988029 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 785/1573] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:24:53 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:24:53.988029 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe095fea-3236-4184-8284-e666c9834ece admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:54.017586 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:24:54.025190 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5b23b-9063-4992-91f8-97686c369935 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:54.037843 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:24:54.050620 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe095fea-3236-4184-8284-e666c9834ece admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:54.055204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a99226-c0df-48d8-8eb9-75da7ab34b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:54.055818 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a99226-c0df-48d8-8eb9-75da7ab34b99 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:54.056137 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a99226-c0df-48d8-8eb9-75da7ab34b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:54.056417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a99226-c0df-48d8-8eb9-75da7ab34b99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:54.057116 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a99226-c0df-48d8-8eb9-75da7ab34b99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:54.058739 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a99226-c0df-48d8-8eb9-75da7ab34b99 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:54.068621 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 786/1574] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:24:54.069831 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a5f49-f179-49c0-b7e4-55a86966befb None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:54.070122 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a5f49-f179-49c0-b7e4-55a86966befb None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:54.070406 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3a5f49-f179-49c0-b7e4-55a86966befb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:54.083593 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5aa81f-b64b-4d68-bb42-7b95e24b47ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:54.084239 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5aa81f-b64b-4d68-bb42-7b95e24b47ac admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:54.084525 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5aa81f-b64b-4d68-bb42-7b95e24b47ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:54.084801 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5aa81f-b64b-4d68-bb42-7b95e24b47ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:54.085470 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5aa81f-b64b-4d68-bb42-7b95e24b47ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:54.087350 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5aa81f-b64b-4d68-bb42-7b95e24b47ac admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:54.089774 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-5f3a5f49-f179-49c0-b7e4-55a86966befb None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:24:54.091787 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5f3a5f49-f179-49c0-b7e4-55a86966befb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:24:54.099449 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 787/1575] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:24:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:24:54.100219 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a5f49-f179-49c0-b7e4-55a86966befb None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:54.114236 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3a5f49-f179-49c0-b7e4-55a86966befb None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:54.121618 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 789/1576] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:24:53 2022] POST /identity/v3/projects => generated 363 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:24:54.121778 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31e547-e2b7-4f70-870f-a3b2e935df84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:54.121905 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5aa81f-b64b-4d68-bb42-7b95e24b47ac admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:54.121999 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31e547-e2b7-4f70-870f-a3b2e935df84 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:54.121999 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31e547-e2b7-4f70-870f-a3b2e935df84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:54.121999 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31e547-e2b7-4f70-870f-a3b2e935df84 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:54.121999 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba31e547-e2b7-4f70-870f-a3b2e935df84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:54.122618 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba31e547-e2b7-4f70-870f-a3b2e935df84 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:54.147430 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 788/1577] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:24:54 2022] POST /identity/v3/users => generated 302 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:24:54.147430 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31e547-e2b7-4f70-870f-a3b2e935df84 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:54.156069 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31e547-e2b7-4f70-870f-a3b2e935df84 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:54.182766 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5aa81f-b64b-4d68-bb42-7b95e24b47ac admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:54.187567 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981b1ac-5ae4-4b1c-80ef-871d4cfb9b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:54.188212 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981b1ac-5ae4-4b1c-80ef-871d4cfb9b0e admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:54.188495 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981b1ac-5ae4-4b1c-80ef-871d4cfb9b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:54.188780 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e981b1ac-5ae4-4b1c-80ef-871d4cfb9b0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:54.189690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981b1ac-5ae4-4b1c-80ef-871d4cfb9b0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:54.191315 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e981b1ac-5ae4-4b1c-80ef-871d4cfb9b0e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:54.213074 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13edbb-6e43-4ff9-978d-788c62a1d77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:54.213694 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13edbb-6e43-4ff9-978d-788c62a1d77e admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:54.213974 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13edbb-6e43-4ff9-978d-788c62a1d77e admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:54.214244 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13edbb-6e43-4ff9-978d-788c62a1d77e admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:54.214904 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13edbb-6e43-4ff9-978d-788c62a1d77e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:54.217384 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13edbb-6e43-4ff9-978d-788c62a1d77e admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:54.218820 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 790/1578] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:24:54 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:24:54.219702 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981b1ac-5ae4-4b1c-80ef-871d4cfb9b0e admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:54.248855 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 789/1579] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:24:54 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:24:54.248855 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13edbb-6e43-4ff9-978d-788c62a1d77e admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:54.281067 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e981b1ac-5ae4-4b1c-80ef-871d4cfb9b0e admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:54.310313 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13edbb-6e43-4ff9-978d-788c62a1d77e admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:54.314187 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:24:54.315022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cdcebd-fe5f-4dba-baa9-1c2ecec36cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:54.315662 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdcebd-fe5f-4dba-baa9-1c2ecec36cb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:54.315930 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdcebd-fe5f-4dba-baa9-1c2ecec36cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:54.316271 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdcebd-fe5f-4dba-baa9-1c2ecec36cb5 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:54.316937 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cdcebd-fe5f-4dba-baa9-1c2ecec36cb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:54.318914 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cdcebd-fe5f-4dba-baa9-1c2ecec36cb5 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:54.341806 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 790/1580] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:24:54 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:24:54.342134 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004baa3-35ea-430d-b726-68431136914d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:54.342761 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004baa3-35ea-430d-b726-68431136914d admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:54.343038 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004baa3-35ea-430d-b726-68431136914d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:54.343145 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cdcebd-fe5f-4dba-baa9-1c2ecec36cb5 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:54.343351 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004baa3-35ea-430d-b726-68431136914d admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:54.343980 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004baa3-35ea-430d-b726-68431136914d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:54.345915 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004baa3-35ea-430d-b726-68431136914d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:54.354842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cdcebd-fe5f-4dba-baa9-1c2ecec36cb5 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:54.359845 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c94e9-36e7-4aa7-b0db-85c06ca6f194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:54.360558 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c94e9-36e7-4aa7-b0db-85c06ca6f194 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:54.360849 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c94e9-36e7-4aa7-b0db-85c06ca6f194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:54.361241 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c94e9-36e7-4aa7-b0db-85c06ca6f194 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:54.362020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c94e9-36e7-4aa7-b0db-85c06ca6f194 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:54.363648 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c94e9-36e7-4aa7-b0db-85c06ca6f194 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:54.367443 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 791/1581] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:24:54 2022] POST /identity/v3/users => generated 297 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:24:54.368286 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004baa3-35ea-430d-b726-68431136914d admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:54.374073 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 791/1582] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:24:54.374951 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c94e9-36e7-4aa7-b0db-85c06ca6f194 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:54.381624 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:24:54.385341 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c94e9-36e7-4aa7-b0db-85c06ca6f194 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:54.392055 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cf355-051f-49a3-8b47-27a5ba60b360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:54.392650 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cf355-051f-49a3-8b47-27a5ba60b360 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:54.392938 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cf355-051f-49a3-8b47-27a5ba60b360 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:54.393218 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84cf355-051f-49a3-8b47-27a5ba60b360 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:54.393905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84cf355-051f-49a3-8b47-27a5ba60b360 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:54.395874 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84cf355-051f-49a3-8b47-27a5ba60b360 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:54.419752 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 792/1583] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:24:54 2022] POST /identity/v3/users => generated 282 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:24:54.420614 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cf355-051f-49a3-8b47-27a5ba60b360 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:54.429628 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004baa3-35ea-430d-b726-68431136914d admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:54.430024 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84cf355-051f-49a3-8b47-27a5ba60b360 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:54.433444 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a810e-27d3-4bb8-9410-5e0b32e15f84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:54.434081 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a810e-27d3-4bb8-9410-5e0b32e15f84 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:54.434392 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a810e-27d3-4bb8-9410-5e0b32e15f84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:54.434503 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c350a-7545-4b1f-9c29-a15600423371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:54.434647 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a810e-27d3-4bb8-9410-5e0b32e15f84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:54.435089 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c350a-7545-4b1f-9c29-a15600423371 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:54.435357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c350a-7545-4b1f-9c29-a15600423371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:54.435622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c350a-7545-4b1f-9c29-a15600423371 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:54.436346 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9c350a-7545-4b1f-9c29-a15600423371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:54.437922 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9c350a-7545-4b1f-9c29-a15600423371 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:54.444533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a810e-27d3-4bb8-9410-5e0b32e15f84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:54.446021 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a810e-27d3-4bb8-9410-5e0b32e15f84 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:54.447814 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 793/1584] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:24:54.448691 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c350a-7545-4b1f-9c29-a15600423371 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:54.457104 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 792/1585] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:24:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:24:54.458314 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a810e-27d3-4bb8-9410-5e0b32e15f84 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:54.458668 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c350a-7545-4b1f-9c29-a15600423371 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:54.463360 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6fd73a-e983-462a-ba87-09b6eb4bdcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:54.464608 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fd73a-e983-462a-ba87-09b6eb4bdcb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:54.464888 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fd73a-e983-462a-ba87-09b6eb4bdcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:54.465156 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fd73a-e983-462a-ba87-09b6eb4bdcb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:54.466534 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6fd73a-e983-462a-ba87-09b6eb4bdcb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:54.468454 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6fd73a-e983-462a-ba87-09b6eb4bdcb7 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:54.469181 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a810e-27d3-4bb8-9410-5e0b32e15f84 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:54.474242 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a5d2f-58d3-45a8-b56d-dead2d48b927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:54.475035 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a5d2f-58d3-45a8-b56d-dead2d48b927 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:54.475322 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a5d2f-58d3-45a8-b56d-dead2d48b927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:54.475628 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290a5d2f-58d3-45a8-b56d-dead2d48b927 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:54.476329 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a5d2f-58d3-45a8-b56d-dead2d48b927 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:54.478278 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290a5d2f-58d3-45a8-b56d-dead2d48b927 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:54.492096 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 794/1586] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:24:54 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:24:54.492980 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6fd73a-e983-462a-ba87-09b6eb4bdcb7 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:54.502718 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 793/1587] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:24:54 2022] POST /identity/v3/users => generated 290 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:24:54.503548 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a5d2f-58d3-45a8-b56d-dead2d48b927 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:54.504172 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6fd73a-e983-462a-ba87-09b6eb4bdcb7 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:54.508793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bffcaa-970e-4131-9ca8-c72eced15148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:54.509401 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bffcaa-970e-4131-9ca8-c72eced15148 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:54.509729 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bffcaa-970e-4131-9ca8-c72eced15148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:54.509939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bffcaa-970e-4131-9ca8-c72eced15148 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:54.510679 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bffcaa-970e-4131-9ca8-c72eced15148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:54.512844 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bffcaa-970e-4131-9ca8-c72eced15148 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:54.514833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290a5d2f-58d3-45a8-b56d-dead2d48b927 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:54.520675 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b35d0-9270-4d95-9aca-f909a224507f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:54.521221 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b35d0-9270-4d95-9aca-f909a224507f admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:54.521509 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b35d0-9270-4d95-9aca-f909a224507f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:54.521784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b35d0-9270-4d95-9aca-f909a224507f admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:54.522485 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b35d0-9270-4d95-9aca-f909a224507f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:54.526436 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 795/1588] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:24:54.526579 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b35d0-9270-4d95-9aca-f909a224507f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:54.526678 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bffcaa-970e-4131-9ca8-c72eced15148 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:54.535370 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bffcaa-970e-4131-9ca8-c72eced15148 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:54.537985 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 794/1589] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:24:54.538820 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b35d0-9270-4d95-9aca-f909a224507f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:54.544126 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ee7bb-0bac-4bcd-adb8-9c0b4da4ec02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:54.544889 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ee7bb-0bac-4bcd-adb8-9c0b4da4ec02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:54.545074 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ee7bb-0bac-4bcd-adb8-9c0b4da4ec02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:54.545351 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ee7bb-0bac-4bcd-adb8-9c0b4da4ec02 admin admin] PATH_INFO: `/v3/projects/12ffb2c18638461aaf26903c3cf167f7/users/8187bb8d31344ecda22634ce5d73f7f3/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:54.549967 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b35d0-9270-4d95-9aca-f909a224507f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:54.555018 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5686144-0fd2-4f28-b7a2-8f9db85e6a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:54.555911 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5686144-0fd2-4f28-b7a2-8f9db85e6a9e admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:54.555911 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5686144-0fd2-4f28-b7a2-8f9db85e6a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:54.556435 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5686144-0fd2-4f28-b7a2-8f9db85e6a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:54.556940 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5686144-0fd2-4f28-b7a2-8f9db85e6a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:54.558499 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5686144-0fd2-4f28-b7a2-8f9db85e6a9e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:54.566299 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ee7bb-0bac-4bcd-adb8-9c0b4da4ec02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12ffb2c18638461aaf26903c3cf167f7, user_id=8187bb8d31344ecda22634ce5d73f7f3, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:54.569401 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ee7bb-0bac-4bcd-adb8-9c0b4da4ec02 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:54.572242 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 795/1590] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:24:54.573535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5686144-0fd2-4f28-b7a2-8f9db85e6a9e admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:54.585331 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 796/1591] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:24:54 2022] PUT /identity/v3/projects/12ffb2c18638461aaf26903c3cf167f7/users/8187bb8d31344ecda22634ce5d73f7f3/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:24:54.585562 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5686144-0fd2-4f28-b7a2-8f9db85e6a9e admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:54.586732 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ee7bb-0bac-4bcd-adb8-9c0b4da4ec02 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:54.669715 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ee7bb-0bac-4bcd-adb8-9c0b4da4ec02 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:54.674856 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5564c4-d710-46b4-8786-5656653cebe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:54.676264 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5564c4-d710-46b4-8786-5656653cebe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:54.676547 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5564c4-d710-46b4-8786-5656653cebe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:54.676830 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5564c4-d710-46b4-8786-5656653cebe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:54.677862 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5564c4-d710-46b4-8786-5656653cebe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:54.679788 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5564c4-d710-46b4-8786-5656653cebe5 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:54.686443 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f849e26-d80d-4e9f-b6dd-c032f8c5fd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:54.687150 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f849e26-d80d-4e9f-b6dd-c032f8c5fd6a admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:54.687513 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f849e26-d80d-4e9f-b6dd-c032f8c5fd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:54.687798 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f849e26-d80d-4e9f-b6dd-c032f8c5fd6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:54.688535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f849e26-d80d-4e9f-b6dd-c032f8c5fd6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:54.690135 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f849e26-d80d-4e9f-b6dd-c032f8c5fd6a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:54.693755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 797/1592] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:24:54.694858 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5564c4-d710-46b4-8786-5656653cebe5 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:54.705543 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 796/1593] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:24:54.705543 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f849e26-d80d-4e9f-b6dd-c032f8c5fd6a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:54.710632 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5564c4-d710-46b4-8786-5656653cebe5 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:54.713640 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f849e26-d80d-4e9f-b6dd-c032f8c5fd6a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:54.716416 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b5c6c-6869-408b-b9ce-ea9ad6e226ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:54.717034 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b5c6c-6869-408b-b9ce-ea9ad6e226ca admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:54.717311 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b5c6c-6869-408b-b9ce-ea9ad6e226ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:54.717620 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b5c6c-6869-408b-b9ce-ea9ad6e226ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:54.718290 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b5c6c-6869-408b-b9ce-ea9ad6e226ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:54.719843 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b5c6c-6869-408b-b9ce-ea9ad6e226ca admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:54.720379 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7d3e7-55d6-4eb9-b7aa-062a75ece082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:54.720996 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7d3e7-55d6-4eb9-b7aa-062a75ece082 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:54.721332 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7d3e7-55d6-4eb9-b7aa-062a75ece082 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:54.721555 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d7d3e7-55d6-4eb9-b7aa-062a75ece082 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:54.722821 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7d3e7-55d6-4eb9-b7aa-062a75ece082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:54.723816 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d7d3e7-55d6-4eb9-b7aa-062a75ece082 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:54.732542 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 798/1594] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:24:54.733447 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b5c6c-6869-408b-b9ce-ea9ad6e226ca admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:54.737594 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 797/1595] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:24:54.737594 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7d3e7-55d6-4eb9-b7aa-062a75ece082 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:54.746205 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b5c6c-6869-408b-b9ce-ea9ad6e226ca admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:54.748858 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d7d3e7-55d6-4eb9-b7aa-062a75ece082 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:54.752196 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532ea61e-7c23-4f97-b704-8bc64169617b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:54.752760 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ea61e-7c23-4f97-b704-8bc64169617b admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:54.753035 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ea61e-7c23-4f97-b704-8bc64169617b admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:54.753303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532ea61e-7c23-4f97-b704-8bc64169617b admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:54.754198 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ea61e-7c23-4f97-b704-8bc64169617b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:54.755571 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532ea61e-7c23-4f97-b704-8bc64169617b admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:54.758955 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e5e9d-b615-4a30-864b-3cb82fc7ea90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:54.759623 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e5e9d-b615-4a30-864b-3cb82fc7ea90 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:54.759931 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e5e9d-b615-4a30-864b-3cb82fc7ea90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:54.760246 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e5e9d-b615-4a30-864b-3cb82fc7ea90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:54.761042 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e5e9d-b615-4a30-864b-3cb82fc7ea90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:54.763384 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e5e9d-b615-4a30-864b-3cb82fc7ea90 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:54.771734 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 799/1596] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:24:54.773111 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9beb0-3efc-4be2-bf74-09f36b746696 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:54.773400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9beb0-3efc-4be2-bf74-09f36b746696 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:54.773729 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9beb0-3efc-4be2-bf74-09f36b746696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:54.777589 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 798/1597] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:24:54.777589 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e5e9d-b615-4a30-864b-3cb82fc7ea90 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:54.782979 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:24:54.788906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e5e9d-b615-4a30-864b-3cb82fc7ea90 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:54.795626 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683cb155-04f3-4cbc-bb5d-2330f9591287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:54.796280 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cb155-04f3-4cbc-bb5d-2330f9591287 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:54.796568 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cb155-04f3-4cbc-bb5d-2330f9591287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:54.796844 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cb155-04f3-4cbc-bb5d-2330f9591287 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:54.797533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683cb155-04f3-4cbc-bb5d-2330f9591287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:54.799163 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683cb155-04f3-4cbc-bb5d-2330f9591287 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:54.804176 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-31c9beb0-3efc-4be2-bf74-09f36b746696 None None] MFA Rules not processed for user `8187bb8d31344ecda22634ce5d73f7f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:24:54.805507 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-31c9beb0-3efc-4be2-bf74-09f36b746696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:24:54.811342 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 799/1598] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:24:54.812264 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683cb155-04f3-4cbc-bb5d-2330f9591287 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:54.824624 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683cb155-04f3-4cbc-bb5d-2330f9591287 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:54.833725 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777df59-764d-421a-ad75-9ee8a8d37ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:54.834454 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777df59-764d-421a-ad75-9ee8a8d37ecf admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:54.834834 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777df59-764d-421a-ad75-9ee8a8d37ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:54.835210 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777df59-764d-421a-ad75-9ee8a8d37ecf admin admin] PATH_INFO: `/v3/projects/55efb10b041b4a02aac7dd7588e38a6b/users/e6dd6288ce06470d9ecf43a26d12f444/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:54.859330 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:24:54.863133 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777df59-764d-421a-ad75-9ee8a8d37ecf admin admin] RBAC: Authorizing `identity:create_grant(project_id=55efb10b041b4a02aac7dd7588e38a6b, user_id=e6dd6288ce06470d9ecf43a26d12f444, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:54.866380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777df59-764d-421a-ad75-9ee8a8d37ecf admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:54.883412 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 800/1599] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:24:54 2022] PUT /identity/v3/projects/55efb10b041b4a02aac7dd7588e38a6b/users/e6dd6288ce06470d9ecf43a26d12f444/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:24:54.884477 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777df59-764d-421a-ad75-9ee8a8d37ecf admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:54.918243 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 800/1600] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:24:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:24:54.920096 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9beb0-3efc-4be2-bf74-09f36b746696 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:54.953042 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777df59-764d-421a-ad75-9ee8a8d37ecf admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:54.960516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9beb0-3efc-4be2-bf74-09f36b746696 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:54.965147 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e63ba7-b27b-4608-8b54-7e49466c020f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:54.966907 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e63ba7-b27b-4608-8b54-7e49466c020f admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:54.967142 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e63ba7-b27b-4608-8b54-7e49466c020f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:54.967439 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e63ba7-b27b-4608-8b54-7e49466c020f admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:54.968281 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e63ba7-b27b-4608-8b54-7e49466c020f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:54.970540 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e63ba7-b27b-4608-8b54-7e49466c020f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:54.972327 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fc0c5-bae0-4e21-a67a-bf8a95d457a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:54.973802 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fc0c5-bae0-4e21-a67a-bf8a95d457a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:54.974520 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fc0c5-bae0-4e21-a67a-bf8a95d457a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:54.975350 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8fc0c5-bae0-4e21-a67a-bf8a95d457a3 admin admin] PATH_INFO: `/v3/projects/ea08949e8ff04f25825d7873da2a7394/users/c77a01fed0e741288f05941fe5670a6d/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:54.984862 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 801/1601] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:24:54.985243 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e63ba7-b27b-4608-8b54-7e49466c020f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:54.995812 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8fc0c5-bae0-4e21-a67a-bf8a95d457a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea08949e8ff04f25825d7873da2a7394, user_id=c77a01fed0e741288f05941fe5670a6d, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:54.997683 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e63ba7-b27b-4608-8b54-7e49466c020f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:54.999113 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8fc0c5-bae0-4e21-a67a-bf8a95d457a3 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:55.003834 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d42b9b-3a79-4a47-b1aa-016d3bd28eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:55.004902 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d42b9b-3a79-4a47-b1aa-016d3bd28eea admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:55.005189 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d42b9b-3a79-4a47-b1aa-016d3bd28eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:55.006172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d42b9b-3a79-4a47-b1aa-016d3bd28eea admin admin] PATH_INFO: `/v3/projects/954859b49535432490388485f316513d/users/d815c45c04314dd0abe18cd9b4d9b744/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:55.015303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 801/1602] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:24:54 2022] PUT /identity/v3/projects/ea08949e8ff04f25825d7873da2a7394/users/c77a01fed0e741288f05941fe5670a6d/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:24:55.017166 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fc0c5-bae0-4e21-a67a-bf8a95d457a3 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:55.023851 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d42b9b-3a79-4a47-b1aa-016d3bd28eea admin admin] RBAC: Authorizing `identity:create_grant(project_id=954859b49535432490388485f316513d, user_id=d815c45c04314dd0abe18cd9b4d9b744, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:55.026623 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d42b9b-3a79-4a47-b1aa-016d3bd28eea admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:55.041262 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 802/1603] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:24:54 2022] PUT /identity/v3/projects/954859b49535432490388485f316513d/users/d815c45c04314dd0abe18cd9b4d9b744/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:24:55.042422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d42b9b-3a79-4a47-b1aa-016d3bd28eea admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:55.089445 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8fc0c5-bae0-4e21-a67a-bf8a95d457a3 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:55.118856 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d42b9b-3a79-4a47-b1aa-016d3bd28eea admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:55.125617 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e4e28-3800-4b3e-b9fa-db7458d7952c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:55.126501 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e4e28-3800-4b3e-b9fa-db7458d7952c admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:55.126788 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e4e28-3800-4b3e-b9fa-db7458d7952c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:55.127080 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e4e28-3800-4b3e-b9fa-db7458d7952c admin admin] PATH_INFO: `/v3/projects/99d0aef0ce5f4773b94af6cb8b231893/users/98a86c51649e4b2daad002da656de7ec/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:55.145855 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e4e28-3800-4b3e-b9fa-db7458d7952c admin admin] RBAC: Authorizing `identity:create_grant(project_id=99d0aef0ce5f4773b94af6cb8b231893, user_id=98a86c51649e4b2daad002da656de7ec, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:55.148978 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e4e28-3800-4b3e-b9fa-db7458d7952c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:55.159472 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd0b2b-b374-4bcc-a165-04f8f07d066a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:55.160075 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd0b2b-b374-4bcc-a165-04f8f07d066a admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:55.160362 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd0b2b-b374-4bcc-a165-04f8f07d066a admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:55.160642 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd0b2b-b374-4bcc-a165-04f8f07d066a admin admin] PATH_INFO: `/v3/projects/d3a1bf94357a4eaea3b9cd0f4c2654ed/users/cd780132a4d849e189508314be49daa3/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:55.165681 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 803/1604] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:24:55 2022] PUT /identity/v3/projects/99d0aef0ce5f4773b94af6cb8b231893/users/98a86c51649e4b2daad002da656de7ec/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:24:55.167288 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1f08c-44d4-4226-a59b-ec14913b63b8 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:55.167855 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1f08c-44d4-4226-a59b-ec14913b63b8 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:55.168245 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1f08c-44d4-4226-a59b-ec14913b63b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:55.176797 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd0b2b-b374-4bcc-a165-04f8f07d066a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3a1bf94357a4eaea3b9cd0f4c2654ed, user_id=cd780132a4d849e189508314be49daa3, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:55.180859 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd0b2b-b374-4bcc-a165-04f8f07d066a admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:55.205020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 802/1605] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:24:55 2022] PUT /identity/v3/projects/d3a1bf94357a4eaea3b9cd0f4c2654ed/users/cd780132a4d849e189508314be49daa3/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:24:55.206819 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae32556-6b34-46b7-a64e-5e153cfa5303 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:55.207802 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae32556-6b34-46b7-a64e-5e153cfa5303 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:55.208520 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae32556-6b34-46b7-a64e-5e153cfa5303 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:55.210317 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 803/1606] 10.222.0.40 () {54 vars in 962 bytes} [Wed Jul 27 15:24:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:24:55.211300 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae32556-6b34-46b7-a64e-5e153cfa5303 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:55.211447 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-75f1f08c-44d4-4226-a59b-ec14913b63b8 None None] MFA Rules not processed for user `e6dd6288ce06470d9ecf43a26d12f444`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:24:55.213373 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-75f1f08c-44d4-4226-a59b-ec14913b63b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:24:55.224802 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:24:55.297136 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:24:55.301487 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 804/1607] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:24:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:24:55.304381 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33377b22-ce4c-4574-96cf-32acc76f94d7 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:55.305106 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33377b22-ce4c-4574-96cf-32acc76f94d7 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:55.305407 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33377b22-ce4c-4574-96cf-32acc76f94d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:55.319051 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae32556-6b34-46b7-a64e-5e153cfa5303 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:55.329970 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-33377b22-ce4c-4574-96cf-32acc76f94d7 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:24:55.331222 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-33377b22-ce4c-4574-96cf-32acc76f94d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:24:55.332156 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbe350d-d65f-4960-9d80-ce3783640d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:55.333210 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe350d-d65f-4960-9d80-ce3783640d22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:55.333724 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe350d-d65f-4960-9d80-ce3783640d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:55.334264 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbe350d-d65f-4960-9d80-ce3783640d22 admin admin] PATH_INFO: `/v3/projects/ab0194db873a441696f7e985a3b6c47c/users/b875adcba700459b99ce0d0d5ec9a9d9/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:55.345377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 805/1608] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:24:55.345377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58c7ea-c140-4c2b-8b33-f6bb25832ec1 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:55.345377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58c7ea-c140-4c2b-8b33-f6bb25832ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:55.345377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e58c7ea-c140-4c2b-8b33-f6bb25832ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:55.357595 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe350d-d65f-4960-9d80-ce3783640d22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab0194db873a441696f7e985a3b6c47c, user_id=b875adcba700459b99ce0d0d5ec9a9d9, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:55.361077 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbe350d-d65f-4960-9d80-ce3783640d22 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:55.377251 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4e58c7ea-c140-4c2b-8b33-f6bb25832ec1 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:24:55.378542 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4e58c7ea-c140-4c2b-8b33-f6bb25832ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:24:55.379023 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 804/1609] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:24:55 2022] PUT /identity/v3/projects/ab0194db873a441696f7e985a3b6c47c/users/b875adcba700459b99ce0d0d5ec9a9d9/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:24:55.381378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234db4a3-7d2a-4ea0-98fc-c29135d7b353 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:55.382005 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234db4a3-7d2a-4ea0-98fc-c29135d7b353 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:55.382875 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234db4a3-7d2a-4ea0-98fc-c29135d7b353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:55.421218 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-234db4a3-7d2a-4ea0-98fc-c29135d7b353 None None] MFA Rules not processed for user `98a86c51649e4b2daad002da656de7ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:24:55.423090 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-234db4a3-7d2a-4ea0-98fc-c29135d7b353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:24:55.467555 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 806/1610] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:24:55.469026 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b1e15-165b-42b5-b649-4e53d3d6fa95 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:55.469315 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b1e15-165b-42b5-b649-4e53d3d6fa95 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:55.469592 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b1e15-165b-42b5-b649-4e53d3d6fa95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:55.504269 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-0d8b1e15-165b-42b5-b649-4e53d3d6fa95 None None] MFA Rules not processed for user `cd780132a4d849e189508314be49daa3`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:24:55.505480 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0d8b1e15-165b-42b5-b649-4e53d3d6fa95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:24:55.514740 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 805/1611] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:24:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:24:55.514740 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359d502-c69a-40d8-9d53-c52cb6b889fa None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:55.514740 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359d502-c69a-40d8-9d53-c52cb6b889fa None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:55.514740 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d359d502-c69a-40d8-9d53-c52cb6b889fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:55.565151 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-d359d502-c69a-40d8-9d53-c52cb6b889fa None None] MFA Rules not processed for user `d3e01aa0ef1340cbba7170bac4a82783`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:24:55.567243 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d359d502-c69a-40d8-9d53-c52cb6b889fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:24:55.634805 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 807/1612] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:24:55 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:24:55.635918 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b1e15-165b-42b5-b649-4e53d3d6fa95 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:55.649664 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b1e15-165b-42b5-b649-4e53d3d6fa95 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:55.655931 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37135992-c735-4152-a198-0c39d9e09a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:55.656605 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37135992-c735-4152-a198-0c39d9e09a8a admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:55.656880 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37135992-c735-4152-a198-0c39d9e09a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:55.657149 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37135992-c735-4152-a198-0c39d9e09a8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:55.658511 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37135992-c735-4152-a198-0c39d9e09a8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:55.660501 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37135992-c735-4152-a198-0c39d9e09a8a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:55.695228 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 806/1613] 10.222.0.40 () {58 vars in 1059 bytes} [Wed Jul 27 15:24:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:24:55.704119 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359d502-c69a-40d8-9d53-c52cb6b889fa None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:55.714220 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 808/1614] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:24:55 2022] POST /identity/v3/projects => generated 403 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:24:55.719221 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397301e-29a5-4d14-a3a1-d7d494eb29c2 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:55.719455 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397301e-29a5-4d14-a3a1-d7d494eb29c2 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:55.719751 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0397301e-29a5-4d14-a3a1-d7d494eb29c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:55.746338 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-0397301e-29a5-4d14-a3a1-d7d494eb29c2 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:24:55.751169 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0397301e-29a5-4d14-a3a1-d7d494eb29c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:24:55.764211 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:24:55.772132 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:24:55.786895 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d359d502-c69a-40d8-9d53-c52cb6b889fa None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:55.850582 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 809/1615] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:24:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:24:55.853038 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397301e-29a5-4d14-a3a1-d7d494eb29c2 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:55.868602 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd195824-cf3e-4e37-b7e0-216001ca0f7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:55.869101 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd195824-cf3e-4e37-b7e0-216001ca0f7f service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:55.869448 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd195824-cf3e-4e37-b7e0-216001ca0f7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:55.869796 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd195824-cf3e-4e37-b7e0-216001ca0f7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:55.883324 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd195824-cf3e-4e37-b7e0-216001ca0f7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:55.885297 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd195824-cf3e-4e37-b7e0-216001ca0f7f service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:55.896954 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 807/1616] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:24:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:24:55.898288 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44204af0-acfa-441b-bfdd-58e2446b7f06 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:55.898813 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44204af0-acfa-441b-bfdd-58e2446b7f06 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:55.898813 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44204af0-acfa-441b-bfdd-58e2446b7f06 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:55.900417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 808/1617] 10.222.0.40 () {54 vars in 962 bytes} [Wed Jul 27 15:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:24:55.901244 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44204af0-acfa-441b-bfdd-58e2446b7f06 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:55.924602 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44204af0-acfa-441b-bfdd-58e2446b7f06 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:55.933240 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fbdb02-a450-4236-b6ca-9eacee5a89a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:55.933955 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbdb02-a450-4236-b6ca-9eacee5a89a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:55.935226 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbdb02-a450-4236-b6ca-9eacee5a89a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:55.935528 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbdb02-a450-4236-b6ca-9eacee5a89a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:55.936376 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fbdb02-a450-4236-b6ca-9eacee5a89a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:55.938477 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fbdb02-a450-4236-b6ca-9eacee5a89a0 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:55.952222 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0397301e-29a5-4d14-a3a1-d7d494eb29c2 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:55.958221 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb5ff5-bf40-4472-85d9-eaf60a174d53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:55.958930 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb5ff5-bf40-4472-85d9-eaf60a174d53 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:55.959388 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb5ff5-bf40-4472-85d9-eaf60a174d53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:55.959726 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb5ff5-bf40-4472-85d9-eaf60a174d53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:55.973318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb5ff5-bf40-4472-85d9-eaf60a174d53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:55.975115 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb5ff5-bf40-4472-85d9-eaf60a174d53 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:55.991812 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 809/1618] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:24:55 2022] POST /identity/v3/projects => generated 363 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:24:55.992815 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fbdb02-a450-4236-b6ca-9eacee5a89a0 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:55.997538 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 810/1619] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:24:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:24:55.998794 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb5ff5-bf40-4472-85d9-eaf60a174d53 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:56.021385 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb5ff5-bf40-4472-85d9-eaf60a174d53 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:56.128225 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fbdb02-a450-4236-b6ca-9eacee5a89a0 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:56.138757 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6533f-40b3-4a33-a715-8d7229549e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:56.139545 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6533f-40b3-4a33-a715-8d7229549e13 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:56.140151 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6533f-40b3-4a33-a715-8d7229549e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:56.140477 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6533f-40b3-4a33-a715-8d7229549e13 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:56.140911 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d171706-ea16-41de-a99d-151b1ec42bea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:56.141337 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6533f-40b3-4a33-a715-8d7229549e13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:56.142718 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d171706-ea16-41de-a99d-151b1ec42bea service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:56.143256 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d171706-ea16-41de-a99d-151b1ec42bea service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:56.144799 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6533f-40b3-4a33-a715-8d7229549e13 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:56.145814 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d171706-ea16-41de-a99d-151b1ec42bea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:56.196755 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 811/1620] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:24:55 2022] POST /identity/v3/users => generated 308 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:24:56.200530 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6533f-40b3-4a33-a715-8d7229549e13 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:56.277149 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:24:56.283491 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6533f-40b3-4a33-a715-8d7229549e13 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:56.291305 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb936ce2-567e-40f7-96f6-e20a8e54b99a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:56.291703 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d171706-ea16-41de-a99d-151b1ec42bea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:56.293031 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb936ce2-567e-40f7-96f6-e20a8e54b99a service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:56.293516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d171706-ea16-41de-a99d-151b1ec42bea service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:56.293764 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb936ce2-567e-40f7-96f6-e20a8e54b99a service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:56.294256 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb936ce2-567e-40f7-96f6-e20a8e54b99a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:56.307052 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 810/1621] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:24:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:24:56.307366 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb936ce2-567e-40f7-96f6-e20a8e54b99a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:56.309907 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5959aa2-6d2d-4db8-818c-75fbc6924d25 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:56.310215 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5959aa2-6d2d-4db8-818c-75fbc6924d25 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:56.310476 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5959aa2-6d2d-4db8-818c-75fbc6924d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:56.310779 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb936ce2-567e-40f7-96f6-e20a8e54b99a service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:56.330548 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 812/1622] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:24:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:24:56.332352 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb936ce2-567e-40f7-96f6-e20a8e54b99a service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:56.337565 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-c5959aa2-6d2d-4db8-818c-75fbc6924d25 None None] MFA Rules not processed for user `d3e01aa0ef1340cbba7170bac4a82783`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:24:56.340229 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-c5959aa2-6d2d-4db8-818c-75fbc6924d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:24:56.346178 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb936ce2-567e-40f7-96f6-e20a8e54b99a service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:56.352598 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbd543-6dff-424a-86ba-2da13520847e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:56.353551 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbd543-6dff-424a-86ba-2da13520847e admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:56.354223 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbd543-6dff-424a-86ba-2da13520847e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:56.354715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbd543-6dff-424a-86ba-2da13520847e admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:56.355649 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cbd543-6dff-424a-86ba-2da13520847e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:56.357994 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cbd543-6dff-424a-86ba-2da13520847e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:56.361307 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 811/1623] 10.222.0.40 () {58 vars in 1059 bytes} [Wed Jul 27 15:24:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:24:56.362178 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5959aa2-6d2d-4db8-818c-75fbc6924d25 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:56.390884 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5959aa2-6d2d-4db8-818c-75fbc6924d25 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:56.405429 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 813/1624] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:24:56 2022] POST /identity/v3/users => generated 288 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:24:56.406306 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbd543-6dff-424a-86ba-2da13520847e admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:56.406683 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a51db-02aa-43a2-87f3-5fe54184ed1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:56.407697 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a51db-02aa-43a2-87f3-5fe54184ed1b admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:56.408486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a51db-02aa-43a2-87f3-5fe54184ed1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:56.408830 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823a51db-02aa-43a2-87f3-5fe54184ed1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:56.409661 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a51db-02aa-43a2-87f3-5fe54184ed1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:56.411530 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823a51db-02aa-43a2-87f3-5fe54184ed1b admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:56.430445 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:24:56.518562 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 812/1625] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:24:56.519654 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbd543-6dff-424a-86ba-2da13520847e admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:56.520096 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a51db-02aa-43a2-87f3-5fe54184ed1b admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:56.520479 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c91f6a-8763-4a9f-95f3-4f713b3ea059 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:56.520479 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c91f6a-8763-4a9f-95f3-4f713b3ea059 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:56.520479 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c91f6a-8763-4a9f-95f3-4f713b3ea059 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:56.520479 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c91f6a-8763-4a9f-95f3-4f713b3ea059 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:56.520921 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823a51db-02aa-43a2-87f3-5fe54184ed1b admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:56.520921 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b53ae8-75fa-4076-9e39-684f3dd194de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:56.520921 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b53ae8-75fa-4076-9e39-684f3dd194de admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:56.520921 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b53ae8-75fa-4076-9e39-684f3dd194de admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:56.521208 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b53ae8-75fa-4076-9e39-684f3dd194de admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:56.521208 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b53ae8-75fa-4076-9e39-684f3dd194de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:56.521208 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b53ae8-75fa-4076-9e39-684f3dd194de admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:56.552274 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 813/1626] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:24:56.553164 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b53ae8-75fa-4076-9e39-684f3dd194de admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:56.571450 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b53ae8-75fa-4076-9e39-684f3dd194de admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:56.583234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd117a96-bbd7-41e4-9c6a-9351c8627628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:56.584926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd117a96-bbd7-41e4-9c6a-9351c8627628 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:56.589106 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd117a96-bbd7-41e4-9c6a-9351c8627628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:56.589404 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd117a96-bbd7-41e4-9c6a-9351c8627628 admin admin] PATH_INFO: `/v3/projects/abd4f3bdfc0747a7bb9f14b6d9617746/users/2f414650ac184678aea92f5cebbdc024/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:56.609491 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd117a96-bbd7-41e4-9c6a-9351c8627628 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abd4f3bdfc0747a7bb9f14b6d9617746, user_id=2f414650ac184678aea92f5cebbdc024, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:56.612495 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd117a96-bbd7-41e4-9c6a-9351c8627628 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:56.643337 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c91f6a-8763-4a9f-95f3-4f713b3ea059 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:56.645435 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c91f6a-8763-4a9f-95f3-4f713b3ea059 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:56.647790 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 814/1627] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:24:56 2022] PUT /identity/v3/projects/abd4f3bdfc0747a7bb9f14b6d9617746/users/2f414650ac184678aea92f5cebbdc024/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:24:56.653879 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd117a96-bbd7-41e4-9c6a-9351c8627628 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:56.663952 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 814/1628] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:24:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:24:56.665440 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c91f6a-8763-4a9f-95f3-4f713b3ea059 service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:56.692724 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c91f6a-8763-4a9f-95f3-4f713b3ea059 service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:56.814344 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd117a96-bbd7-41e4-9c6a-9351c8627628 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:56.825866 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dd22c-b15d-4efc-99a7-e05025c794ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:56.827164 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dd22c-b15d-4efc-99a7-e05025c794ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:56.828328 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dd22c-b15d-4efc-99a7-e05025c794ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:56.828328 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dd22c-b15d-4efc-99a7-e05025c794ed admin admin] PATH_INFO: `/v3/projects/a6f3bce2e90f49a5af48ee7934e0ea79/users/14966e53f64b46fc87fa2a647c848132/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:56.832177 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91327284-16c2-4789-aaaa-912996438cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:56.834459 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91327284-16c2-4789-aaaa-912996438cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:56.836221 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91327284-16c2-4789-aaaa-912996438cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:56.836221 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91327284-16c2-4789-aaaa-912996438cc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:56.837893 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91327284-16c2-4789-aaaa-912996438cc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:56.842776 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91327284-16c2-4789-aaaa-912996438cc9 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:56.874205 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 815/1629] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:24:56.875869 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93dd22c-b15d-4efc-99a7-e05025c794ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6f3bce2e90f49a5af48ee7934e0ea79, user_id=14966e53f64b46fc87fa2a647c848132, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:56.877809 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91327284-16c2-4789-aaaa-912996438cc9 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:56.881865 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93dd22c-b15d-4efc-99a7-e05025c794ed admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:56.908722 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91327284-16c2-4789-aaaa-912996438cc9 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:56.911063 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 815/1630] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:24:56 2022] PUT /identity/v3/projects/a6f3bce2e90f49a5af48ee7934e0ea79/users/14966e53f64b46fc87fa2a647c848132/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:24:56.917574 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dd22c-b15d-4efc-99a7-e05025c794ed admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:57.034620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb54e7-ae6a-4f0e-8910-01f6c2051d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:57.036143 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb54e7-ae6a-4f0e-8910-01f6c2051d48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:57.040233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb54e7-ae6a-4f0e-8910-01f6c2051d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:57.041757 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb54e7-ae6a-4f0e-8910-01f6c2051d48 admin admin] PATH_INFO: `/v3/projects/abd4f3bdfc0747a7bb9f14b6d9617746/users/2f414650ac184678aea92f5cebbdc024/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:57.045225 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb54e7-ae6a-4f0e-8910-01f6c2051d48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abd4f3bdfc0747a7bb9f14b6d9617746, user_id=2f414650ac184678aea92f5cebbdc024, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:57.054339 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbb54e7-ae6a-4f0e-8910-01f6c2051d48 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:57.066068 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:24:57.070110 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dd22c-b15d-4efc-99a7-e05025c794ed admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:57.080540 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 816/1631] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:24:56 2022] PUT /identity/v3/projects/abd4f3bdfc0747a7bb9f14b6d9617746/users/2f414650ac184678aea92f5cebbdc024/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:24:57.082937 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbf694-a7c0-4bfb-818c-d23a5134daaa None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:57.085689 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbf694-a7c0-4bfb-818c-d23a5134daaa None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:57.085974 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbf694-a7c0-4bfb-818c-d23a5134daaa None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:57.087311 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 817/1632] 10.222.0.40 () {54 vars in 912 bytes} [Wed Jul 27 15:24:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:24:57.088937 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66e699-a76e-405a-b0e0-dd2b910644b5 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:57.088937 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66e699-a76e-405a-b0e0-dd2b910644b5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:57.088937 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66e699-a76e-405a-b0e0-dd2b910644b5 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:57.096336 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 818/1633] 10.222.0.40 () {54 vars in 912 bytes} [Wed Jul 27 15:24:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:24:57.097448 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a3146-8301-4efb-8d9c-bd67320aa828 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:57.097737 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a3146-8301-4efb-8d9c-bd67320aa828 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:57.098015 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a3146-8301-4efb-8d9c-bd67320aa828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:57.158980 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-3f8a3146-8301-4efb-8d9c-bd67320aa828 None None] MFA Rules not processed for user `2f414650ac184678aea92f5cebbdc024`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:24:57.160538 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3f8a3146-8301-4efb-8d9c-bd67320aa828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:24:57.181570 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:24:57.208328 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ef497-a3d7-46a8-a010-23325cb0ce70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:57.210337 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ef497-a3d7-46a8-a010-23325cb0ce70 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:57.211454 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ef497-a3d7-46a8-a010-23325cb0ce70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:57.211957 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ef497-a3d7-46a8-a010-23325cb0ce70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:57.212888 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ef497-a3d7-46a8-a010-23325cb0ce70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:57.217802 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ef497-a3d7-46a8-a010-23325cb0ce70 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:57.261191 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 816/1634] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:24:57.263007 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e735f5f-7e48-456c-9087-bf12e894c199 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:57.263353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e735f5f-7e48-456c-9087-bf12e894c199 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:57.263737 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e735f5f-7e48-456c-9087-bf12e894c199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:57.293028 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-2e735f5f-7e48-456c-9087-bf12e894c199 None None] MFA Rules not processed for user `d3e01aa0ef1340cbba7170bac4a82783`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:24:57.294995 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-2e735f5f-7e48-456c-9087-bf12e894c199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:24:57.307259 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 819/1635] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:24:57 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:24:57.309818 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073fb59-ec1d-48d0-89d1-101369a5043c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:57.310280 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073fb59-ec1d-48d0-89d1-101369a5043c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:57.310632 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073fb59-ec1d-48d0-89d1-101369a5043c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:57.344512 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9073fb59-ec1d-48d0-89d1-101369a5043c None None] MFA Rules not processed for user `d3e01aa0ef1340cbba7170bac4a82783`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:24:57.349733 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9073fb59-ec1d-48d0-89d1-101369a5043c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:24:57.444638 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 817/1636] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Jul 27 15:24:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:24:57.446314 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e735f5f-7e48-456c-9087-bf12e894c199 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:57.460756 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e735f5f-7e48-456c-9087-bf12e894c199 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:57.473027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f5355-d7b2-4224-9fbc-4a1424ae8331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:57.474335 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f5355-d7b2-4224-9fbc-4a1424ae8331 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:57.474775 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f5355-d7b2-4224-9fbc-4a1424ae8331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:57.475218 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62f5355-d7b2-4224-9fbc-4a1424ae8331 admin admin] PATH_INFO: `/v3/projects/a6f3bce2e90f49a5af48ee7934e0ea79/users/14966e53f64b46fc87fa2a647c848132/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:57.479095 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f5355-d7b2-4224-9fbc-4a1424ae8331 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6f3bce2e90f49a5af48ee7934e0ea79, user_id=14966e53f64b46fc87fa2a647c848132, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:57.484117 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62f5355-d7b2-4224-9fbc-4a1424ae8331 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:57.504617 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 818/1637] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:24:57 2022] PUT /identity/v3/projects/a6f3bce2e90f49a5af48ee7934e0ea79/users/14966e53f64b46fc87fa2a647c848132/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:24:57.505579 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 820/1638] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Jul 27 15:24:57 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:24:57.505980 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f5355-d7b2-4224-9fbc-4a1424ae8331 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:57.506661 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073fb59-ec1d-48d0-89d1-101369a5043c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:57.609690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073fb59-ec1d-48d0-89d1-101369a5043c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:57.657096 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62f5355-d7b2-4224-9fbc-4a1424ae8331 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:57.670945 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f89760e-a9f8-4efb-abda-5bc70da21f25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:57.671673 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89760e-a9f8-4efb-abda-5bc70da21f25 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:57.673079 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89760e-a9f8-4efb-abda-5bc70da21f25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:57.673505 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f89760e-a9f8-4efb-abda-5bc70da21f25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:57.680900 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:24:57.745043 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3e48f-dbd9-4439-a1b5-755adebe8450 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:57.745888 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3e48f-dbd9-4439-a1b5-755adebe8450 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:57.746184 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3e48f-dbd9-4439-a1b5-755adebe8450 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:57.746562 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d3e48f-dbd9-4439-a1b5-755adebe8450 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:57.828163 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89760e-a9f8-4efb-abda-5bc70da21f25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:57.830989 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f89760e-a9f8-4efb-abda-5bc70da21f25 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:57.847947 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 819/1639] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:24:57 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:24:57.850969 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19658583-6c9f-46f2-9e00-61956ad7772a None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:57.851287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19658583-6c9f-46f2-9e00-61956ad7772a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:57.851586 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19658583-6c9f-46f2-9e00-61956ad7772a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:57.888986 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d3e48f-dbd9-4439-a1b5-755adebe8450 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:57.896975 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-19658583-6c9f-46f2-9e00-61956ad7772a None None] MFA Rules not processed for user `14966e53f64b46fc87fa2a647c848132`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:24:57.899501 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-19658583-6c9f-46f2-9e00-61956ad7772a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:24:57.904586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d3e48f-dbd9-4439-a1b5-755adebe8450 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:57.909963 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:24:57.929780 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 821/1640] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:24:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:24:57.969214 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3e48f-dbd9-4439-a1b5-755adebe8450 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:57.989628 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d3e48f-dbd9-4439-a1b5-755adebe8450 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:58.008103 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05578e-55d2-4154-ad00-8901578ed74a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:58.011020 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05578e-55d2-4154-ad00-8901578ed74a service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:58.011578 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05578e-55d2-4154-ad00-8901578ed74a service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:58.012932 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af05578e-55d2-4154-ad00-8901578ed74a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:58.016384 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 820/1641] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:24:57 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:24:58.041082 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af05578e-55d2-4154-ad00-8901578ed74a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:58.046289 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af05578e-55d2-4154-ad00-8901578ed74a service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:58.077067 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 822/1642] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:24:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 15:24:58.137454 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19658583-6c9f-46f2-9e00-61956ad7772a None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:58.150271 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19658583-6c9f-46f2-9e00-61956ad7772a None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:58.154406 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6ca84-236f-4b58-8267-3435902ae4c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:58.155623 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6ca84-236f-4b58-8267-3435902ae4c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:58.155905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6ca84-236f-4b58-8267-3435902ae4c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:58.156241 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6ca84-236f-4b58-8267-3435902ae4c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:58.181640 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b6ca84-236f-4b58-8267-3435902ae4c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:58.183171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b6ca84-236f-4b58-8267-3435902ae4c0 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:58.217687 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 821/1643] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:24:58 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:24:58.575409 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05578e-55d2-4154-ad00-8901578ed74a service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:58.638999 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6ca84-236f-4b58-8267-3435902ae4c0 service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:58.730280 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af05578e-55d2-4154-ad00-8901578ed74a service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:58.744417 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7390b-30a8-4929-b35d-176c51b5cfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:58.745809 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7390b-30a8-4929-b35d-176c51b5cfdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:58.747267 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7390b-30a8-4929-b35d-176c51b5cfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:58.749767 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7390b-30a8-4929-b35d-176c51b5cfdc admin admin] PATH_INFO: `/v3/users/8187bb8d31344ecda22634ce5d73f7f3` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:58.753367 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a7390b-30a8-4929-b35d-176c51b5cfdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8187bb8d31344ecda22634ce5d73f7f3)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:58.761691 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a7390b-30a8-4929-b35d-176c51b5cfdc admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:58.831368 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b6ca84-236f-4b58-8267-3435902ae4c0 service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:58.843690 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba0ec7a-0a32-4839-8e65-3c6649a10320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:58.844705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0ec7a-0a32-4839-8e65-3c6649a10320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:58.845891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0ec7a-0a32-4839-8e65-3c6649a10320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:58.846330 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba0ec7a-0a32-4839-8e65-3c6649a10320 admin admin] PATH_INFO: `/v3/users/e6dd6288ce06470d9ecf43a26d12f444` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:58.849725 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0ec7a-0a32-4839-8e65-3c6649a10320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6dd6288ce06470d9ecf43a26d12f444)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:58.858258 dv-cinder-841315-2-smb devstack@keystone.service[80057]: WARNING py.warnings [None req-3ba0ec7a-0a32-4839-8e65-3c6649a10320 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:24:58.858258 dv-cinder-841315-2-smb devstack@keystone.service[80057]: warnings.warn(msg) Jul 27 15:24:58.858258 dv-cinder-841315-2-smb devstack@keystone.service[80057]: Jul 27 15:24:58.863413 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba0ec7a-0a32-4839-8e65-3c6649a10320 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:58.880018 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-62a7390b-30a8-4929-b35d-176c51b5cfdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8187bb8d31344ecda22634ce5d73f7f3'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:24:58.881086 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-62a7390b-30a8-4929-b35d-176c51b5cfdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8187bb8d31344ecda22634ce5d73f7f3'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:24:58.900304 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-62a7390b-30a8-4929-b35d-176c51b5cfdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8187bb8d31344ecda22634ce5d73f7f3'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:24:58.902525 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-62a7390b-30a8-4929-b35d-176c51b5cfdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8187bb8d31344ecda22634ce5d73f7f3'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:24:58.942011 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:24:58.979684 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-62a7390b-30a8-4929-b35d-176c51b5cfdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8187bb8d31344ecda22634ce5d73f7f3'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:24:58.989223 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-3ba0ec7a-0a32-4839-8e65-3c6649a10320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6dd6288ce06470d9ecf43a26d12f444'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:24:58.989956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-3ba0ec7a-0a32-4839-8e65-3c6649a10320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6dd6288ce06470d9ecf43a26d12f444'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:24:59.005220 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-3ba0ec7a-0a32-4839-8e65-3c6649a10320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6dd6288ce06470d9ecf43a26d12f444'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:24:59.024661 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-3ba0ec7a-0a32-4839-8e65-3c6649a10320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6dd6288ce06470d9ecf43a26d12f444'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:24:59.032526 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 823/1644] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:24:58 2022] DELETE /identity/v3/users/8187bb8d31344ecda22634ce5d73f7f3 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:24:59.035756 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7390b-30a8-4929-b35d-176c51b5cfdc admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:59.038165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-62a7390b-30a8-4929-b35d-176c51b5cfdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:24:59.074448 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-3ba0ec7a-0a32-4839-8e65-3c6649a10320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6dd6288ce06470d9ecf43a26d12f444'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:24:59.085408 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 822/1645] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:24:58 2022] DELETE /identity/v3/users/e6dd6288ce06470d9ecf43a26d12f444 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:24:59.086783 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d711d-960c-4b61-9172-a5d275097a63 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:59.087078 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d711d-960c-4b61-9172-a5d275097a63 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:59.087365 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d711d-960c-4b61-9172-a5d275097a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:59.129500 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-8b9d711d-960c-4b61-9172-a5d275097a63 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:24:59.131197 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8b9d711d-960c-4b61-9172-a5d275097a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:24:59.142022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:24:59.236054 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7390b-30a8-4929-b35d-176c51b5cfdc admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:59.255450 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 823/1646] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:24:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:24:59.259838 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eaeea7-c9c3-4bd9-86e5-92967f3ce4a2 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:59.261682 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eaeea7-c9c3-4bd9-86e5-92967f3ce4a2 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:59.262202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5eaeea7-c9c3-4bd9-86e5-92967f3ce4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:59.306499 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-d5eaeea7-c9c3-4bd9-86e5-92967f3ce4a2 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:24:59.307837 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d5eaeea7-c9c3-4bd9-86e5-92967f3ce4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:24:59.326077 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 824/1647] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:24:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:24:59.370736 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852042e-261e-429d-8689-0e50b2909cef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:59.371546 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852042e-261e-429d-8689-0e50b2909cef service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:59.371834 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852042e-261e-429d-8689-0e50b2909cef service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:59.372150 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c852042e-261e-429d-8689-0e50b2909cef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:59.374178 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c852042e-261e-429d-8689-0e50b2909cef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:24:59.513397 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852042e-261e-429d-8689-0e50b2909cef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:59.515035 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c852042e-261e-429d-8689-0e50b2909cef service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:59.547346 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eaeea7-c9c3-4bd9-86e5-92967f3ce4a2 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:59.549031 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d5eaeea7-c9c3-4bd9-86e5-92967f3ce4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:24:59.554474 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 824/1648] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:24:59 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:24:59.568903 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852042e-261e-429d-8689-0e50b2909cef service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:24:59.570357 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c852042e-261e-429d-8689-0e50b2909cef service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:24:59.681822 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5eaeea7-c9c3-4bd9-86e5-92967f3ce4a2 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:59.692179 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268ad8f-7a4b-4cdd-aa10-6f987bccb8bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:59.692832 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268ad8f-7a4b-4cdd-aa10-6f987bccb8bf service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:59.693119 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268ad8f-7a4b-4cdd-aa10-6f987bccb8bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:59.693393 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268ad8f-7a4b-4cdd-aa10-6f987bccb8bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:59.725037 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268ad8f-7a4b-4cdd-aa10-6f987bccb8bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:59.726691 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268ad8f-7a4b-4cdd-aa10-6f987bccb8bf service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:59.741188 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 825/1649] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:24:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 15:24:59.769641 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c852042e-261e-429d-8689-0e50b2909cef service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:24:59.781081 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df734698-b8a1-44c1-8542-c1352a70d259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:24:59.783052 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df734698-b8a1-44c1-8542-c1352a70d259 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:24:59.816648 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df734698-b8a1-44c1-8542-c1352a70d259 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:24:59.816648 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df734698-b8a1-44c1-8542-c1352a70d259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:24:59.816648 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:24:59.817891 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df734698-b8a1-44c1-8542-c1352a70d259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:24:59.820253 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df734698-b8a1-44c1-8542-c1352a70d259 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:24:59.845672 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 825/1650] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:24:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 15:25:02.901319 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268ad8f-7a4b-4cdd-aa10-6f987bccb8bf service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:02.903416 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a268ad8f-7a4b-4cdd-aa10-6f987bccb8bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:02.928744 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268ad8f-7a4b-4cdd-aa10-6f987bccb8bf service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:02.938626 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eff8b3-e2d2-4f2d-9c63-f1d8a1bb3a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:02.939603 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eff8b3-e2d2-4f2d-9c63-f1d8a1bb3a65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:02.940053 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eff8b3-e2d2-4f2d-9c63-f1d8a1bb3a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:02.940478 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eff8b3-e2d2-4f2d-9c63-f1d8a1bb3a65 admin admin] PATH_INFO: `/v3/projects/12ffb2c18638461aaf26903c3cf167f7` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:02.942252 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eff8b3-e2d2-4f2d-9c63-f1d8a1bb3a65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12ffb2c18638461aaf26903c3cf167f7)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:02.946392 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eff8b3-e2d2-4f2d-9c63-f1d8a1bb3a65 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:02.953324 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df734698-b8a1-44c1-8542-c1352a70d259 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:02.956033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-df734698-b8a1-44c1-8542-c1352a70d259 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:02.987646 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df734698-b8a1-44c1-8542-c1352a70d259 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:02.999042 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b5793-4d58-4ddb-8f3a-791f8f0335b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:03.000490 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b5793-4d58-4ddb-8f3a-791f8f0335b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:03.002185 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b5793-4d58-4ddb-8f3a-791f8f0335b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:03.002678 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b5793-4d58-4ddb-8f3a-791f8f0335b2 admin admin] PATH_INFO: `/v3/projects/55efb10b041b4a02aac7dd7588e38a6b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:03.006746 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b5793-4d58-4ddb-8f3a-791f8f0335b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55efb10b041b4a02aac7dd7588e38a6b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:03.010157 dv-cinder-841315-2-smb devstack@keystone.service[80058]: WARNING py.warnings [None req-628b5793-4d58-4ddb-8f3a-791f8f0335b2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 15:25:03.010157 dv-cinder-841315-2-smb devstack@keystone.service[80058]: warnings.warn(msg) Jul 27 15:25:03.010157 dv-cinder-841315-2-smb devstack@keystone.service[80058]: Jul 27 15:25:03.013304 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628b5793-4d58-4ddb-8f3a-791f8f0335b2 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:03.076941 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-d8eff8b3-e2d2-4f2d-9c63-f1d8a1bb3a65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12ffb2c18638461aaf26903c3cf167f7', 'request_id': 'req-d8eff8b3-e2d2-4f2d-9c63-f1d8a1bb3a65'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:03.094013 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-d8eff8b3-e2d2-4f2d-9c63-f1d8a1bb3a65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12ffb2c18638461aaf26903c3cf167f7', 'request_id': 'req-d8eff8b3-e2d2-4f2d-9c63-f1d8a1bb3a65'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:03.114183 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-d8eff8b3-e2d2-4f2d-9c63-f1d8a1bb3a65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12ffb2c18638461aaf26903c3cf167f7', 'request_id': 'req-d8eff8b3-e2d2-4f2d-9c63-f1d8a1bb3a65'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:03.147667 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-d8eff8b3-e2d2-4f2d-9c63-f1d8a1bb3a65 admin admin] The token cache is being invalidate because project 12ffb2c18638461aaf26903c3cf167f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:25:03.148065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-d8eff8b3-e2d2-4f2d-9c63-f1d8a1bb3a65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:03.151352 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-d8eff8b3-e2d2-4f2d-9c63-f1d8a1bb3a65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:03.155299 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 826/1651] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:25:02 2022] DELETE /identity/v3/projects/12ffb2c18638461aaf26903c3cf167f7 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:25:03.159809 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ecb58-cba4-4d82-958c-765515402ee4 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:03.160126 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ecb58-cba4-4d82-958c-765515402ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:03.160408 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4ecb58-cba4-4d82-958c-765515402ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:03.186536 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-628b5793-4d58-4ddb-8f3a-791f8f0335b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55efb10b041b4a02aac7dd7588e38a6b', 'request_id': 'req-628b5793-4d58-4ddb-8f3a-791f8f0335b2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:03.217700 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-1d4ecb58-cba4-4d82-958c-765515402ee4 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:03.223275 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-1d4ecb58-cba4-4d82-958c-765515402ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:03.227841 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-628b5793-4d58-4ddb-8f3a-791f8f0335b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55efb10b041b4a02aac7dd7588e38a6b', 'request_id': 'req-628b5793-4d58-4ddb-8f3a-791f8f0335b2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:03.249406 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-628b5793-4d58-4ddb-8f3a-791f8f0335b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55efb10b041b4a02aac7dd7588e38a6b', 'request_id': 'req-628b5793-4d58-4ddb-8f3a-791f8f0335b2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:03.284617 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-628b5793-4d58-4ddb-8f3a-791f8f0335b2 admin admin] The token cache is being invalidate because project 55efb10b041b4a02aac7dd7588e38a6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:25:03.284929 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-628b5793-4d58-4ddb-8f3a-791f8f0335b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:03.285727 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-628b5793-4d58-4ddb-8f3a-791f8f0335b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:03.291305 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 826/1652] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:25:02 2022] DELETE /identity/v3/projects/55efb10b041b4a02aac7dd7588e38a6b => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:25:03.292824 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b5793-4d58-4ddb-8f3a-791f8f0335b2 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:03.295770 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-628b5793-4d58-4ddb-8f3a-791f8f0335b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:03.314396 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:03.393593 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 827/1653] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:25:03.401662 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9744c-ce27-4ed6-81a0-7ae53fab65a6 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:03.401975 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9744c-ce27-4ed6-81a0-7ae53fab65a6 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:03.402465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c9744c-ce27-4ed6-81a0-7ae53fab65a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:03.433338 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628b5793-4d58-4ddb-8f3a-791f8f0335b2 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:03.453771 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d019e-d2e5-44f8-9ee4-2aaad296393d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:03.454384 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-a5c9744c-ce27-4ed6-81a0-7ae53fab65a6 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:03.455612 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a5c9744c-ce27-4ed6-81a0-7ae53fab65a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:03.455841 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d019e-d2e5-44f8-9ee4-2aaad296393d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:03.456651 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d019e-d2e5-44f8-9ee4-2aaad296393d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:03.458068 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d019e-d2e5-44f8-9ee4-2aaad296393d admin admin] PATH_INFO: `/v3/users/2f414650ac184678aea92f5cebbdc024` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:03.460392 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d019e-d2e5-44f8-9ee4-2aaad296393d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f414650ac184678aea92f5cebbdc024)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:03.463858 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d019e-d2e5-44f8-9ee4-2aaad296393d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:03.479381 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 828/1654] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:03.480706 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9744c-ce27-4ed6-81a0-7ae53fab65a6 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:03.498820 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c9744c-ce27-4ed6-81a0-7ae53fab65a6 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:03.511160 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ec0b0-9071-46c9-9fc4-361544856d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:03.511809 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ec0b0-9071-46c9-9fc4-361544856d91 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:03.512663 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ec0b0-9071-46c9-9fc4-361544856d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:03.512941 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43ec0b0-9071-46c9-9fc4-361544856d91 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:03.513648 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ec0b0-9071-46c9-9fc4-361544856d91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:25:03.513957 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ec0b0-9071-46c9-9fc4-361544856d91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:03.515565 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43ec0b0-9071-46c9-9fc4-361544856d91 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:03.564202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 829/1655] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:25:03.565103 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ec0b0-9071-46c9-9fc4-361544856d91 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:03.589101 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43ec0b0-9071-46c9-9fc4-361544856d91 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:03.607622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddaafba-02b3-428e-81d4-cbfe7c638537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:03.608740 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddaafba-02b3-428e-81d4-cbfe7c638537 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:03.609253 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddaafba-02b3-428e-81d4-cbfe7c638537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:03.609764 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddaafba-02b3-428e-81d4-cbfe7c638537 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:03.611201 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddaafba-02b3-428e-81d4-cbfe7c638537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:03.613192 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddaafba-02b3-428e-81d4-cbfe7c638537 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:03.652654 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-543d019e-d2e5-44f8-9ee4-2aaad296393d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f414650ac184678aea92f5cebbdc024'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:03.654524 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-543d019e-d2e5-44f8-9ee4-2aaad296393d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f414650ac184678aea92f5cebbdc024'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:03.682576 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 830/1656] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:25:03 2022] POST /identity/v3/projects => generated 379 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:03.686670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-543d019e-d2e5-44f8-9ee4-2aaad296393d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f414650ac184678aea92f5cebbdc024'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:03.689327 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-543d019e-d2e5-44f8-9ee4-2aaad296393d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f414650ac184678aea92f5cebbdc024'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:03.693024 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddaafba-02b3-428e-81d4-cbfe7c638537 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:03.705992 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-bddaafba-02b3-428e-81d4-cbfe7c638537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:03.732403 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-543d019e-d2e5-44f8-9ee4-2aaad296393d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f414650ac184678aea92f5cebbdc024'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:03.751794 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:03.781378 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 827/1657] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:25:03 2022] DELETE /identity/v3/users/2f414650ac184678aea92f5cebbdc024 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:03.906160 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddaafba-02b3-428e-81d4-cbfe7c638537 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:04.052657 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d019e-d2e5-44f8-9ee4-2aaad296393d admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:04.055272 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-543d019e-d2e5-44f8-9ee4-2aaad296393d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:04.082406 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e61d1-3717-4b92-b577-ed93612a9adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:04.083644 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e61d1-3717-4b92-b577-ed93612a9adb admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:04.083956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e61d1-3717-4b92-b577-ed93612a9adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:04.084327 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e61d1-3717-4b92-b577-ed93612a9adb admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:04.085081 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e61d1-3717-4b92-b577-ed93612a9adb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:04.087558 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e61d1-3717-4b92-b577-ed93612a9adb admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:04.127276 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 831/1658] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:25:03 2022] POST /identity/v3/users => generated 290 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:04.128412 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e61d1-3717-4b92-b577-ed93612a9adb admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:04.140140 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e61d1-3717-4b92-b577-ed93612a9adb admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:04.145544 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d3ab3-1055-471f-bdd0-1e620fa6ccc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:04.146281 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d3ab3-1055-471f-bdd0-1e620fa6ccc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:04.146567 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d3ab3-1055-471f-bdd0-1e620fa6ccc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:04.146847 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58d3ab3-1055-471f-bdd0-1e620fa6ccc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:04.147756 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d3ab3-1055-471f-bdd0-1e620fa6ccc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:04.149588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58d3ab3-1055-471f-bdd0-1e620fa6ccc9 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:04.177658 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 832/1659] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:04.185107 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d3ab3-1055-471f-bdd0-1e620fa6ccc9 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:04.199733 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58d3ab3-1055-471f-bdd0-1e620fa6ccc9 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:04.218718 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfc81c-a18b-4a3a-8f28-0844e41a3099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:04.222355 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfc81c-a18b-4a3a-8f28-0844e41a3099 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:04.225349 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfc81c-a18b-4a3a-8f28-0844e41a3099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:04.225349 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dfc81c-a18b-4a3a-8f28-0844e41a3099 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:04.225642 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dfc81c-a18b-4a3a-8f28-0844e41a3099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:04.239431 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dfc81c-a18b-4a3a-8f28-0844e41a3099 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:04.257517 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d019e-d2e5-44f8-9ee4-2aaad296393d admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:04.266807 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44f9186-703c-4e8d-bf1b-d916ce87c15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:04.272947 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f9186-703c-4e8d-bf1b-d916ce87c15b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:04.273249 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f9186-703c-4e8d-bf1b-d916ce87c15b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:04.273664 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44f9186-703c-4e8d-bf1b-d916ce87c15b admin admin] PATH_INFO: `/v3/users/cd780132a4d849e189508314be49daa3` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:04.278342 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f9186-703c-4e8d-bf1b-d916ce87c15b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd780132a4d849e189508314be49daa3)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:04.279859 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 833/1660] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:04 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:04.280325 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44f9186-703c-4e8d-bf1b-d916ce87c15b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:04.285062 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfc81c-a18b-4a3a-8f28-0844e41a3099 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:04.301705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:04.317176 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dfc81c-a18b-4a3a-8f28-0844e41a3099 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:04.338541 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f43fef3-a275-4aad-b204-616abb25cbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:04.339170 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43fef3-a275-4aad-b204-616abb25cbd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:04.339456 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43fef3-a275-4aad-b204-616abb25cbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:04.339736 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f43fef3-a275-4aad-b204-616abb25cbd8 admin admin] PATH_INFO: `/v3/projects/c53b5c4e5b5a4fcd993ed3cd5b219bb9/users/c05e1245dd4f4ca394bc57b4b4b0b241/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:04.388632 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43fef3-a275-4aad-b204-616abb25cbd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c53b5c4e5b5a4fcd993ed3cd5b219bb9, user_id=c05e1245dd4f4ca394bc57b4b4b0b241, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:04.390802 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f43fef3-a275-4aad-b204-616abb25cbd8 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:04.432893 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 834/1661] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:04 2022] PUT /identity/v3/projects/c53b5c4e5b5a4fcd993ed3cd5b219bb9/users/c05e1245dd4f4ca394bc57b4b4b0b241/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:25:04.433110 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a44f9186-703c-4e8d-bf1b-d916ce87c15b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd780132a4d849e189508314be49daa3'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:04.433110 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a44f9186-703c-4e8d-bf1b-d916ce87c15b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd780132a4d849e189508314be49daa3'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:04.435575 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac867358-8d51-4d79-9fc3-1e579dac15d0 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:04.435575 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac867358-8d51-4d79-9fc3-1e579dac15d0 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:04.435798 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac867358-8d51-4d79-9fc3-1e579dac15d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:04.458802 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a44f9186-703c-4e8d-bf1b-d916ce87c15b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd780132a4d849e189508314be49daa3'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:04.462875 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a44f9186-703c-4e8d-bf1b-d916ce87c15b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd780132a4d849e189508314be49daa3'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:04.517668 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a44f9186-703c-4e8d-bf1b-d916ce87c15b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd780132a4d849e189508314be49daa3'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:04.530546 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-ac867358-8d51-4d79-9fc3-1e579dac15d0 None None] MFA Rules not processed for user `c05e1245dd4f4ca394bc57b4b4b0b241`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:04.531793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ac867358-8d51-4d79-9fc3-1e579dac15d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:04.569819 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 828/1662] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:25:04 2022] DELETE /identity/v3/users/cd780132a4d849e189508314be49daa3 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:04.574877 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d908a-3d13-44b1-b51b-798172046f66 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:04.575435 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d908a-3d13-44b1-b51b-798172046f66 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:04.575719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d908a-3d13-44b1-b51b-798172046f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:04.639093 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-116d908a-3d13-44b1-b51b-798172046f66 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:04.639689 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-116d908a-3d13-44b1-b51b-798172046f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:04.710984 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 835/1663] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:25:04.712155 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac867358-8d51-4d79-9fc3-1e579dac15d0 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:04.716237 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ac867358-8d51-4d79-9fc3-1e579dac15d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:04.859817 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 829/1664] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:04.895053 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac867358-8d51-4d79-9fc3-1e579dac15d0 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:04.905251 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff1ec3-54ef-4453-8cdc-63cf316e1516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:04.905901 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff1ec3-54ef-4453-8cdc-63cf316e1516 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:04.906178 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff1ec3-54ef-4453-8cdc-63cf316e1516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:04.906754 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff1ec3-54ef-4453-8cdc-63cf316e1516 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:04.907117 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff1ec3-54ef-4453-8cdc-63cf316e1516 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:04.911629 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff1ec3-54ef-4453-8cdc-63cf316e1516 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:04.963718 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d908a-3d13-44b1-b51b-798172046f66 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:04.975811 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-116d908a-3d13-44b1-b51b-798172046f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:04.991795 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 836/1665] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:25:04 2022] POST /identity/v3/projects => generated 381 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:25:04.996409 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff1ec3-54ef-4453-8cdc-63cf316e1516 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:05.026446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:05.135232 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:05.142220 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d908a-3d13-44b1-b51b-798172046f66 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:05.144880 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff1ec3-54ef-4453-8cdc-63cf316e1516 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:05.154664 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68ebbc-0034-405f-8f9b-215ff494b558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:05.155756 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68ebbc-0034-405f-8f9b-215ff494b558 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:05.156091 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68ebbc-0034-405f-8f9b-215ff494b558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:05.156374 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68ebbc-0034-405f-8f9b-215ff494b558 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:05.157408 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68ebbc-0034-405f-8f9b-215ff494b558 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:05.159171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a68ebbc-0034-405f-8f9b-215ff494b558 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:05.197356 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 837/1666] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:25:04 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:05.202533 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68ebbc-0034-405f-8f9b-215ff494b558 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:05.210323 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389adf30-808a-430e-9c29-65d1a6634add service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:05.211303 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389adf30-808a-430e-9c29-65d1a6634add service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:05.211808 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389adf30-808a-430e-9c29-65d1a6634add service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:05.212450 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389adf30-808a-430e-9c29-65d1a6634add service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:05.218903 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-7a68ebbc-0034-405f-8f9b-215ff494b558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:05.226658 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389adf30-808a-430e-9c29-65d1a6634add service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:05.228564 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389adf30-808a-430e-9c29-65d1a6634add service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:05.243057 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 830/1667] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:05.245093 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389adf30-808a-430e-9c29-65d1a6634add service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:05.254866 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68ebbc-0034-405f-8f9b-215ff494b558 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:05.263738 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389adf30-808a-430e-9c29-65d1a6634add service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:05.269556 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfdc83f-9d53-452c-ba20-c019bfe3ac9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:05.270231 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdc83f-9d53-452c-ba20-c019bfe3ac9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:05.270514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdc83f-9d53-452c-ba20-c019bfe3ac9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:05.270789 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfdc83f-9d53-452c-ba20-c019bfe3ac9b admin admin] PATH_INFO: `/v3/users/98a86c51649e4b2daad002da656de7ec` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:05.272016 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e376e1-7fac-4695-aadf-5046da345a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:05.272865 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e376e1-7fac-4695-aadf-5046da345a63 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:05.273378 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e376e1-7fac-4695-aadf-5046da345a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:05.273859 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfdc83f-9d53-452c-ba20-c019bfe3ac9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=98a86c51649e4b2daad002da656de7ec)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:05.274120 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e376e1-7fac-4695-aadf-5046da345a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:05.274990 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e376e1-7fac-4695-aadf-5046da345a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:05.275786 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfdc83f-9d53-452c-ba20-c019bfe3ac9b admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:05.278310 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e376e1-7fac-4695-aadf-5046da345a63 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:05.294025 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 831/1668] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:05.299383 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e376e1-7fac-4695-aadf-5046da345a63 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:05.326375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e376e1-7fac-4695-aadf-5046da345a63 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:05.339187 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d3a3f-9cf7-459a-905f-6d9228ff74e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:05.340762 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d3a3f-9cf7-459a-905f-6d9228ff74e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:05.341559 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d3a3f-9cf7-459a-905f-6d9228ff74e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:05.344100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886d3a3f-9cf7-459a-905f-6d9228ff74e1 admin admin] PATH_INFO: `/v3/projects/53509d9b868b4729b88da9eab37bf513/users/a1b0eb9d5b4142999a377a01be9798f4/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:05.381942 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d3a3f-9cf7-459a-905f-6d9228ff74e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53509d9b868b4729b88da9eab37bf513, user_id=a1b0eb9d5b4142999a377a01be9798f4, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:05.384020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-cbfdc83f-9d53-452c-ba20-c019bfe3ac9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98a86c51649e4b2daad002da656de7ec'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:05.385953 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-cbfdc83f-9d53-452c-ba20-c019bfe3ac9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98a86c51649e4b2daad002da656de7ec'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:05.386652 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886d3a3f-9cf7-459a-905f-6d9228ff74e1 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:05.413696 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-cbfdc83f-9d53-452c-ba20-c019bfe3ac9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98a86c51649e4b2daad002da656de7ec'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:05.414752 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 832/1669] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:05 2022] PUT /identity/v3/projects/53509d9b868b4729b88da9eab37bf513/users/a1b0eb9d5b4142999a377a01be9798f4/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:05.419661 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d3a3f-9cf7-459a-905f-6d9228ff74e1 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:05.446332 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-cbfdc83f-9d53-452c-ba20-c019bfe3ac9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98a86c51649e4b2daad002da656de7ec'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:05.476764 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-cbfdc83f-9d53-452c-ba20-c019bfe3ac9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98a86c51649e4b2daad002da656de7ec'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:05.495416 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 838/1670] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:25:05 2022] DELETE /identity/v3/users/98a86c51649e4b2daad002da656de7ec => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:05.500160 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfdc83f-9d53-452c-ba20-c019bfe3ac9b admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:05.503766 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-cbfdc83f-9d53-452c-ba20-c019bfe3ac9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:05.601733 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886d3a3f-9cf7-459a-905f-6d9228ff74e1 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:05.689118 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfdc83f-9d53-452c-ba20-c019bfe3ac9b admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:05.707240 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:05.710097 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b9627-d0a1-4b37-a091-68f6202ca3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:05.710922 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b9627-d0a1-4b37-a091-68f6202ca3e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:05.711308 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b9627-d0a1-4b37-a091-68f6202ca3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:05.712400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b9627-d0a1-4b37-a091-68f6202ca3e8 admin admin] PATH_INFO: `/v3/projects/abd4f3bdfc0747a7bb9f14b6d9617746` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:05.722576 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b9627-d0a1-4b37-a091-68f6202ca3e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abd4f3bdfc0747a7bb9f14b6d9617746)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:05.725309 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b9627-d0a1-4b37-a091-68f6202ca3e8 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:05.748297 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6fc319-714c-4c04-b9af-73d130100759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:05.748950 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fc319-714c-4c04-b9af-73d130100759 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:05.749235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fc319-714c-4c04-b9af-73d130100759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:05.749505 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fc319-714c-4c04-b9af-73d130100759 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:05.750213 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6fc319-714c-4c04-b9af-73d130100759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:05.751836 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6fc319-714c-4c04-b9af-73d130100759 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:05.790869 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 833/1671] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:05 2022] GET /identity/v3/roles => generated 1420 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:05.792687 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca1ef3-7350-4b27-b7f7-186019c3f550 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:05.792863 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca1ef3-7350-4b27-b7f7-186019c3f550 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:05.793682 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca1ef3-7350-4b27-b7f7-186019c3f550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:05.850272 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a2ca1ef3-7350-4b27-b7f7-186019c3f550 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:05.851847 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a2ca1ef3-7350-4b27-b7f7-186019c3f550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:05.900633 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-9d9b9627-d0a1-4b37-a091-68f6202ca3e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abd4f3bdfc0747a7bb9f14b6d9617746', 'request_id': 'req-9d9b9627-d0a1-4b37-a091-68f6202ca3e8'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:05.921008 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-9d9b9627-d0a1-4b37-a091-68f6202ca3e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abd4f3bdfc0747a7bb9f14b6d9617746', 'request_id': 'req-9d9b9627-d0a1-4b37-a091-68f6202ca3e8'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:05.938105 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=81,keystone:INSERT=4,keystone:DELETE=15 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:05.942689 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-9d9b9627-d0a1-4b37-a091-68f6202ca3e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abd4f3bdfc0747a7bb9f14b6d9617746', 'request_id': 'req-9d9b9627-d0a1-4b37-a091-68f6202ca3e8'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:05.972770 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-9d9b9627-d0a1-4b37-a091-68f6202ca3e8 admin admin] The token cache is being invalidate because project abd4f3bdfc0747a7bb9f14b6d9617746 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:25:05.973069 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-9d9b9627-d0a1-4b37-a091-68f6202ca3e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:05.975640 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-9d9b9627-d0a1-4b37-a091-68f6202ca3e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:05.978784 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 839/1672] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:25:05 2022] DELETE /identity/v3/projects/abd4f3bdfc0747a7bb9f14b6d9617746 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:05.981279 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b9627-d0a1-4b37-a091-68f6202ca3e8 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:05.986747 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9d9b9627-d0a1-4b37-a091-68f6202ca3e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:06.033525 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 834/1673] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:06.034839 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f79984-7056-4d9d-ab88-b31a0bf94e8e None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:06.035133 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f79984-7056-4d9d-ab88-b31a0bf94e8e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:06.035407 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f79984-7056-4d9d-ab88-b31a0bf94e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:06.073174 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d7f79984-7056-4d9d-ab88-b31a0bf94e8e None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:06.074473 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d7f79984-7056-4d9d-ab88-b31a0bf94e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:06.116044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 835/1674] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:06.117673 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79429a0-561a-4c9f-8a9e-5c70acc38196 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:06.117874 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79429a0-561a-4c9f-8a9e-5c70acc38196 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:06.118189 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79429a0-561a-4c9f-8a9e-5c70acc38196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:06.181590 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f79429a0-561a-4c9f-8a9e-5c70acc38196 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:06.182703 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f79429a0-561a-4c9f-8a9e-5c70acc38196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:06.191339 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b9627-d0a1-4b37-a091-68f6202ca3e8 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:06.199814 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226a160-9b71-407a-b909-07e99f1a2ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:06.200553 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226a160-9b71-407a-b909-07e99f1a2ba8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:06.200838 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226a160-9b71-407a-b909-07e99f1a2ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:06.201162 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226a160-9b71-407a-b909-07e99f1a2ba8 admin admin] PATH_INFO: `/v3/projects/53509d9b868b4729b88da9eab37bf513/users/a1b0eb9d5b4142999a377a01be9798f4/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:06.205153 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226a160-9b71-407a-b909-07e99f1a2ba8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53509d9b868b4729b88da9eab37bf513, user_id=a1b0eb9d5b4142999a377a01be9798f4, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:06.210376 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 836/1675] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:06.214915 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79429a0-561a-4c9f-8a9e-5c70acc38196 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:06.216566 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f79429a0-561a-4c9f-8a9e-5c70acc38196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:06.216951 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226a160-9b71-407a-b909-07e99f1a2ba8 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:06.259917 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 840/1676] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:05 2022] PUT /identity/v3/projects/53509d9b868b4729b88da9eab37bf513/users/a1b0eb9d5b4142999a377a01be9798f4/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:06.261329 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226a160-9b71-407a-b909-07e99f1a2ba8 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:06.362015 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79429a0-561a-4c9f-8a9e-5c70acc38196 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:06.409173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226a160-9b71-407a-b909-07e99f1a2ba8 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:06.430507 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358762e5-67af-4678-ad4e-f4bbc351cd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:06.431425 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358762e5-67af-4678-ad4e-f4bbc351cd2d admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:06.431888 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358762e5-67af-4678-ad4e-f4bbc351cd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:06.432391 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358762e5-67af-4678-ad4e-f4bbc351cd2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:06.433476 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358762e5-67af-4678-ad4e-f4bbc351cd2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:25:06.434108 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358762e5-67af-4678-ad4e-f4bbc351cd2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:06.435803 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358762e5-67af-4678-ad4e-f4bbc351cd2d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:06.466057 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 841/1677] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:25:06.467376 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028aae0-c6f3-49ea-9680-db5c75d12167 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:06.467672 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028aae0-c6f3-49ea-9680-db5c75d12167 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:06.467957 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6028aae0-c6f3-49ea-9680-db5c75d12167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:06.480247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0aed4c-f0ad-41b2-ab1e-2f85d4e43843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:06.480948 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0aed4c-f0ad-41b2-ab1e-2f85d4e43843 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:06.481234 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0aed4c-f0ad-41b2-ab1e-2f85d4e43843 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:06.481886 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0aed4c-f0ad-41b2-ab1e-2f85d4e43843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:06.501179 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0aed4c-f0ad-41b2-ab1e-2f85d4e43843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:06.502654 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0aed4c-f0ad-41b2-ab1e-2f85d4e43843 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:06.527039 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 837/1678] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:06.528512 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0aed4c-f0ad-41b2-ab1e-2f85d4e43843 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:06.531004 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-6028aae0-c6f3-49ea-9680-db5c75d12167 None None] MFA Rules not processed for user `a1b0eb9d5b4142999a377a01be9798f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:06.532291 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6028aae0-c6f3-49ea-9680-db5c75d12167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:06.546166 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0aed4c-f0ad-41b2-ab1e-2f85d4e43843 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:06.566442 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e711410-ac08-4748-bd0b-e62fcbb1c11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:06.567055 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e711410-ac08-4748-bd0b-e62fcbb1c11b admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:06.567335 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e711410-ac08-4748-bd0b-e62fcbb1c11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:06.567605 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e711410-ac08-4748-bd0b-e62fcbb1c11b admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:06.568310 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e711410-ac08-4748-bd0b-e62fcbb1c11b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:06.570230 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e711410-ac08-4748-bd0b-e62fcbb1c11b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:06.641664 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 838/1679] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:25:06 2022] POST /identity/v3/projects => generated 369 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:06.642759 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e711410-ac08-4748-bd0b-e62fcbb1c11b admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:06.662788 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:06.701426 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:06.715685 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 842/1680] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:06 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:06.724563 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028aae0-c6f3-49ea-9680-db5c75d12167 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:06.726294 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6028aae0-c6f3-49ea-9680-db5c75d12167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:06.778910 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e711410-ac08-4748-bd0b-e62fcbb1c11b admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:06.787582 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba3bd2-b3be-444f-8472-cbd441813f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:06.788444 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba3bd2-b3be-444f-8472-cbd441813f2f admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:06.788729 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba3bd2-b3be-444f-8472-cbd441813f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:06.789007 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba3bd2-b3be-444f-8472-cbd441813f2f admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:06.789779 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba3bd2-b3be-444f-8472-cbd441813f2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:06.791856 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba3bd2-b3be-444f-8472-cbd441813f2f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:06.841867 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 839/1681] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:25:06 2022] POST /identity/v3/users => generated 285 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:06.843049 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba3bd2-b3be-444f-8472-cbd441813f2f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:06.859616 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba3bd2-b3be-444f-8472-cbd441813f2f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:06.872820 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6028aae0-c6f3-49ea-9680-db5c75d12167 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:06.879841 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e600b-6991-4649-9741-00484e918afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:06.880839 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e600b-6991-4649-9741-00484e918afc admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:06.881139 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e600b-6991-4649-9741-00484e918afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:06.881430 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e600b-6991-4649-9741-00484e918afc admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:06.882164 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e600b-6991-4649-9741-00484e918afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:06.884326 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e600b-6991-4649-9741-00484e918afc admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:06.911221 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 840/1682] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:06.915130 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e600b-6991-4649-9741-00484e918afc admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:06.937353 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e600b-6991-4649-9741-00484e918afc admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:06.952053 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3872948a-a62f-4adc-a7ef-c71e075f4989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:06.953129 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872948a-a62f-4adc-a7ef-c71e075f4989 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:06.953129 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872948a-a62f-4adc-a7ef-c71e075f4989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:06.953851 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3872948a-a62f-4adc-a7ef-c71e075f4989 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:06.953930 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3872948a-a62f-4adc-a7ef-c71e075f4989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:06.955497 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3872948a-a62f-4adc-a7ef-c71e075f4989 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:06.974015 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5a376-8a28-41a4-b8d1-dd443b796161 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:06.975260 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5a376-8a28-41a4-b8d1-dd443b796161 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:06.976076 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5a376-8a28-41a4-b8d1-dd443b796161 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:06.976545 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5a376-8a28-41a4-b8d1-dd443b796161 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:06.980024 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 841/1683] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:06.981500 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3872948a-a62f-4adc-a7ef-c71e075f4989 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:07.002005 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3872948a-a62f-4adc-a7ef-c71e075f4989 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:07.017993 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda0f73-9241-4e92-9a26-3b8dcad817a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:07.018729 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda0f73-9241-4e92-9a26-3b8dcad817a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:07.019020 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda0f73-9241-4e92-9a26-3b8dcad817a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:07.019304 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda0f73-9241-4e92-9a26-3b8dcad817a4 admin admin] PATH_INFO: `/v3/projects/f208e7361b1d401c97ae637364b28038/users/7f9411e07c804aa08e440dc56e742515/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:07.053979 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda0f73-9241-4e92-9a26-3b8dcad817a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f208e7361b1d401c97ae637364b28038, user_id=7f9411e07c804aa08e440dc56e742515, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:07.056726 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda0f73-9241-4e92-9a26-3b8dcad817a4 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:07.083586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 842/1684] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:06 2022] PUT /identity/v3/projects/f208e7361b1d401c97ae637364b28038/users/7f9411e07c804aa08e440dc56e742515/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:25:07.093100 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5a376-8a28-41a4-b8d1-dd443b796161 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:07.095354 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5a376-8a28-41a4-b8d1-dd443b796161 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:07.096361 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781f957-bf65-438b-9e24-c096772a843f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:07.097051 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781f957-bf65-438b-9e24-c096772a843f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:07.097051 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781f957-bf65-438b-9e24-c096772a843f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:07.113340 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 843/1685] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:06 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:07.124999 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5a376-8a28-41a4-b8d1-dd443b796161 service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:07.130073 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-51d5a376-8a28-41a4-b8d1-dd443b796161 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:07.165405 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-c781f957-bf65-438b-9e24-c096772a843f None None] MFA Rules not processed for user `7f9411e07c804aa08e440dc56e742515`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:07.166734 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5a376-8a28-41a4-b8d1-dd443b796161 service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:07.167051 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c781f957-bf65-438b-9e24-c096772a843f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:07.244971 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c5bc02-b26c-4d8d-9760-8c167aa416fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:07.246971 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5bc02-b26c-4d8d-9760-8c167aa416fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:07.247588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5bc02-b26c-4d8d-9760-8c167aa416fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:07.248092 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c5bc02-b26c-4d8d-9760-8c167aa416fc admin admin] PATH_INFO: `/v3/projects/d3a1bf94357a4eaea3b9cd0f4c2654ed` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:07.255209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c5bc02-b26c-4d8d-9760-8c167aa416fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3a1bf94357a4eaea3b9cd0f4c2654ed)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:07.255209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c5bc02-b26c-4d8d-9760-8c167aa416fc admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:07.270775 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:07.307063 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 843/1686] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:07 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:07.308051 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c781f957-bf65-438b-9e24-c096772a843f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:07.383611 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-c3c5bc02-b26c-4d8d-9760-8c167aa416fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3a1bf94357a4eaea3b9cd0f4c2654ed', 'request_id': 'req-c3c5bc02-b26c-4d8d-9760-8c167aa416fc'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:07.392842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-c3c5bc02-b26c-4d8d-9760-8c167aa416fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3a1bf94357a4eaea3b9cd0f4c2654ed', 'request_id': 'req-c3c5bc02-b26c-4d8d-9760-8c167aa416fc'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:07.413705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-c3c5bc02-b26c-4d8d-9760-8c167aa416fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3a1bf94357a4eaea3b9cd0f4c2654ed', 'request_id': 'req-c3c5bc02-b26c-4d8d-9760-8c167aa416fc'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:07.424128 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:07.443157 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c781f957-bf65-438b-9e24-c096772a843f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:07.448727 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-c3c5bc02-b26c-4d8d-9760-8c167aa416fc admin admin] The token cache is being invalidate because project d3a1bf94357a4eaea3b9cd0f4c2654ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:25:07.452277 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-c3c5bc02-b26c-4d8d-9760-8c167aa416fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:07.455585 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-c3c5bc02-b26c-4d8d-9760-8c167aa416fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:07.459775 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 844/1687] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:25:07 2022] DELETE /identity/v3/projects/d3a1bf94357a4eaea3b9cd0f4c2654ed => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:07.460977 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c5bc02-b26c-4d8d-9760-8c167aa416fc admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:07.467287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-c3c5bc02-b26c-4d8d-9760-8c167aa416fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:07.548239 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aec4be-30c9-49eb-955a-e57458836b94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:07.551611 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aec4be-30c9-49eb-955a-e57458836b94 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:07.552416 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aec4be-30c9-49eb-955a-e57458836b94 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:07.552697 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aec4be-30c9-49eb-955a-e57458836b94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:07.559066 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f5aec4be-30c9-49eb-955a-e57458836b94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:07.642498 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c5bc02-b26c-4d8d-9760-8c167aa416fc admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:07.659083 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb7bc2-3aaa-4209-a173-9875d23fb880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:07.660516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb7bc2-3aaa-4209-a173-9875d23fb880 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:07.660906 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb7bc2-3aaa-4209-a173-9875d23fb880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:07.661287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafb7bc2-3aaa-4209-a173-9875d23fb880 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:07.672430 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafb7bc2-3aaa-4209-a173-9875d23fb880 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:07.674673 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafb7bc2-3aaa-4209-a173-9875d23fb880 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:07.716249 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aec4be-30c9-49eb-955a-e57458836b94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:07.717656 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aec4be-30c9-49eb-955a-e57458836b94 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:07.739451 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 844/1688] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:07 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:07.740489 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aec4be-30c9-49eb-955a-e57458836b94 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:07.745223 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f5aec4be-30c9-49eb-955a-e57458836b94 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:07.758160 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 845/1689] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:25:07 2022] POST /identity/v3/projects => generated 369 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:07.762413 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb7bc2-3aaa-4209-a173-9875d23fb880 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:07.785358 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aec4be-30c9-49eb-955a-e57458836b94 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:07.911833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fb847-2c45-4652-afda-2a05dc173c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:07.912533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fb847-2c45-4652-afda-2a05dc173c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:07.912807 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fb847-2c45-4652-afda-2a05dc173c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:07.913090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fb847-2c45-4652-afda-2a05dc173c25 admin admin] PATH_INFO: `/v3/users/14966e53f64b46fc87fa2a647c848132` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:07.919491 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fb847-2c45-4652-afda-2a05dc173c25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14966e53f64b46fc87fa2a647c848132)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:07.921783 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fb847-2c45-4652-afda-2a05dc173c25 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:07.934471 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafb7bc2-3aaa-4209-a173-9875d23fb880 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:07.944051 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd41598-a519-4fec-8e70-5e5cdc82ea1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:07.944948 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd41598-a519-4fec-8e70-5e5cdc82ea1b admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:07.945333 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd41598-a519-4fec-8e70-5e5cdc82ea1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:07.945707 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd41598-a519-4fec-8e70-5e5cdc82ea1b admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:07.946499 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd41598-a519-4fec-8e70-5e5cdc82ea1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:07.949836 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd41598-a519-4fec-8e70-5e5cdc82ea1b admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:07.994536 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 846/1690] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:25:07 2022] POST /identity/v3/users => generated 291 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:25:07.996160 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd41598-a519-4fec-8e70-5e5cdc82ea1b admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:08.017684 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-491fb847-2c45-4652-afda-2a05dc173c25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14966e53f64b46fc87fa2a647c848132'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:08.018827 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-491fb847-2c45-4652-afda-2a05dc173c25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14966e53f64b46fc87fa2a647c848132'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:08.025325 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd41598-a519-4fec-8e70-5e5cdc82ea1b admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:08.026861 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:08.047297 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b70d93-cb07-41d3-9f72-0ddaaf004271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:08.048130 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b70d93-cb07-41d3-9f72-0ddaaf004271 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:08.049108 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b70d93-cb07-41d3-9f72-0ddaaf004271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:08.052970 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b70d93-cb07-41d3-9f72-0ddaaf004271 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:08.055464 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b70d93-cb07-41d3-9f72-0ddaaf004271 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:08.056012 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-491fb847-2c45-4652-afda-2a05dc173c25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14966e53f64b46fc87fa2a647c848132'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:08.057220 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-491fb847-2c45-4652-afda-2a05dc173c25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14966e53f64b46fc87fa2a647c848132'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:08.059832 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b70d93-cb07-41d3-9f72-0ddaaf004271 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:08.077600 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:08.106847 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-491fb847-2c45-4652-afda-2a05dc173c25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14966e53f64b46fc87fa2a647c848132'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:08.112821 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 847/1691] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:08.115322 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b70d93-cb07-41d3-9f72-0ddaaf004271 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:08.120764 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a1b70d93-cb07-41d3-9f72-0ddaaf004271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:08.144970 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 845/1692] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:25:07 2022] DELETE /identity/v3/users/14966e53f64b46fc87fa2a647c848132 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:08.158571 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b70d93-cb07-41d3-9f72-0ddaaf004271 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:08.323648 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1dd4bb-2862-4d6e-8aa3-37317d1ab3cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:08.325307 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1dd4bb-2862-4d6e-8aa3-37317d1ab3cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:08.325655 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1dd4bb-2862-4d6e-8aa3-37317d1ab3cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:08.326003 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1dd4bb-2862-4d6e-8aa3-37317d1ab3cf admin admin] PATH_INFO: `/v3/projects/a210f0e1c8e642ceb5b5b1ea4131c5be/users/c242b2ecc6d1499cb6bf952e4ec8ebdc/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:08.357090 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1dd4bb-2862-4d6e-8aa3-37317d1ab3cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a210f0e1c8e642ceb5b5b1ea4131c5be, user_id=c242b2ecc6d1499cb6bf952e4ec8ebdc, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:08.365935 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1dd4bb-2862-4d6e-8aa3-37317d1ab3cf admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:08.399880 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 848/1693] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:08 2022] PUT /identity/v3/projects/a210f0e1c8e642ceb5b5b1ea4131c5be/users/c242b2ecc6d1499cb6bf952e4ec8ebdc/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:08.401680 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fb847-2c45-4652-afda-2a05dc173c25 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:08.424477 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fb847-2c45-4652-afda-2a05dc173c25 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:08.519828 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec96a9-bd0e-49d1-978b-f7975d6a0202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:08.520839 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec96a9-bd0e-49d1-978b-f7975d6a0202 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:08.521300 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec96a9-bd0e-49d1-978b-f7975d6a0202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:08.521898 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec96a9-bd0e-49d1-978b-f7975d6a0202 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:08.523010 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec96a9-bd0e-49d1-978b-f7975d6a0202 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:08.525011 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec96a9-bd0e-49d1-978b-f7975d6a0202 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:08.538048 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 846/1694] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:08.544700 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1dd4bb-2862-4d6e-8aa3-37317d1ab3cf admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:08.561097 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1dd4bb-2862-4d6e-8aa3-37317d1ab3cf admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:08.568774 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075dd5b4-49ef-49a1-9236-134f6686cdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:08.569910 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075dd5b4-49ef-49a1-9236-134f6686cdcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:08.570414 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075dd5b4-49ef-49a1-9236-134f6686cdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:08.570933 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075dd5b4-49ef-49a1-9236-134f6686cdcf admin admin] PATH_INFO: `/v3/projects/a210f0e1c8e642ceb5b5b1ea4131c5be/users/c242b2ecc6d1499cb6bf952e4ec8ebdc/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:08.573715 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075dd5b4-49ef-49a1-9236-134f6686cdcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a210f0e1c8e642ceb5b5b1ea4131c5be, user_id=c242b2ecc6d1499cb6bf952e4ec8ebdc, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:08.577729 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075dd5b4-49ef-49a1-9236-134f6686cdcf admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:08.606730 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 849/1695] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:08 2022] PUT /identity/v3/projects/a210f0e1c8e642ceb5b5b1ea4131c5be/users/c242b2ecc6d1499cb6bf952e4ec8ebdc/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:08.610649 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6d51b-1287-4888-ba0d-5c4872f8933c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:08.611020 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6d51b-1287-4888-ba0d-5c4872f8933c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:08.611377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc6d51b-1287-4888-ba0d-5c4872f8933c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:08.654846 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-cbc6d51b-1287-4888-ba0d-5c4872f8933c None None] MFA Rules not processed for user `c242b2ecc6d1499cb6bf952e4ec8ebdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:08.656378 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-cbc6d51b-1287-4888-ba0d-5c4872f8933c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:08.661503 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075dd5b4-49ef-49a1-9236-134f6686cdcf admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:08.663335 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-075dd5b4-49ef-49a1-9236-134f6686cdcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:08.772481 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075dd5b4-49ef-49a1-9236-134f6686cdcf admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:08.777923 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306f23e-079d-47fa-8207-d9b8edb1357d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:08.778660 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306f23e-079d-47fa-8207-d9b8edb1357d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:08.779011 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306f23e-079d-47fa-8207-d9b8edb1357d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:08.779376 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306f23e-079d-47fa-8207-d9b8edb1357d admin admin] PATH_INFO: `/v3/projects/99d0aef0ce5f4773b94af6cb8b231893` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:08.780810 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 847/1696] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:08 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:08.781306 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306f23e-079d-47fa-8207-d9b8edb1357d admin admin] RBAC: Authorizing `identity:delete_project(project_id=99d0aef0ce5f4773b94af6cb8b231893)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:08.783449 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1306f23e-079d-47fa-8207-d9b8edb1357d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:08.793817 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6d51b-1287-4888-ba0d-5c4872f8933c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:08.796762 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-cbc6d51b-1287-4888-ba0d-5c4872f8933c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:08.899452 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1306f23e-079d-47fa-8207-d9b8edb1357d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99d0aef0ce5f4773b94af6cb8b231893', 'request_id': 'req-1306f23e-079d-47fa-8207-d9b8edb1357d'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:08.913973 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1306f23e-079d-47fa-8207-d9b8edb1357d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99d0aef0ce5f4773b94af6cb8b231893', 'request_id': 'req-1306f23e-079d-47fa-8207-d9b8edb1357d'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:08.931650 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc6d51b-1287-4888-ba0d-5c4872f8933c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:08.934984 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1306f23e-079d-47fa-8207-d9b8edb1357d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99d0aef0ce5f4773b94af6cb8b231893', 'request_id': 'req-1306f23e-079d-47fa-8207-d9b8edb1357d'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:08.944071 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:08.952767 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:08.959964 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1306f23e-079d-47fa-8207-d9b8edb1357d admin admin] The token cache is being invalidate because project 99d0aef0ce5f4773b94af6cb8b231893 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:25:08.961173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1306f23e-079d-47fa-8207-d9b8edb1357d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:08.963129 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1306f23e-079d-47fa-8207-d9b8edb1357d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:08.973315 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 850/1697] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:25:08 2022] DELETE /identity/v3/projects/99d0aef0ce5f4773b94af6cb8b231893 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:25:08.974948 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290af8b-4c1f-495b-8406-7959ec4ef342 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:08.975345 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290af8b-4c1f-495b-8406-7959ec4ef342 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:08.975905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1290af8b-4c1f-495b-8406-7959ec4ef342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:09.000747 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-1290af8b-4c1f-495b-8406-7959ec4ef342 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:09.002257 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-1290af8b-4c1f-495b-8406-7959ec4ef342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:09.076508 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469f6a5-2c79-4755-bbd7-a021a0b26daa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:09.077156 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469f6a5-2c79-4755-bbd7-a021a0b26daa service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:09.077437 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469f6a5-2c79-4755-bbd7-a021a0b26daa service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:09.077711 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469f6a5-2c79-4755-bbd7-a021a0b26daa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:09.082793 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7469f6a5-2c79-4755-bbd7-a021a0b26daa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:09.151529 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 851/1698] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:09.151529 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c90292-8c54-4eb2-91a4-02e483a8853d None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:09.151765 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c90292-8c54-4eb2-91a4-02e483a8853d None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:09.151873 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c90292-8c54-4eb2-91a4-02e483a8853d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:09.209477 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-e3c90292-8c54-4eb2-91a4-02e483a8853d None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:09.211139 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e3c90292-8c54-4eb2-91a4-02e483a8853d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:09.222909 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 852/1699] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:09.227264 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c90292-8c54-4eb2-91a4-02e483a8853d None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:09.256903 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c90292-8c54-4eb2-91a4-02e483a8853d None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:09.269240 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1fea86-0c11-483d-8bc0-981757c28931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:09.270377 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fea86-0c11-483d-8bc0-981757c28931 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:09.270948 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fea86-0c11-483d-8bc0-981757c28931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:09.271554 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fea86-0c11-483d-8bc0-981757c28931 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:09.272727 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1fea86-0c11-483d-8bc0-981757c28931 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:25:09.278162 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1fea86-0c11-483d-8bc0-981757c28931 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:09.280739 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1fea86-0c11-483d-8bc0-981757c28931 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:09.296913 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469f6a5-2c79-4755-bbd7-a021a0b26daa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:09.302856 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469f6a5-2c79-4755-bbd7-a021a0b26daa service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:09.310475 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 853/1700] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:25:09.311683 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1fea86-0c11-483d-8bc0-981757c28931 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:09.330053 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1fea86-0c11-483d-8bc0-981757c28931 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:09.339102 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac477678-d121-4b51-b7ba-b291727f120e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:09.339842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac477678-d121-4b51-b7ba-b291727f120e admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:09.340289 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac477678-d121-4b51-b7ba-b291727f120e admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:09.340659 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac477678-d121-4b51-b7ba-b291727f120e admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:09.341600 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac477678-d121-4b51-b7ba-b291727f120e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:09.342689 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 848/1701] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:08 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:09.344410 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac477678-d121-4b51-b7ba-b291727f120e admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:09.442718 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469f6a5-2c79-4755-bbd7-a021a0b26daa service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:09.444358 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7469f6a5-2c79-4755-bbd7-a021a0b26daa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:09.461536 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469f6a5-2c79-4755-bbd7-a021a0b26daa service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:09.479118 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 854/1702] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:25:09 2022] POST /identity/v3/projects => generated 371 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:09.486712 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac477678-d121-4b51-b7ba-b291727f120e admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:09.604890 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aca3e4-41c5-437c-a279-2c8cab911e28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:09.605578 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aca3e4-41c5-437c-a279-2c8cab911e28 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:09.605869 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aca3e4-41c5-437c-a279-2c8cab911e28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:09.606209 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aca3e4-41c5-437c-a279-2c8cab911e28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:09.608147 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a1aca3e4-41c5-437c-a279-2c8cab911e28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:09.690481 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac477678-d121-4b51-b7ba-b291727f120e admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:09.699799 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c123f-55fa-4ebf-a7f8-22f01309f76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:09.700551 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c123f-55fa-4ebf-a7f8-22f01309f76a admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:09.700843 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c123f-55fa-4ebf-a7f8-22f01309f76a admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:09.701119 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07c123f-55fa-4ebf-a7f8-22f01309f76a admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:09.701864 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c123f-55fa-4ebf-a7f8-22f01309f76a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:09.704047 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07c123f-55fa-4ebf-a7f8-22f01309f76a admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:09.753156 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aca3e4-41c5-437c-a279-2c8cab911e28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:09.754763 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1aca3e4-41c5-437c-a279-2c8cab911e28 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:09.755599 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 855/1703] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:25:09 2022] POST /identity/v3/users => generated 286 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:09.759852 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c123f-55fa-4ebf-a7f8-22f01309f76a admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:09.783662 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07c123f-55fa-4ebf-a7f8-22f01309f76a admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:09.785508 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 849/1704] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:09 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 15:25:09.793701 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1cf42-15ac-488f-86fe-2282fa576da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:09.794359 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1cf42-15ac-488f-86fe-2282fa576da1 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:09.794577 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1cf42-15ac-488f-86fe-2282fa576da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:09.794856 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1cf42-15ac-488f-86fe-2282fa576da1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:09.795571 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b1cf42-15ac-488f-86fe-2282fa576da1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:09.797319 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b1cf42-15ac-488f-86fe-2282fa576da1 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:09.826392 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 856/1705] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 15:25:09.828149 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aca3e4-41c5-437c-a279-2c8cab911e28 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:09.848071 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aca3e4-41c5-437c-a279-2c8cab911e28 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:09.868373 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c98058-5c47-4237-957b-c4b045e2842f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:09.869805 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c98058-5c47-4237-957b-c4b045e2842f admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:09.870101 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c98058-5c47-4237-957b-c4b045e2842f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:09.870380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c98058-5c47-4237-957b-c4b045e2842f admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:09.874789 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c98058-5c47-4237-957b-c4b045e2842f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:09.876640 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c98058-5c47-4237-957b-c4b045e2842f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:09.898562 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:09.930940 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1cf42-15ac-488f-86fe-2282fa576da1 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:09.954553 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 850/1706] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 15:25:09.963625 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1cf42-15ac-488f-86fe-2282fa576da1 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:09.970324 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c98058-5c47-4237-957b-c4b045e2842f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:09.972829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-37c98058-5c47-4237-957b-c4b045e2842f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:09.993623 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c776b71e-a849-4940-8d81-654eeb3b0007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:09.994332 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776b71e-a849-4940-8d81-654eeb3b0007 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:09.994620 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776b71e-a849-4940-8d81-654eeb3b0007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:09.999517 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c776b71e-a849-4940-8d81-654eeb3b0007 admin admin] PATH_INFO: `/v3/projects/05a81aff270b431b9972a3997a850a45/users/add38343a4604fab8b0e40bbe8e01e60/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:10.037093 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c98058-5c47-4237-957b-c4b045e2842f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:10.052576 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346b62d-8dd9-4e4f-afc0-869787114911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:10.054401 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346b62d-8dd9-4e4f-afc0-869787114911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:10.056611 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346b62d-8dd9-4e4f-afc0-869787114911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:10.057395 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346b62d-8dd9-4e4f-afc0-869787114911 admin admin] PATH_INFO: `/v3/projects/a6f3bce2e90f49a5af48ee7934e0ea79` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:10.062361 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346b62d-8dd9-4e4f-afc0-869787114911 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6f3bce2e90f49a5af48ee7934e0ea79)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:10.068203 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c776b71e-a849-4940-8d81-654eeb3b0007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05a81aff270b431b9972a3997a850a45, user_id=add38343a4604fab8b0e40bbe8e01e60, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:10.070584 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2346b62d-8dd9-4e4f-afc0-869787114911 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:10.075201 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c776b71e-a849-4940-8d81-654eeb3b0007 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:10.127326 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 857/1707] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:09 2022] PUT /identity/v3/projects/05a81aff270b431b9972a3997a850a45/users/add38343a4604fab8b0e40bbe8e01e60/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:10.131834 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d2b7a-a759-41b0-9abe-f279f26bf643 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:10.132147 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d2b7a-a759-41b0-9abe-f279f26bf643 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:10.132429 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d2b7a-a759-41b0-9abe-f279f26bf643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:10.249960 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:10.256706 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-488d2b7a-a759-41b0-9abe-f279f26bf643 None None] MFA Rules not processed for user `b875adcba700459b99ce0d0d5ec9a9d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:10.264533 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-488d2b7a-a759-41b0-9abe-f279f26bf643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:10.278191 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2346b62d-8dd9-4e4f-afc0-869787114911 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6f3bce2e90f49a5af48ee7934e0ea79', 'request_id': 'req-2346b62d-8dd9-4e4f-afc0-869787114911'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:10.307562 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2346b62d-8dd9-4e4f-afc0-869787114911 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6f3bce2e90f49a5af48ee7934e0ea79', 'request_id': 'req-2346b62d-8dd9-4e4f-afc0-869787114911'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:10.331046 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2346b62d-8dd9-4e4f-afc0-869787114911 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6f3bce2e90f49a5af48ee7934e0ea79', 'request_id': 'req-2346b62d-8dd9-4e4f-afc0-869787114911'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:10.360936 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2346b62d-8dd9-4e4f-afc0-869787114911 admin admin] The token cache is being invalidate because project a6f3bce2e90f49a5af48ee7934e0ea79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:25:10.361278 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2346b62d-8dd9-4e4f-afc0-869787114911 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:10.363560 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2346b62d-8dd9-4e4f-afc0-869787114911 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:10.366366 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 851/1708] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:25:09 2022] DELETE /identity/v3/projects/a6f3bce2e90f49a5af48ee7934e0ea79 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:25:10.370380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bfa7f-5073-44de-9ee4-01ed1b7a7544 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:10.370670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bfa7f-5073-44de-9ee4-01ed1b7a7544 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:10.372096 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bfa7f-5073-44de-9ee4-01ed1b7a7544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:10.451325 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-fa6bfa7f-5073-44de-9ee4-01ed1b7a7544 None None] MFA Rules not processed for user `add38343a4604fab8b0e40bbe8e01e60`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:10.455796 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-fa6bfa7f-5073-44de-9ee4-01ed1b7a7544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:10.459147 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 858/1709] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:10.464340 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7bd30-1913-4fcb-933c-db427510816c None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:10.464636 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7bd30-1913-4fcb-933c-db427510816c None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:10.466097 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d7bd30-1913-4fcb-933c-db427510816c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:10.517271 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-64d7bd30-1913-4fcb-933c-db427510816c None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:10.518551 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-64d7bd30-1913-4fcb-933c-db427510816c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:10.724214 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 852/1710] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:10.725683 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8adfe-386d-4a39-942a-a2f171694843 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:10.726156 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8adfe-386d-4a39-942a-a2f171694843 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:10.728068 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8adfe-386d-4a39-942a-a2f171694843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:10.779795 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 859/1711] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:10.780200 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-01e8adfe-386d-4a39-942a-a2f171694843 None None] MFA Rules not processed for user `b875adcba700459b99ce0d0d5ec9a9d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:10.780290 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7bd30-1913-4fcb-933c-db427510816c None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:10.780290 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-64d7bd30-1913-4fcb-933c-db427510816c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:10.780435 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-01e8adfe-386d-4a39-942a-a2f171694843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:10.802679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 853/1712] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:10.806416 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dae0ef-60b0-4428-bf2b-b6bfd9c0fec9 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:10.806416 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dae0ef-60b0-4428-bf2b-b6bfd9c0fec9 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:10.807640 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dae0ef-60b0-4428-bf2b-b6bfd9c0fec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:10.869055 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-12dae0ef-60b0-4428-bf2b-b6bfd9c0fec9 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:10.873960 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-12dae0ef-60b0-4428-bf2b-b6bfd9c0fec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:10.908960 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 854/1713] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:10.914098 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dae0ef-60b0-4428-bf2b-b6bfd9c0fec9 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:10.920347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-12dae0ef-60b0-4428-bf2b-b6bfd9c0fec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:11.011216 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d7bd30-1913-4fcb-933c-db427510816c None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:11.035485 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01142ec9-b97b-4d0d-ae86-5f6d6bc5013e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:11.035485 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01142ec9-b97b-4d0d-ae86-5f6d6bc5013e service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:11.035485 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01142ec9-b97b-4d0d-ae86-5f6d6bc5013e service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:11.035485 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01142ec9-b97b-4d0d-ae86-5f6d6bc5013e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:11.053881 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01142ec9-b97b-4d0d-ae86-5f6d6bc5013e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:11.056050 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01142ec9-b97b-4d0d-ae86-5f6d6bc5013e service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:11.078715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:11.087035 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 860/1714] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:11.089620 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01142ec9-b97b-4d0d-ae86-5f6d6bc5013e service nova] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:11.114836 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dae0ef-60b0-4428-bf2b-b6bfd9c0fec9 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:11.128689 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01142ec9-b97b-4d0d-ae86-5f6d6bc5013e service nova] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:11.137431 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e5d5ec-dbd5-4349-97f9-f7ab33a51444 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:11.137431 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5d5ec-dbd5-4349-97f9-f7ab33a51444 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:11.137431 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5d5ec-dbd5-4349-97f9-f7ab33a51444 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:11.137431 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5d5ec-dbd5-4349-97f9-f7ab33a51444 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:11.148742 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784d058-4ad3-4ca3-b530-fc260174c588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:11.149534 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784d058-4ad3-4ca3-b530-fc260174c588 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:11.149825 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784d058-4ad3-4ca3-b530-fc260174c588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:11.150099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784d058-4ad3-4ca3-b530-fc260174c588 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:11.150805 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784d058-4ad3-4ca3-b530-fc260174c588 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:25:11.151107 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784d058-4ad3-4ca3-b530-fc260174c588 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:11.157191 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784d058-4ad3-4ca3-b530-fc260174c588 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:11.158595 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5d5ec-dbd5-4349-97f9-f7ab33a51444 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:11.160633 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e5d5ec-dbd5-4349-97f9-f7ab33a51444 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:11.187964 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 855/1715] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:11.190469 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a81d55-0c8f-46d9-8665-ef74220233bc None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:11.191027 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a81d55-0c8f-46d9-8665-ef74220233bc None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:11.191432 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a81d55-0c8f-46d9-8665-ef74220233bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:11.205529 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 861/1716] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:25:11.206723 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784d058-4ad3-4ca3-b530-fc260174c588 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:11.238455 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784d058-4ad3-4ca3-b530-fc260174c588 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:11.252600 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef96f5-41b9-4ffc-a82b-b0a053de417f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:11.253878 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef96f5-41b9-4ffc-a82b-b0a053de417f admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:11.254212 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef96f5-41b9-4ffc-a82b-b0a053de417f admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:11.254657 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef96f5-41b9-4ffc-a82b-b0a053de417f admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:11.255566 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef96f5-41b9-4ffc-a82b-b0a053de417f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:11.258656 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef96f5-41b9-4ffc-a82b-b0a053de417f admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:11.289078 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-49a81d55-0c8f-46d9-8665-ef74220233bc None None] MFA Rules not processed for user `0b92ad58e5484bc796e1b61fa9f788dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:11.290766 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-49a81d55-0c8f-46d9-8665-ef74220233bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:11.311271 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:11.354087 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 862/1717] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:25:11 2022] POST /identity/v3/projects => generated 407 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:11.358141 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef96f5-41b9-4ffc-a82b-b0a053de417f admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:11.483690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 856/1718] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:11.615825 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef96f5-41b9-4ffc-a82b-b0a053de417f admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:11.637909 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868873ba-0051-47f3-a15b-b4982401149b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:11.641011 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868873ba-0051-47f3-a15b-b4982401149b admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:11.641558 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868873ba-0051-47f3-a15b-b4982401149b admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:11.642046 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868873ba-0051-47f3-a15b-b4982401149b admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:11.643102 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868873ba-0051-47f3-a15b-b4982401149b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:11.645477 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868873ba-0051-47f3-a15b-b4982401149b admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:11.704379 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a81d55-0c8f-46d9-8665-ef74220233bc None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:11.706519 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 863/1719] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:25:11 2022] POST /identity/v3/users => generated 304 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:11.729745 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a81d55-0c8f-46d9-8665-ef74220233bc None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:11.743466 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d045a69-b522-4b15-b20e-f77e2aac5ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:11.744173 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d045a69-b522-4b15-b20e-f77e2aac5ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:11.744463 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d045a69-b522-4b15-b20e-f77e2aac5ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:11.744743 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d045a69-b522-4b15-b20e-f77e2aac5ef4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:11.745440 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d045a69-b522-4b15-b20e-f77e2aac5ef4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:11.747086 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d045a69-b522-4b15-b20e-f77e2aac5ef4 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:11.804081 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 857/1720] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:11.804735 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868873ba-0051-47f3-a15b-b4982401149b admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:11.819980 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868873ba-0051-47f3-a15b-b4982401149b admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:11.848571 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963bb04-3132-48ba-bb19-bf402ea3c827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:11.860018 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963bb04-3132-48ba-bb19-bf402ea3c827 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:11.862194 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963bb04-3132-48ba-bb19-bf402ea3c827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:11.864316 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963bb04-3132-48ba-bb19-bf402ea3c827 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:11.873045 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963bb04-3132-48ba-bb19-bf402ea3c827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:11.878192 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963bb04-3132-48ba-bb19-bf402ea3c827 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:11.941667 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 864/1721] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:11.942428 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d045a69-b522-4b15-b20e-f77e2aac5ef4 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:11.964506 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d045a69-b522-4b15-b20e-f77e2aac5ef4 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:11.995175 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d3787-0ce9-488e-acd9-11ff67a3bda3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:12.000257 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d3787-0ce9-488e-acd9-11ff67a3bda3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:12.000551 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d3787-0ce9-488e-acd9-11ff67a3bda3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:12.008112 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17d3787-0ce9-488e-acd9-11ff67a3bda3 admin admin] PATH_INFO: `/v3/projects/04ecbc93bb7e4e49bf018a8bf154ba71/users/c3fe61268b664ff4bf2c8ffa50ae37f0/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:12.086780 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d3787-0ce9-488e-acd9-11ff67a3bda3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04ecbc93bb7e4e49bf018a8bf154ba71, user_id=c3fe61268b664ff4bf2c8ffa50ae37f0, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:12.094920 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17d3787-0ce9-488e-acd9-11ff67a3bda3 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:12.139896 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 858/1722] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:11 2022] PUT /identity/v3/projects/04ecbc93bb7e4e49bf018a8bf154ba71/users/c3fe61268b664ff4bf2c8ffa50ae37f0/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:25:12.153559 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f057ae9-3ec3-4794-a276-c8b491a17b15 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:12.154531 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f057ae9-3ec3-4794-a276-c8b491a17b15 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:12.155002 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f057ae9-3ec3-4794-a276-c8b491a17b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:12.243384 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d3787-0ce9-488e-acd9-11ff67a3bda3 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:12.286371 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-9f057ae9-3ec3-4794-a276-c8b491a17b15 None None] MFA Rules not processed for user `c3fe61268b664ff4bf2c8ffa50ae37f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:12.287611 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9f057ae9-3ec3-4794-a276-c8b491a17b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:12.489825 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17d3787-0ce9-488e-acd9-11ff67a3bda3 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:12.507584 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3042cb8-af7f-4281-b05a-bdffdc292df8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:12.508259 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3042cb8-af7f-4281-b05a-bdffdc292df8 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:12.508554 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3042cb8-af7f-4281-b05a-bdffdc292df8 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:12.508861 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3042cb8-af7f-4281-b05a-bdffdc292df8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:12.519577 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 865/1723] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:12 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:12.520989 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f057ae9-3ec3-4794-a276-c8b491a17b15 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:12.620517 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:12.693038 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3042cb8-af7f-4281-b05a-bdffdc292df8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:12.697130 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3042cb8-af7f-4281-b05a-bdffdc292df8 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:12.721483 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f057ae9-3ec3-4794-a276-c8b491a17b15 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:12.729807 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 859/1724] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:12.741616 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e5d97-7711-4e3d-b9e9-5f11fe1d7f36 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:12.742169 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e5d97-7711-4e3d-b9e9-5f11fe1d7f36 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:12.743199 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935e5d97-7711-4e3d-b9e9-5f11fe1d7f36 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:12.745603 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 860/1725] 10.222.0.40 () {54 vars in 912 bytes} [Wed Jul 27 15:25:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:25:12.747017 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9271e55-16b6-4cc1-8733-039f5a8b3d88 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:12.747213 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951818f1-1b88-49ab-a9c7-b5944b0672db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:12.747742 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9271e55-16b6-4cc1-8733-039f5a8b3d88 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:12.747854 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951818f1-1b88-49ab-a9c7-b5944b0672db admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:12.748136 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951818f1-1b88-49ab-a9c7-b5944b0672db admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:12.748414 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951818f1-1b88-49ab-a9c7-b5944b0672db admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:12.749936 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951818f1-1b88-49ab-a9c7-b5944b0672db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:12.755347 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951818f1-1b88-49ab-a9c7-b5944b0672db admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:12.758749 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9271e55-16b6-4cc1-8733-039f5a8b3d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:12.770221 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:12.807808 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f9271e55-16b6-4cc1-8733-039f5a8b3d88 None None] MFA Rules not processed for user `d815c45c04314dd0abe18cd9b4d9b744`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:12.810356 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f9271e55-16b6-4cc1-8733-039f5a8b3d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:12.837942 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 866/1726] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:25:12 2022] POST /identity/v3/projects => generated 409 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:12.839385 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f04a4-e019-45e3-9adf-c20d16542594 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:12.843712 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f04a4-e019-45e3-9adf-c20d16542594 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:12.846035 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f04a4-e019-45e3-9adf-c20d16542594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:12.952901 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 861/1727] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:12.952901 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9271e55-16b6-4cc1-8733-039f5a8b3d88 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:12.968695 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9271e55-16b6-4cc1-8733-039f5a8b3d88 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:12.985452 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-a61f04a4-e019-45e3-9adf-c20d16542594 None None] MFA Rules not processed for user `227dac1eaefc4d0a8d3cc8a6dee2ecba`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:12.986921 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a61f04a4-e019-45e3-9adf-c20d16542594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:13.112178 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 867/1728] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Jul 27 15:25:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:13.116775 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740a48c-d983-4332-870f-e8f1fbeacadd None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:13.117790 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740a48c-d983-4332-870f-e8f1fbeacadd None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:13.118891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740a48c-d983-4332-870f-e8f1fbeacadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:13.147623 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee8f5a-5b2e-4a44-9448-87f655cbdc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:13.148303 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee8f5a-5b2e-4a44-9448-87f655cbdc63 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:13.148587 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee8f5a-5b2e-4a44-9448-87f655cbdc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:13.148909 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee8f5a-5b2e-4a44-9448-87f655cbdc63 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:13.149544 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee8f5a-5b2e-4a44-9448-87f655cbdc63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:13.164273 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee8f5a-5b2e-4a44-9448-87f655cbdc63 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:13.182971 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-9740a48c-d983-4332-870f-e8f1fbeacadd None None] MFA Rules not processed for user `d815c45c04314dd0abe18cd9b4d9b744`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:13.186620 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9740a48c-d983-4332-870f-e8f1fbeacadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:13.229130 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 862/1729] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:25:12 2022] POST /identity/v3/users => generated 311 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:13.233074 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee8f5a-5b2e-4a44-9448-87f655cbdc63 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:13.260951 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee8f5a-5b2e-4a44-9448-87f655cbdc63 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:13.283264 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b6d83-d1e4-43c7-87fd-1bb0852047aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:13.284970 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b6d83-d1e4-43c7-87fd-1bb0852047aa admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:13.285544 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b6d83-d1e4-43c7-87fd-1bb0852047aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:13.293065 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b6d83-d1e4-43c7-87fd-1bb0852047aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:13.295915 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b6d83-d1e4-43c7-87fd-1bb0852047aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:13.298598 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b6d83-d1e4-43c7-87fd-1bb0852047aa admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:13.322356 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 863/1730] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:13.326378 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b6d83-d1e4-43c7-87fd-1bb0852047aa admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:13.330671 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b54b6d83-d1e4-43c7-87fd-1bb0852047aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:13.356450 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b6d83-d1e4-43c7-87fd-1bb0852047aa admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:13.374309 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d20528-e2fc-46b4-b1a8-ef0069a9f02e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:13.375346 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d20528-e2fc-46b4-b1a8-ef0069a9f02e service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:13.377247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d20528-e2fc-46b4-b1a8-ef0069a9f02e service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:13.377715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d20528-e2fc-46b4-b1a8-ef0069a9f02e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:13.397931 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d20528-e2fc-46b4-b1a8-ef0069a9f02e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:13.399963 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d20528-e2fc-46b4-b1a8-ef0069a9f02e service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:13.414137 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 864/1731] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:13.415141 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d20528-e2fc-46b4-b1a8-ef0069a9f02e service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:13.459513 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d20528-e2fc-46b4-b1a8-ef0069a9f02e service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:13.486585 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 868/1732] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:13.514049 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed61f5-e992-49c9-aaad-3348b632c6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:13.514930 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed61f5-e992-49c9-aaad-3348b632c6ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:13.515033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed61f5-e992-49c9-aaad-3348b632c6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:13.515400 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ed61f5-e992-49c9-aaad-3348b632c6ae admin admin] PATH_INFO: `/v3/projects/b5b8eeaec55c4f3b8e65ab8eea4cdbf4/users/8a0675770a104f98a0b41fb17afc28a7/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:13.615507 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740a48c-d983-4332-870f-e8f1fbeacadd None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:13.653290 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed61f5-e992-49c9-aaad-3348b632c6ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5b8eeaec55c4f3b8e65ab8eea4cdbf4, user_id=8a0675770a104f98a0b41fb17afc28a7, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:13.656002 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ed61f5-e992-49c9-aaad-3348b632c6ae admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:13.715850 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 865/1733] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:13 2022] PUT /identity/v3/projects/b5b8eeaec55c4f3b8e65ab8eea4cdbf4/users/8a0675770a104f98a0b41fb17afc28a7/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:13.716920 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed61f5-e992-49c9-aaad-3348b632c6ae admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:13.772853 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:13.941949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740a48c-d983-4332-870f-e8f1fbeacadd None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:14.052278 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ed61f5-e992-49c9-aaad-3348b632c6ae admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:14.059621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838ab60-a96c-4dc3-a0c3-45eabc268afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:14.060523 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838ab60-a96c-4dc3-a0c3-45eabc268afb admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:14.061009 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838ab60-a96c-4dc3-a0c3-45eabc268afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:14.061434 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5838ab60-a96c-4dc3-a0c3-45eabc268afb admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:14.062416 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5838ab60-a96c-4dc3-a0c3-45eabc268afb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:14.064431 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5838ab60-a96c-4dc3-a0c3-45eabc268afb admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:14.082301 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:14.082561 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 866/1734] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:14.085498 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838ab60-a96c-4dc3-a0c3-45eabc268afb admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:14.108815 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5838ab60-a96c-4dc3-a0c3-45eabc268afb admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:14.117008 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e39bc0-7cc2-4cc8-9b2a-44d2b0a7b0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:14.118259 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e39bc0-7cc2-4cc8-9b2a-44d2b0a7b0d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:14.118848 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e39bc0-7cc2-4cc8-9b2a-44d2b0a7b0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:14.119268 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e39bc0-7cc2-4cc8-9b2a-44d2b0a7b0d7 admin admin] PATH_INFO: `/v3/projects/b5b8eeaec55c4f3b8e65ab8eea4cdbf4/users/8a0675770a104f98a0b41fb17afc28a7/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:14.125856 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e39bc0-7cc2-4cc8-9b2a-44d2b0a7b0d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5b8eeaec55c4f3b8e65ab8eea4cdbf4, user_id=8a0675770a104f98a0b41fb17afc28a7, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:14.130736 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e39bc0-7cc2-4cc8-9b2a-44d2b0a7b0d7 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:14.200065 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 867/1735] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:14 2022] PUT /identity/v3/projects/b5b8eeaec55c4f3b8e65ab8eea4cdbf4/users/8a0675770a104f98a0b41fb17afc28a7/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:14.208078 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a020d-3e58-4e74-89a5-b69a06267034 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:14.208625 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a020d-3e58-4e74-89a5-b69a06267034 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:14.208903 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a020d-3e58-4e74-89a5-b69a06267034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:14.267763 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-bd4a020d-3e58-4e74-89a5-b69a06267034 None None] MFA Rules not processed for user `8a0675770a104f98a0b41fb17afc28a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:14.269276 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bd4a020d-3e58-4e74-89a5-b69a06267034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:14.304361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599ab13-f8e2-4819-9db9-2277babff65a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:14.304361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599ab13-f8e2-4819-9db9-2277babff65a service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:14.304361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599ab13-f8e2-4819-9db9-2277babff65a service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:14.304361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599ab13-f8e2-4819-9db9-2277babff65a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:14.569038 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599ab13-f8e2-4819-9db9-2277babff65a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:14.579701 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 868/1736] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:14 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:14.583445 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599ab13-f8e2-4819-9db9-2277babff65a service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:14.617148 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 869/1737] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 1001 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:14.740857 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a020d-3e58-4e74-89a5-b69a06267034 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:14.742187 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bd4a020d-3e58-4e74-89a5-b69a06267034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:14.821842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3062f15-3306-4f0f-b9da-65be0600a81d None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:14.822187 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3062f15-3306-4f0f-b9da-65be0600a81d None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:14.822478 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3062f15-3306-4f0f-b9da-65be0600a81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:14.918583 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-b3062f15-3306-4f0f-b9da-65be0600a81d None None] MFA Rules not processed for user `c77a01fed0e741288f05941fe5670a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:14.919892 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b3062f15-3306-4f0f-b9da-65be0600a81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:14.992776 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a020d-3e58-4e74-89a5-b69a06267034 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:15.005625 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f21a9b-9e34-492c-a350-d67302e66717 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:15.006704 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f21a9b-9e34-492c-a350-d67302e66717 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:15.006704 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f21a9b-9e34-492c-a350-d67302e66717 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:15.006924 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f21a9b-9e34-492c-a350-d67302e66717 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:15.040546 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f21a9b-9e34-492c-a350-d67302e66717 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:15.042380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f21a9b-9e34-492c-a350-d67302e66717 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:15.087683 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 869/1738] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:14 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:15.132165 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 870/1739] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:25:15.476354 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda0d7b-a08b-4603-844c-9f0939eaf355 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:15.477200 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda0d7b-a08b-4603-844c-9f0939eaf355 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:15.477744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda0d7b-a08b-4603-844c-9f0939eaf355 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:15.479806 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 870/1740] 10.222.0.40 () {54 vars in 961 bytes} [Wed Jul 27 15:25:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:25:15.486996 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fb8cc-18c3-470f-89a9-726a2f24ebdc None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:15.487563 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fb8cc-18c3-470f-89a9-726a2f24ebdc None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:15.487747 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3fb8cc-18c3-470f-89a9-726a2f24ebdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:15.533920 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda0d7b-a08b-4603-844c-9f0939eaf355 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:15.535755 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-dcda0d7b-a08b-4603-844c-9f0939eaf355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:15.542437 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-3a3fb8cc-18c3-470f-89a9-726a2f24ebdc None None] MFA Rules not processed for user `a386d326dc634cbd943ac30f6e8d08bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:15.544560 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-3a3fb8cc-18c3-470f-89a9-726a2f24ebdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:15.553370 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda0d7b-a08b-4603-844c-9f0939eaf355 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:15.578226 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7417d297-396b-4845-a735-0be928a0463f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:15.578927 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417d297-396b-4845-a735-0be928a0463f service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:15.579212 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417d297-396b-4845-a735-0be928a0463f service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:15.584104 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417d297-396b-4845-a735-0be928a0463f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:15.627790 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:15.688912 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:15.713457 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 871/1741] 10.222.0.40 () {58 vars in 1058 bytes} [Wed Jul 27 15:25:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:15.715306 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3fb8cc-18c3-470f-89a9-726a2f24ebdc None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:15.716703 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-3a3fb8cc-18c3-470f-89a9-726a2f24ebdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:15.763258 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7417d297-396b-4845-a735-0be928a0463f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:15.765374 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7417d297-396b-4845-a735-0be928a0463f service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:15.789413 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 871/1742] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:15 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 15:25:15.791766 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7417d297-396b-4845-a735-0be928a0463f service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:15.817547 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3fb8cc-18c3-470f-89a9-726a2f24ebdc None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:15.834790 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe62fe7-820e-431c-b0d8-b4343cfe9b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:15.838800 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe62fe7-820e-431c-b0d8-b4343cfe9b47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:15.840145 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe62fe7-820e-431c-b0d8-b4343cfe9b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:15.840235 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe62fe7-820e-431c-b0d8-b4343cfe9b47 admin admin] PATH_INFO: `/v3/users/add38343a4604fab8b0e40bbe8e01e60` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:15.850010 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe62fe7-820e-431c-b0d8-b4343cfe9b47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=add38343a4604fab8b0e40bbe8e01e60)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:15.857691 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe62fe7-820e-431c-b0d8-b4343cfe9b47 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:15.976783 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ebe62fe7-820e-431c-b0d8-b4343cfe9b47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'add38343a4604fab8b0e40bbe8e01e60'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:15.978186 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ebe62fe7-820e-431c-b0d8-b4343cfe9b47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'add38343a4604fab8b0e40bbe8e01e60'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:16.007000 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ebe62fe7-820e-431c-b0d8-b4343cfe9b47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'add38343a4604fab8b0e40bbe8e01e60'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:16.022976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7417d297-396b-4845-a735-0be928a0463f service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:16.025989 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ebe62fe7-820e-431c-b0d8-b4343cfe9b47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'add38343a4604fab8b0e40bbe8e01e60'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:16.044039 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5e78f-46dc-4950-917d-dba016ebf2b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:16.045988 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5e78f-46dc-4950-917d-dba016ebf2b0 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:16.046281 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5e78f-46dc-4950-917d-dba016ebf2b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:16.046561 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5e78f-46dc-4950-917d-dba016ebf2b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:16.065524 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ebe62fe7-820e-431c-b0d8-b4343cfe9b47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'add38343a4604fab8b0e40bbe8e01e60'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:16.070222 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5e78f-46dc-4950-917d-dba016ebf2b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:16.071792 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5e78f-46dc-4950-917d-dba016ebf2b0 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:16.086842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 872/1743] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:25:15 2022] DELETE /identity/v3/users/add38343a4604fab8b0e40bbe8e01e60 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:16.087252 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe62fe7-820e-431c-b0d8-b4343cfe9b47 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:16.094435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ebe62fe7-820e-431c-b0d8-b4343cfe9b47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:16.119979 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 872/1744] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:16.134444 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5e78f-46dc-4950-917d-dba016ebf2b0 service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:16.137525 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-34c5e78f-46dc-4950-917d-dba016ebf2b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:16.197564 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5e78f-46dc-4950-917d-dba016ebf2b0 service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:16.438473 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe62fe7-820e-431c-b0d8-b4343cfe9b47 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:16.464485 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd737c0-8308-4db9-9932-76f3455e0b26 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a386d326dc634cbd943ac30f6e8d08bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:16.465686 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd737c0-8308-4db9-9932-76f3455e0b26 service placement] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:16.465970 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd737c0-8308-4db9-9932-76f3455e0b26 service placement] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:16.466244 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd737c0-8308-4db9-9932-76f3455e0b26 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:16.467518 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096a83d-c167-4b4a-92d5-1ba30bfd9ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:16.468203 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096a83d-c167-4b4a-92d5-1ba30bfd9ca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:16.468483 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096a83d-c167-4b4a-92d5-1ba30bfd9ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:16.468747 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096a83d-c167-4b4a-92d5-1ba30bfd9ca2 admin admin] PATH_INFO: `/v3/users/7f9411e07c804aa08e440dc56e742515` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:16.474366 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f096a83d-c167-4b4a-92d5-1ba30bfd9ca2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f9411e07c804aa08e440dc56e742515)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:16.476377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f096a83d-c167-4b4a-92d5-1ba30bfd9ca2 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:16.484638 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-4bd737c0-8308-4db9-9932-76f3455e0b26 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:16.538148 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd737c0-8308-4db9-9932-76f3455e0b26 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:16.539716 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd737c0-8308-4db9-9932-76f3455e0b26 service placement] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:16.579195 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:16.603898 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 873/1745] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:16.606741 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd93637-6e05-4b01-b2f1-fd73a44188d9 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:16.607145 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd93637-6e05-4b01-b2f1-fd73a44188d9 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:16.607531 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd93637-6e05-4b01-b2f1-fd73a44188d9 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:16.612179 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 874/1746] 10.222.0.40 () {54 vars in 912 bytes} [Wed Jul 27 15:25:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:25:16.613589 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d33a2-2dc8-4b37-9fd0-f177574ab4db None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:16.613976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d33a2-2dc8-4b37-9fd0-f177574ab4db None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:16.614354 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2d33a2-2dc8-4b37-9fd0-f177574ab4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:16.647480 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-1d2d33a2-2dc8-4b37-9fd0-f177574ab4db None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:16.648964 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-1d2d33a2-2dc8-4b37-9fd0-f177574ab4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:16.675575 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:16.679449 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f096a83d-c167-4b4a-92d5-1ba30bfd9ca2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f9411e07c804aa08e440dc56e742515'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:16.681422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f096a83d-c167-4b4a-92d5-1ba30bfd9ca2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f9411e07c804aa08e440dc56e742515'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:16.693986 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 875/1747] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:16.695737 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f350886-dc2e-48f9-830c-c596e9011cc4 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:16.701580 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f350886-dc2e-48f9-830c-c596e9011cc4 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:16.701930 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f096a83d-c167-4b4a-92d5-1ba30bfd9ca2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f9411e07c804aa08e440dc56e742515'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:16.702452 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f350886-dc2e-48f9-830c-c596e9011cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:16.704468 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f096a83d-c167-4b4a-92d5-1ba30bfd9ca2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f9411e07c804aa08e440dc56e742515'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:16.740133 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f096a83d-c167-4b4a-92d5-1ba30bfd9ca2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f9411e07c804aa08e440dc56e742515'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:16.776036 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-0f350886-dc2e-48f9-830c-c596e9011cc4 None None] MFA Rules not processed for user `227dac1eaefc4d0a8d3cc8a6dee2ecba`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:16.777869 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-0f350886-dc2e-48f9-830c-c596e9011cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:16.781433 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 873/1748] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:25:16 2022] DELETE /identity/v3/users/7f9411e07c804aa08e440dc56e742515 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:16.781433 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096a83d-c167-4b4a-92d5-1ba30bfd9ca2 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:16.783208 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f096a83d-c167-4b4a-92d5-1ba30bfd9ca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:16.985651 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 876/1749] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Jul 27 15:25:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:16.987510 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08856a88-1d7d-4d49-a6cb-42a8bdefdce0 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:16.988089 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08856a88-1d7d-4d49-a6cb-42a8bdefdce0 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:16.988616 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08856a88-1d7d-4d49-a6cb-42a8bdefdce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:16.992079 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096a83d-c167-4b4a-92d5-1ba30bfd9ca2 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:17.001690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42449d-bcce-4c75-a2fb-7f7eaf2a4eb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:17.002322 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42449d-bcce-4c75-a2fb-7f7eaf2a4eb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:17.002605 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42449d-bcce-4c75-a2fb-7f7eaf2a4eb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:17.010151 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42449d-bcce-4c75-a2fb-7f7eaf2a4eb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:17.016565 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ce42449d-bcce-4c75-a2fb-7f7eaf2a4eb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:17.018778 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-08856a88-1d7d-4d49-a6cb-42a8bdefdce0 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:17.020143 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-08856a88-1d7d-4d49-a6cb-42a8bdefdce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:17.196476 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 877/1750] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:17.201075 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08856a88-1d7d-4d49-a6cb-42a8bdefdce0 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:17.202953 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-08856a88-1d7d-4d49-a6cb-42a8bdefdce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:17.228618 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08856a88-1d7d-4d49-a6cb-42a8bdefdce0 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:17.242694 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a1782-bfc9-4930-97c3-af98a6a7dd50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:17.243647 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a1782-bfc9-4930-97c3-af98a6a7dd50 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:17.244073 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a1782-bfc9-4930-97c3-af98a6a7dd50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:17.244522 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1a1782-bfc9-4930-97c3-af98a6a7dd50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:17.259641 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a1782-bfc9-4930-97c3-af98a6a7dd50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:17.262703 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1a1782-bfc9-4930-97c3-af98a6a7dd50 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:17.275002 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 878/1751] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:17.276126 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a1782-bfc9-4930-97c3-af98a6a7dd50 service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:17.296611 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1a1782-bfc9-4930-97c3-af98a6a7dd50 service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:17.302811 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6044f-af72-413a-9080-0c0067cb2199 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:17.303692 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6044f-af72-413a-9080-0c0067cb2199 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:17.304033 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6044f-af72-413a-9080-0c0067cb2199 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:17.304352 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6044f-af72-413a-9080-0c0067cb2199 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:17.317078 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6044f-af72-413a-9080-0c0067cb2199 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:17.318281 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6044f-af72-413a-9080-0c0067cb2199 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:17.325968 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42449d-bcce-4c75-a2fb-7f7eaf2a4eb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:17.327511 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42449d-bcce-4c75-a2fb-7f7eaf2a4eb4 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:17.331762 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 879/1752] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:17.370609 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 874/1753] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:18.474025 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6044f-af72-413a-9080-0c0067cb2199 service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:18.475589 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-75d6044f-af72-413a-9080-0c0067cb2199 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:18.502486 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42449d-bcce-4c75-a2fb-7f7eaf2a4eb4 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:18.505010 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ce42449d-bcce-4c75-a2fb-7f7eaf2a4eb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:18.516735 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6044f-af72-413a-9080-0c0067cb2199 service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:18.529235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42449d-bcce-4c75-a2fb-7f7eaf2a4eb4 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:18.540278 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c51889-299e-4550-84b6-a2e7fe459fe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:18.541223 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c51889-299e-4550-84b6-a2e7fe459fe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:18.541905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c51889-299e-4550-84b6-a2e7fe459fe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:18.542500 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91ff8b-dd6c-4735-9482-dfb070a50db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:18.543011 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c51889-299e-4550-84b6-a2e7fe459fe3 admin admin] PATH_INFO: `/v3/users/c05e1245dd4f4ca394bc57b4b4b0b241` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:18.544063 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91ff8b-dd6c-4735-9482-dfb070a50db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:18.545285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91ff8b-dd6c-4735-9482-dfb070a50db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:18.547494 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91ff8b-dd6c-4735-9482-dfb070a50db6 admin admin] PATH_INFO: `/v3/projects/f208e7361b1d401c97ae637364b28038` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:18.549286 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae91ff8b-dd6c-4735-9482-dfb070a50db6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f208e7361b1d401c97ae637364b28038)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:18.549860 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c51889-299e-4550-84b6-a2e7fe459fe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c05e1245dd4f4ca394bc57b4b4b0b241)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:18.551976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c51889-299e-4550-84b6-a2e7fe459fe3 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:18.555275 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae91ff8b-dd6c-4735-9482-dfb070a50db6 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:18.669298 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ae91ff8b-dd6c-4735-9482-dfb070a50db6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f208e7361b1d401c97ae637364b28038', 'request_id': 'req-ae91ff8b-dd6c-4735-9482-dfb070a50db6'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:18.679166 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ae91ff8b-dd6c-4735-9482-dfb070a50db6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f208e7361b1d401c97ae637364b28038', 'request_id': 'req-ae91ff8b-dd6c-4735-9482-dfb070a50db6'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:18.696791 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-72c51889-299e-4550-84b6-a2e7fe459fe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c05e1245dd4f4ca394bc57b4b4b0b241'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:18.701082 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-72c51889-299e-4550-84b6-a2e7fe459fe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c05e1245dd4f4ca394bc57b4b4b0b241'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:18.716604 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ae91ff8b-dd6c-4735-9482-dfb070a50db6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f208e7361b1d401c97ae637364b28038', 'request_id': 'req-ae91ff8b-dd6c-4735-9482-dfb070a50db6'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:18.720322 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-72c51889-299e-4550-84b6-a2e7fe459fe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c05e1245dd4f4ca394bc57b4b4b0b241'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:18.726420 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:18.749820 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ae91ff8b-dd6c-4735-9482-dfb070a50db6 admin admin] The token cache is being invalidate because project f208e7361b1d401c97ae637364b28038 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:25:18.750123 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ae91ff8b-dd6c-4735-9482-dfb070a50db6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:18.752384 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ae91ff8b-dd6c-4735-9482-dfb070a50db6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:18.753554 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-72c51889-299e-4550-84b6-a2e7fe459fe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c05e1245dd4f4ca394bc57b4b4b0b241'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:18.764294 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:18.771054 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 875/1754] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:25:18 2022] DELETE /identity/v3/projects/f208e7361b1d401c97ae637364b28038 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:18.777845 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91ff8b-dd6c-4735-9482-dfb070a50db6 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:18.782443 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ae91ff8b-dd6c-4735-9482-dfb070a50db6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:18.788516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-72c51889-299e-4550-84b6-a2e7fe459fe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c05e1245dd4f4ca394bc57b4b4b0b241'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:18.802204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 880/1755] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:25:18 2022] DELETE /identity/v3/users/c05e1245dd4f4ca394bc57b4b4b0b241 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:18.803145 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c51889-299e-4550-84b6-a2e7fe459fe3 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:18.810517 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-72c51889-299e-4550-84b6-a2e7fe459fe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:18.962597 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91ff8b-dd6c-4735-9482-dfb070a50db6 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:19.021704 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c51889-299e-4550-84b6-a2e7fe459fe3 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:19.050836 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6713e6-52d4-4409-b1f6-30cac3b67bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:19.051501 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6713e6-52d4-4409-b1f6-30cac3b67bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:19.052112 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6713e6-52d4-4409-b1f6-30cac3b67bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:19.052579 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6713e6-52d4-4409-b1f6-30cac3b67bc7 admin admin] PATH_INFO: `/v3/users/c242b2ecc6d1499cb6bf952e4ec8ebdc` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:19.054727 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6713e6-52d4-4409-b1f6-30cac3b67bc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c242b2ecc6d1499cb6bf952e4ec8ebdc)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:19.056969 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6713e6-52d4-4409-b1f6-30cac3b67bc7 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:19.195222 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea306a2-b024-4cb9-8535-10b06cccea92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:19.197039 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea306a2-b024-4cb9-8535-10b06cccea92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:19.197861 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea306a2-b024-4cb9-8535-10b06cccea92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:19.198156 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea306a2-b024-4cb9-8535-10b06cccea92 admin admin] PATH_INFO: `/v3/projects/05a81aff270b431b9972a3997a850a45` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:19.203110 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea306a2-b024-4cb9-8535-10b06cccea92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05a81aff270b431b9972a3997a850a45)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:19.207843 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea306a2-b024-4cb9-8535-10b06cccea92 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:19.249523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4c6713e6-52d4-4409-b1f6-30cac3b67bc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c242b2ecc6d1499cb6bf952e4ec8ebdc'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:19.253336 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4c6713e6-52d4-4409-b1f6-30cac3b67bc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c242b2ecc6d1499cb6bf952e4ec8ebdc'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:19.285632 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4c6713e6-52d4-4409-b1f6-30cac3b67bc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c242b2ecc6d1499cb6bf952e4ec8ebdc'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:19.301154 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4c6713e6-52d4-4409-b1f6-30cac3b67bc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c242b2ecc6d1499cb6bf952e4ec8ebdc'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:19.349123 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4c6713e6-52d4-4409-b1f6-30cac3b67bc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c242b2ecc6d1499cb6bf952e4ec8ebdc'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:19.350159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2ea306a2-b024-4cb9-8535-10b06cccea92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05a81aff270b431b9972a3997a850a45', 'request_id': 'req-2ea306a2-b024-4cb9-8535-10b06cccea92'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:19.363340 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 881/1756] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:25:18 2022] DELETE /identity/v3/users/c242b2ecc6d1499cb6bf952e4ec8ebdc => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:19.367534 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67026eb9-f292-4123-9abe-01298cb4c729 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:19.367900 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67026eb9-f292-4123-9abe-01298cb4c729 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:19.368335 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67026eb9-f292-4123-9abe-01298cb4c729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:19.369968 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2ea306a2-b024-4cb9-8535-10b06cccea92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05a81aff270b431b9972a3997a850a45', 'request_id': 'req-2ea306a2-b024-4cb9-8535-10b06cccea92'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:19.390104 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2ea306a2-b024-4cb9-8535-10b06cccea92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05a81aff270b431b9972a3997a850a45', 'request_id': 'req-2ea306a2-b024-4cb9-8535-10b06cccea92'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:19.396822 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-67026eb9-f292-4123-9abe-01298cb4c729 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:19.398482 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-67026eb9-f292-4123-9abe-01298cb4c729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:19.426224 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2ea306a2-b024-4cb9-8535-10b06cccea92 admin admin] The token cache is being invalidate because project 05a81aff270b431b9972a3997a850a45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:25:19.427300 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2ea306a2-b024-4cb9-8535-10b06cccea92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:19.429549 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2ea306a2-b024-4cb9-8535-10b06cccea92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:19.437222 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 876/1757] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:25:18 2022] DELETE /identity/v3/projects/05a81aff270b431b9972a3997a850a45 => generated 0 bytes in 662 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:19.439733 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb60b2-e94e-46bd-838c-5e2d7f67b515 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:19.440544 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb60b2-e94e-46bd-838c-5e2d7f67b515 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:19.443324 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb60b2-e94e-46bd-838c-5e2d7f67b515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:19.508866 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b9cb60b2-e94e-46bd-838c-5e2d7f67b515 None None] MFA Rules not processed for user `d815c45c04314dd0abe18cd9b4d9b744`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:19.515163 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b9cb60b2-e94e-46bd-838c-5e2d7f67b515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:19.555950 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 882/1758] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:19.558414 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d31b2-afec-4ea0-ae49-4b23ae615f3e None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:19.558964 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d31b2-afec-4ea0-ae49-4b23ae615f3e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:19.559451 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2d31b2-afec-4ea0-ae49-4b23ae615f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:19.564361 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:19.587723 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:19.598508 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-3a2d31b2-afec-4ea0-ae49-4b23ae615f3e None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:19.601497 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-3a2d31b2-afec-4ea0-ae49-4b23ae615f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:19.617024 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 877/1759] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:19.618363 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb60b2-e94e-46bd-838c-5e2d7f67b515 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:19.620369 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b9cb60b2-e94e-46bd-838c-5e2d7f67b515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:19.649164 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 883/1760] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:19.650835 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6cfee-0b86-4b96-a23c-b81493bc230d None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:19.653746 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6cfee-0b86-4b96-a23c-b81493bc230d None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:19.654714 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6cfee-0b86-4b96-a23c-b81493bc230d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:19.701476 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-26d6cfee-0b86-4b96-a23c-b81493bc230d None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:19.705317 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-26d6cfee-0b86-4b96-a23c-b81493bc230d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:19.733162 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 884/1761] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:19.760380 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6cfee-0b86-4b96-a23c-b81493bc230d None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:19.797273 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb60b2-e94e-46bd-838c-5e2d7f67b515 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:19.798242 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6cfee-0b86-4b96-a23c-b81493bc230d None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:19.804564 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162469fd-6083-4fd4-874b-af267cd71578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:19.805216 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162469fd-6083-4fd4-874b-af267cd71578 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:19.805503 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162469fd-6083-4fd4-874b-af267cd71578 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:19.805783 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162469fd-6083-4fd4-874b-af267cd71578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:19.820367 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82e806-506b-407e-ae7f-228cf322096d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:19.826069 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162469fd-6083-4fd4-874b-af267cd71578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:19.826231 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82e806-506b-407e-ae7f-228cf322096d admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:19.826807 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82e806-506b-407e-ae7f-228cf322096d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:19.827705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162469fd-6083-4fd4-874b-af267cd71578 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:19.829140 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82e806-506b-407e-ae7f-228cf322096d admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:19.832198 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82e806-506b-407e-ae7f-228cf322096d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:25:19.832546 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82e806-506b-407e-ae7f-228cf322096d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:19.841328 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82e806-506b-407e-ae7f-228cf322096d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:19.872026 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 878/1762] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:19.885016 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 885/1763] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:25:19.885161 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162469fd-6083-4fd4-874b-af267cd71578 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:19.917279 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162469fd-6083-4fd4-874b-af267cd71578 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:19.933093 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c5149-9eef-4e93-a1c9-24d8f4d049be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:19.933939 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c5149-9eef-4e93-a1c9-24d8f4d049be admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:19.934320 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c5149-9eef-4e93-a1c9-24d8f4d049be admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:19.934698 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c5149-9eef-4e93-a1c9-24d8f4d049be admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:19.936687 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c5149-9eef-4e93-a1c9-24d8f4d049be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:19.943211 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c5149-9eef-4e93-a1c9-24d8f4d049be admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:20.066927 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 879/1764] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:25:19 2022] POST /identity/v3/projects => generated 383 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:20.068251 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82e806-506b-407e-ae7f-228cf322096d admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:20.093367 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82e806-506b-407e-ae7f-228cf322096d admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:20.236771 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8837f-4604-40b5-9c2e-34aefafb3673 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:20.237082 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8837f-4604-40b5-9c2e-34aefafb3673 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:20.237331 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8837f-4604-40b5-9c2e-34aefafb3673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:20.281763 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-7ef8837f-4604-40b5-9c2e-34aefafb3673 None None] MFA Rules not processed for user `0b92ad58e5484bc796e1b61fa9f788dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:20.284380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7ef8837f-4604-40b5-9c2e-34aefafb3673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:20.284500 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805275a-5a13-4c69-9268-0abe4b13c785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:20.286514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805275a-5a13-4c69-9268-0abe4b13c785 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:20.286849 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805275a-5a13-4c69-9268-0abe4b13c785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:20.302125 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1805275a-5a13-4c69-9268-0abe4b13c785 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:20.306789 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805275a-5a13-4c69-9268-0abe4b13c785 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:20.312621 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1805275a-5a13-4c69-9268-0abe4b13c785 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:20.402916 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 886/1765] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:25:20 2022] POST /identity/v3/users => generated 292 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:20.403837 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805275a-5a13-4c69-9268-0abe4b13c785 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:20.434356 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 880/1766] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:20.441724 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1805275a-5a13-4c69-9268-0abe4b13c785 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:20.460368 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021d284-b6cc-4177-b19e-b442da69b809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:20.462591 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021d284-b6cc-4177-b19e-b442da69b809 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:20.463033 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021d284-b6cc-4177-b19e-b442da69b809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:20.463740 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021d284-b6cc-4177-b19e-b442da69b809 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:20.474745 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021d284-b6cc-4177-b19e-b442da69b809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:20.481992 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021d284-b6cc-4177-b19e-b442da69b809 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:20.496471 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 887/1767] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:20.500500 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8837f-4604-40b5-9c2e-34aefafb3673 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:20.522616 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8837f-4604-40b5-9c2e-34aefafb3673 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:20.534550 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd861ac5-b1c6-4a65-b82a-2db2b4a391d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:20.536376 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd861ac5-b1c6-4a65-b82a-2db2b4a391d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:20.536667 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd861ac5-b1c6-4a65-b82a-2db2b4a391d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:20.536946 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd861ac5-b1c6-4a65-b82a-2db2b4a391d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:20.537661 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd861ac5-b1c6-4a65-b82a-2db2b4a391d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:20.545208 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd861ac5-b1c6-4a65-b82a-2db2b4a391d7 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:20.550092 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66711cd-fd0a-4fe8-b03f-6f0bc2226b02 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:20.550987 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66711cd-fd0a-4fe8-b03f-6f0bc2226b02 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:20.551661 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66711cd-fd0a-4fe8-b03f-6f0bc2226b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:20.572757 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 881/1768] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:20.578624 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd861ac5-b1c6-4a65-b82a-2db2b4a391d7 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:20.610284 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd861ac5-b1c6-4a65-b82a-2db2b4a391d7 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:20.638286 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecd2e5-6cb5-4c35-a59f-2b5dae21c513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:20.638710 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecd2e5-6cb5-4c35-a59f-2b5dae21c513 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:20.639003 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecd2e5-6cb5-4c35-a59f-2b5dae21c513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:20.639284 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecd2e5-6cb5-4c35-a59f-2b5dae21c513 admin admin] PATH_INFO: `/v3/projects/4494cdebe59f4d948718e90135ae3cc3/users/f499544645494a74bfe020e282d7a2cc/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:20.674554 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbecd2e5-6cb5-4c35-a59f-2b5dae21c513 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4494cdebe59f4d948718e90135ae3cc3, user_id=f499544645494a74bfe020e282d7a2cc, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:20.677400 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbecd2e5-6cb5-4c35-a59f-2b5dae21c513 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:20.698674 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 882/1769] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:20 2022] PUT /identity/v3/projects/4494cdebe59f4d948718e90135ae3cc3/users/f499544645494a74bfe020e282d7a2cc/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:20.700132 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecd2e5-6cb5-4c35-a59f-2b5dae21c513 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:20.708897 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-cbecd2e5-6cb5-4c35-a59f-2b5dae21c513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:20.710808 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-b66711cd-fd0a-4fe8-b03f-6f0bc2226b02 None None] MFA Rules not processed for user `b470b4c2ca1a4d1a8a864789bf603d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:20.712897 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b66711cd-fd0a-4fe8-b03f-6f0bc2226b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:20.781961 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:20.819738 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecd2e5-6cb5-4c35-a59f-2b5dae21c513 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:20.822118 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 888/1770] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Jul 27 15:25:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:20.826580 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246534ef-6d73-4c1d-8dcf-69e7f4c9792a None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:20.828064 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246534ef-6d73-4c1d-8dcf-69e7f4c9792a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:20.828453 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246534ef-6d73-4c1d-8dcf-69e7f4c9792a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:20.863393 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a2155-18f1-4738-bb2e-c37fdcbbfd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:20.864407 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a2155-18f1-4738-bb2e-c37fdcbbfd49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:20.864857 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a2155-18f1-4738-bb2e-c37fdcbbfd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:20.865342 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a2155-18f1-4738-bb2e-c37fdcbbfd49 admin admin] PATH_INFO: `/v3/projects/a210f0e1c8e642ceb5b5b1ea4131c5be` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:20.867128 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a2155-18f1-4738-bb2e-c37fdcbbfd49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a210f0e1c8e642ceb5b5b1ea4131c5be)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:20.870419 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a2155-18f1-4738-bb2e-c37fdcbbfd49 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:20.908830 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-246534ef-6d73-4c1d-8dcf-69e7f4c9792a None None] MFA Rules not processed for user `f499544645494a74bfe020e282d7a2cc`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:20.911351 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-246534ef-6d73-4c1d-8dcf-69e7f4c9792a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:20.942864 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-448a2155-18f1-4738-bb2e-c37fdcbbfd49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a210f0e1c8e642ceb5b5b1ea4131c5be', 'request_id': 'req-448a2155-18f1-4738-bb2e-c37fdcbbfd49'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:20.958421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:20.962831 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-448a2155-18f1-4738-bb2e-c37fdcbbfd49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a210f0e1c8e642ceb5b5b1ea4131c5be', 'request_id': 'req-448a2155-18f1-4738-bb2e-c37fdcbbfd49'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:20.972532 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-448a2155-18f1-4738-bb2e-c37fdcbbfd49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a210f0e1c8e642ceb5b5b1ea4131c5be', 'request_id': 'req-448a2155-18f1-4738-bb2e-c37fdcbbfd49'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:20.996638 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-448a2155-18f1-4738-bb2e-c37fdcbbfd49 admin admin] The token cache is being invalidate because project a210f0e1c8e642ceb5b5b1ea4131c5be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:25:20.997572 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-448a2155-18f1-4738-bb2e-c37fdcbbfd49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:20.998819 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-448a2155-18f1-4738-bb2e-c37fdcbbfd49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:21.004029 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 883/1771] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:25:20 2022] DELETE /identity/v3/projects/a210f0e1c8e642ceb5b5b1ea4131c5be => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:21.010220 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a0a4f-8e59-4504-876f-a1e27c4647ce None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:21.010984 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a0a4f-8e59-4504-876f-a1e27c4647ce None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:21.013164 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a0a4f-8e59-4504-876f-a1e27c4647ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:21.051434 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-559a0a4f-8e59-4504-876f-a1e27c4647ce None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:21.053938 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-559a0a4f-8e59-4504-876f-a1e27c4647ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:21.088897 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 889/1772] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:21.092704 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246534ef-6d73-4c1d-8dcf-69e7f4c9792a None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:21.095932 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-246534ef-6d73-4c1d-8dcf-69e7f4c9792a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:21.238688 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 884/1773] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:25:21.240105 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a0a4f-8e59-4504-876f-a1e27c4647ce None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:21.242783 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-559a0a4f-8e59-4504-876f-a1e27c4647ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:21.269442 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a0a4f-8e59-4504-876f-a1e27c4647ce None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:21.281512 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3c94cd-cbea-4269-b50f-160df4768e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:21.282161 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c94cd-cbea-4269-b50f-160df4768e1b admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:21.282587 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c94cd-cbea-4269-b50f-160df4768e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:21.283366 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3c94cd-cbea-4269-b50f-160df4768e1b admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:21.283893 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c94cd-cbea-4269-b50f-160df4768e1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:21.288880 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3c94cd-cbea-4269-b50f-160df4768e1b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:21.300813 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246534ef-6d73-4c1d-8dcf-69e7f4c9792a None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:21.357099 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 885/1774] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:25:21 2022] POST /identity/v3/projects => generated 387 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:21.359526 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f177b43-c512-402b-ad3a-370d871464b1 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:21.360315 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f177b43-c512-402b-ad3a-370d871464b1 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:21.360994 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f177b43-c512-402b-ad3a-370d871464b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:21.400932 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-2f177b43-c512-402b-ad3a-370d871464b1 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:21.406636 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2f177b43-c512-402b-ad3a-370d871464b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:21.446880 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e9f6e-71d9-4cba-9f4b-2d12e58af759 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68bbf8bb59a84829afacd9677c9639a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:21.450851 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e9f6e-71d9-4cba-9f4b-2d12e58af759 service swift] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:21.452737 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e9f6e-71d9-4cba-9f4b-2d12e58af759 service swift] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:21.454067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04e9f6e-71d9-4cba-9f4b-2d12e58af759 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:21.457178 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e04e9f6e-71d9-4cba-9f4b-2d12e58af759 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:21.513020 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:21.550468 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:21.580787 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e9f6e-71d9-4cba-9f4b-2d12e58af759 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:21.584476 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04e9f6e-71d9-4cba-9f4b-2d12e58af759 service swift] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:21.602276 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 890/1775] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Jul 27 15:25:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 15:25:21.613017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e9f6e-71d9-4cba-9f4b-2d12e58af759 service swift] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:21.619349 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 886/1776] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:21.623283 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f177b43-c512-402b-ad3a-370d871464b1 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:21.645192 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04e9f6e-71d9-4cba-9f4b-2d12e58af759 service swift] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:21.654544 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a0373-29a0-4fdb-afa6-1284f338bca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:21.655841 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a0373-29a0-4fdb-afa6-1284f338bca1 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:21.656341 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a0373-29a0-4fdb-afa6-1284f338bca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:21.656761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a0373-29a0-4fdb-afa6-1284f338bca1 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:21.658342 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a0373-29a0-4fdb-afa6-1284f338bca1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:21.661983 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365a0373-29a0-4fdb-afa6-1284f338bca1 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:21.671795 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f177b43-c512-402b-ad3a-370d871464b1 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:21.701263 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011afa5-12f9-40c1-9bcb-c6a608bade0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:21.702049 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011afa5-12f9-40c1-9bcb-c6a608bade0b admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:21.702176 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011afa5-12f9-40c1-9bcb-c6a608bade0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:21.702458 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011afa5-12f9-40c1-9bcb-c6a608bade0b admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:21.706976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011afa5-12f9-40c1-9bcb-c6a608bade0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:25:21.707338 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011afa5-12f9-40c1-9bcb-c6a608bade0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:21.714156 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011afa5-12f9-40c1-9bcb-c6a608bade0b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:21.740614 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 891/1777] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:25:21 2022] POST /identity/v3/users => generated 300 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:21.750142 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98577d66-428b-4215-9997-e64658125a1f None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:21.750563 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98577d66-428b-4215-9997-e64658125a1f None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:21.750952 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98577d66-428b-4215-9997-e64658125a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:21.772539 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 887/1778] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:25:21.774563 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011afa5-12f9-40c1-9bcb-c6a608bade0b admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:21.820649 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011afa5-12f9-40c1-9bcb-c6a608bade0b admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:21.837826 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613c9a3-cd0f-415d-ab3d-fde2add08eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:21.838763 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613c9a3-cd0f-415d-ab3d-fde2add08eb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:21.838763 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613c9a3-cd0f-415d-ab3d-fde2add08eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:21.839050 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613c9a3-cd0f-415d-ab3d-fde2add08eb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:21.840475 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c613c9a3-cd0f-415d-ab3d-fde2add08eb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:21.842849 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c613c9a3-cd0f-415d-ab3d-fde2add08eb7 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:21.875270 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 888/1779] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:21.875270 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613c9a3-cd0f-415d-ab3d-fde2add08eb7 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:21.909904 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613c9a3-cd0f-415d-ab3d-fde2add08eb7 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:21.912978 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-98577d66-428b-4215-9997-e64658125a1f None None] MFA Rules not processed for user `c77a01fed0e741288f05941fe5670a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:21.927117 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db9d14-8346-4cfc-8abc-01277e14301b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:21.927971 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db9d14-8346-4cfc-8abc-01277e14301b admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:21.928299 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db9d14-8346-4cfc-8abc-01277e14301b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:21.928702 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db9d14-8346-4cfc-8abc-01277e14301b admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:21.929400 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db9d14-8346-4cfc-8abc-01277e14301b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:21.929514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-98577d66-428b-4215-9997-e64658125a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:21.931335 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db9d14-8346-4cfc-8abc-01277e14301b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:22.030002 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 889/1780] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:25:21 2022] POST /identity/v3/projects => generated 379 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:22.031009 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db9d14-8346-4cfc-8abc-01277e14301b admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:22.084511 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 892/1781] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:21 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 343 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:22.086460 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98577d66-428b-4215-9997-e64658125a1f None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:22.114061 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98577d66-428b-4215-9997-e64658125a1f None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:22.263404 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db9d14-8346-4cfc-8abc-01277e14301b admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:22.269035 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626741a-7413-4125-a039-16360a3fc74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:22.269815 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626741a-7413-4125-a039-16360a3fc74e admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:22.270155 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626741a-7413-4125-a039-16360a3fc74e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:22.270605 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626741a-7413-4125-a039-16360a3fc74e admin admin] PATH_INFO: `/v3/projects/b75a9edc8b49455a8a2b65bab7e701e6/users/3db5867e16d842499ec4ed837d10270a/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:22.303332 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626741a-7413-4125-a039-16360a3fc74e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b75a9edc8b49455a8a2b65bab7e701e6, user_id=3db5867e16d842499ec4ed837d10270a, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:22.307008 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626741a-7413-4125-a039-16360a3fc74e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:22.377515 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35032695-5189-4edb-9964-59b6e9cf3638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:22.381660 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35032695-5189-4edb-9964-59b6e9cf3638 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:22.385133 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35032695-5189-4edb-9964-59b6e9cf3638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:22.385133 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35032695-5189-4edb-9964-59b6e9cf3638 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:22.387771 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 890/1782] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:22 2022] PUT /identity/v3/projects/b75a9edc8b49455a8a2b65bab7e701e6/users/3db5867e16d842499ec4ed837d10270a/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:22.388666 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35032695-5189-4edb-9964-59b6e9cf3638 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:22.392001 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626741a-7413-4125-a039-16360a3fc74e admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:22.400886 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35032695-5189-4edb-9964-59b6e9cf3638 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:22.513242 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 893/1783] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:25:22 2022] POST /identity/v3/users => generated 290 bytes in 427 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:22.515919 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35032695-5189-4edb-9964-59b6e9cf3638 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:22.581996 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35032695-5189-4edb-9964-59b6e9cf3638 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:22.701052 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626741a-7413-4125-a039-16360a3fc74e admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:22.747488 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f56be-583a-4de0-92a5-3300e8788d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:22.748145 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f56be-583a-4de0-92a5-3300e8788d12 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:22.748432 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f56be-583a-4de0-92a5-3300e8788d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:22.748706 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f56be-583a-4de0-92a5-3300e8788d12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:22.749427 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f56be-583a-4de0-92a5-3300e8788d12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:22.755815 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f56be-583a-4de0-92a5-3300e8788d12 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:22.789564 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 891/1784] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:22.795550 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f56be-583a-4de0-92a5-3300e8788d12 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:22.809475 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f21f56be-583a-4de0-92a5-3300e8788d12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:22.846597 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f56be-583a-4de0-92a5-3300e8788d12 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:22.847802 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d185ef8-b64e-44de-acb8-0f2491262d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:22.848481 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d185ef8-b64e-44de-acb8-0f2491262d0d admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:22.848772 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d185ef8-b64e-44de-acb8-0f2491262d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:22.849036 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d185ef8-b64e-44de-acb8-0f2491262d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:22.849751 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d185ef8-b64e-44de-acb8-0f2491262d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:22.851378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d185ef8-b64e-44de-acb8-0f2491262d0d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:22.860625 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:22.871567 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e3810-2b58-40f8-9323-3173494d6b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:22.872272 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e3810-2b58-40f8-9323-3173494d6b32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:22.872537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e3810-2b58-40f8-9323-3173494d6b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:22.872816 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e3810-2b58-40f8-9323-3173494d6b32 admin admin] PATH_INFO: `/v3/projects/c53b5c4e5b5a4fcd993ed3cd5b219bb9` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:22.876590 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e3810-2b58-40f8-9323-3173494d6b32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c53b5c4e5b5a4fcd993ed3cd5b219bb9)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:22.884696 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e3810-2b58-40f8-9323-3173494d6b32 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:22.890707 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 894/1785] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:22.890707 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d185ef8-b64e-44de-acb8-0f2491262d0d admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:22.894052 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:22.918009 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d185ef8-b64e-44de-acb8-0f2491262d0d admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:22.931457 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf2a8ec-c28b-4d82-a02b-c89a4c566808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:22.932179 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2a8ec-c28b-4d82-a02b-c89a4c566808 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:22.933261 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2a8ec-c28b-4d82-a02b-c89a4c566808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:22.933613 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf2a8ec-c28b-4d82-a02b-c89a4c566808 admin admin] PATH_INFO: `/v3/projects/b75a9edc8b49455a8a2b65bab7e701e6/users/3db5867e16d842499ec4ed837d10270a/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:22.939530 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf2a8ec-c28b-4d82-a02b-c89a4c566808 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b75a9edc8b49455a8a2b65bab7e701e6, user_id=3db5867e16d842499ec4ed837d10270a, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:22.943119 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf2a8ec-c28b-4d82-a02b-c89a4c566808 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:22.971363 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 895/1786] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:22 2022] PUT /identity/v3/projects/b75a9edc8b49455a8a2b65bab7e701e6/users/3db5867e16d842499ec4ed837d10270a/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:22.972295 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf2a8ec-c28b-4d82-a02b-c89a4c566808 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:22.998591 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-418e3810-2b58-40f8-9323-3173494d6b32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c53b5c4e5b5a4fcd993ed3cd5b219bb9', 'request_id': 'req-418e3810-2b58-40f8-9323-3173494d6b32'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:23.015172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-418e3810-2b58-40f8-9323-3173494d6b32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c53b5c4e5b5a4fcd993ed3cd5b219bb9', 'request_id': 'req-418e3810-2b58-40f8-9323-3173494d6b32'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:23.026577 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-418e3810-2b58-40f8-9323-3173494d6b32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c53b5c4e5b5a4fcd993ed3cd5b219bb9', 'request_id': 'req-418e3810-2b58-40f8-9323-3173494d6b32'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:23.062315 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-418e3810-2b58-40f8-9323-3173494d6b32 admin admin] The token cache is being invalidate because project c53b5c4e5b5a4fcd993ed3cd5b219bb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:25:23.064357 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-418e3810-2b58-40f8-9323-3173494d6b32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:23.067638 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-418e3810-2b58-40f8-9323-3173494d6b32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:23.079041 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 892/1787] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:25:22 2022] DELETE /identity/v3/projects/c53b5c4e5b5a4fcd993ed3cd5b219bb9 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:23.084382 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f72dca-bd82-4785-99be-d5286324f46b None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:23.085620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f72dca-bd82-4785-99be-d5286324f46b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:23.087268 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f72dca-bd82-4785-99be-d5286324f46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:23.169638 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-15f72dca-bd82-4785-99be-d5286324f46b None None] MFA Rules not processed for user `3db5867e16d842499ec4ed837d10270a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:23.170810 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-15f72dca-bd82-4785-99be-d5286324f46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:23.195685 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf2a8ec-c28b-4d82-a02b-c89a4c566808 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:23.489410 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c88f4d-7428-4100-85b8-a1bd4b823c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:23.493108 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c88f4d-7428-4100-85b8-a1bd4b823c19 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:23.493593 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c88f4d-7428-4100-85b8-a1bd4b823c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:23.494326 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c88f4d-7428-4100-85b8-a1bd4b823c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:23.495668 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c88f4d-7428-4100-85b8-a1bd4b823c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:23.504604 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c88f4d-7428-4100-85b8-a1bd4b823c19 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:23.551053 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 896/1788] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 574 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:23.551053 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c88f4d-7428-4100-85b8-a1bd4b823c19 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:23.556557 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-c8c88f4d-7428-4100-85b8-a1bd4b823c19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:23.585075 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 893/1789] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:23.596061 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f72dca-bd82-4785-99be-d5286324f46b None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:23.601287 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-15f72dca-bd82-4785-99be-d5286324f46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:23.613438 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c88f4d-7428-4100-85b8-a1bd4b823c19 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:23.639090 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9503ed4-97a2-44c7-90f6-d8548acaa40f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:23.639428 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f72dca-bd82-4785-99be-d5286324f46b None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:23.639760 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9503ed4-97a2-44c7-90f6-d8548acaa40f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:23.640161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9503ed4-97a2-44c7-90f6-d8548acaa40f admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:23.640450 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9503ed4-97a2-44c7-90f6-d8548acaa40f admin admin] PATH_INFO: `/v3/users/a1b0eb9d5b4142999a377a01be9798f4` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:23.642111 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9503ed4-97a2-44c7-90f6-d8548acaa40f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1b0eb9d5b4142999a377a01be9798f4)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:23.644587 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f06b9f-c6e5-49bb-9d93-c6cfa57b41f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:23.645464 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f06b9f-c6e5-49bb-9d93-c6cfa57b41f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:23.645842 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f06b9f-c6e5-49bb-9d93-c6cfa57b41f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:23.646281 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f06b9f-c6e5-49bb-9d93-c6cfa57b41f3 admin admin] PATH_INFO: `/v3/users/c3fe61268b664ff4bf2c8ffa50ae37f0` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:23.647321 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f06b9f-c6e5-49bb-9d93-c6cfa57b41f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3fe61268b664ff4bf2c8ffa50ae37f0)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:23.648111 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9503ed4-97a2-44c7-90f6-d8548acaa40f admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:23.681041 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f06b9f-c6e5-49bb-9d93-c6cfa57b41f3 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:23.804113 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f9503ed4-97a2-44c7-90f6-d8548acaa40f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1b0eb9d5b4142999a377a01be9798f4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:23.807599 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f9503ed4-97a2-44c7-90f6-d8548acaa40f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1b0eb9d5b4142999a377a01be9798f4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:23.853107 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f9503ed4-97a2-44c7-90f6-d8548acaa40f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1b0eb9d5b4142999a377a01be9798f4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:23.866417 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-12f06b9f-c6e5-49bb-9d93-c6cfa57b41f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3fe61268b664ff4bf2c8ffa50ae37f0'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:23.867703 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-12f06b9f-c6e5-49bb-9d93-c6cfa57b41f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3fe61268b664ff4bf2c8ffa50ae37f0'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:23.892635 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-12f06b9f-c6e5-49bb-9d93-c6cfa57b41f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3fe61268b664ff4bf2c8ffa50ae37f0'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:23.893994 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-12f06b9f-c6e5-49bb-9d93-c6cfa57b41f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3fe61268b664ff4bf2c8ffa50ae37f0'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:23.920810 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f9503ed4-97a2-44c7-90f6-d8548acaa40f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1b0eb9d5b4142999a377a01be9798f4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:23.928637 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:23.930872 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-12f06b9f-c6e5-49bb-9d93-c6cfa57b41f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3fe61268b664ff4bf2c8ffa50ae37f0'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:23.959238 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 894/1790] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:25:23 2022] DELETE /identity/v3/users/c3fe61268b664ff4bf2c8ffa50ae37f0 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:23.960424 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f06b9f-c6e5-49bb-9d93-c6cfa57b41f3 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:23.970106 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-12f06b9f-c6e5-49bb-9d93-c6cfa57b41f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:23.999420 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f9503ed4-97a2-44c7-90f6-d8548acaa40f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1b0eb9d5b4142999a377a01be9798f4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:24.007798 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:24.030164 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 897/1791] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:25:23 2022] DELETE /identity/v3/users/a1b0eb9d5b4142999a377a01be9798f4 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:24.031159 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9503ed4-97a2-44c7-90f6-d8548acaa40f admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:24.036792 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f9503ed4-97a2-44c7-90f6-d8548acaa40f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:24.158169 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9503ed4-97a2-44c7-90f6-d8548acaa40f admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:24.173060 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3747504-f8fc-468d-b472-ba350c083591 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:24.174514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3747504-f8fc-468d-b472-ba350c083591 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:24.174806 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3747504-f8fc-468d-b472-ba350c083591 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:24.176460 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3747504-f8fc-468d-b472-ba350c083591 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:24.179717 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a3747504-f8fc-468d-b472-ba350c083591 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:24.242751 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f06b9f-c6e5-49bb-9d93-c6cfa57b41f3 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:24.323133 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3747504-f8fc-468d-b472-ba350c083591 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:24.327437 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3747504-f8fc-468d-b472-ba350c083591 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:24.363045 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 898/1792] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:24.371182 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7106c-5163-496e-8da2-a25d4b4401a2 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:24.372526 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7106c-5163-496e-8da2-a25d4b4401a2 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:24.372816 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7106c-5163-496e-8da2-a25d4b4401a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:24.451233 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-06e7106c-5163-496e-8da2-a25d4b4401a2 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:24.453338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-06e7106c-5163-496e-8da2-a25d4b4401a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:24.469752 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1e682-2d4a-4f56-937a-54ccb0155fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:24.470441 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1e682-2d4a-4f56-937a-54ccb0155fd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:24.470656 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1e682-2d4a-4f56-937a-54ccb0155fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:24.470937 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1e682-2d4a-4f56-937a-54ccb0155fd0 admin admin] PATH_INFO: `/v3/projects/0822e5d1ae5f4a34ab832bb5111e81b0/users/f2bde016741340b98d9ecc1ab420c8b4/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:24.531568 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1e682-2d4a-4f56-937a-54ccb0155fd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0822e5d1ae5f4a34ab832bb5111e81b0, user_id=f2bde016741340b98d9ecc1ab420c8b4, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:24.538658 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1e682-2d4a-4f56-937a-54ccb0155fd0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:24.567805 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 899/1793] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:24.567805 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7106c-5163-496e-8da2-a25d4b4401a2 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:24.567805 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-06e7106c-5163-496e-8da2-a25d4b4401a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:24.574702 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 895/1794] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:23 2022] PUT /identity/v3/projects/0822e5d1ae5f4a34ab832bb5111e81b0/users/f2bde016741340b98d9ecc1ab420c8b4/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:24.585782 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f009cd5-6e7e-4a84-99e3-eb0673687a57 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:24.585978 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f009cd5-6e7e-4a84-99e3-eb0673687a57 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:24.586077 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f009cd5-6e7e-4a84-99e3-eb0673687a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:24.604107 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7106c-5163-496e-8da2-a25d4b4401a2 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:24.654798 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-7f009cd5-6e7e-4a84-99e3-eb0673687a57 None None] MFA Rules not processed for user `f2bde016741340b98d9ecc1ab420c8b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:24.657212 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7f009cd5-6e7e-4a84-99e3-eb0673687a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:24.661656 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:24.675021 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21bc7b-0feb-411f-8bd1-f1926fd7d1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:24.675836 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21bc7b-0feb-411f-8bd1-f1926fd7d1ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:24.676173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21bc7b-0feb-411f-8bd1-f1926fd7d1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:24.676454 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21bc7b-0feb-411f-8bd1-f1926fd7d1ce admin admin] PATH_INFO: `/v3/users/f499544645494a74bfe020e282d7a2cc` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:24.677950 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d21bc7b-0feb-411f-8bd1-f1926fd7d1ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=f499544645494a74bfe020e282d7a2cc)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:24.679880 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d21bc7b-0feb-411f-8bd1-f1926fd7d1ce admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:24.745767 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1d21bc7b-0feb-411f-8bd1-f1926fd7d1ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f499544645494a74bfe020e282d7a2cc'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:24.746865 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1d21bc7b-0feb-411f-8bd1-f1926fd7d1ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f499544645494a74bfe020e282d7a2cc'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:24.758895 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1d21bc7b-0feb-411f-8bd1-f1926fd7d1ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f499544645494a74bfe020e282d7a2cc'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:24.773378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1d21bc7b-0feb-411f-8bd1-f1926fd7d1ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f499544645494a74bfe020e282d7a2cc'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:24.809152 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1d21bc7b-0feb-411f-8bd1-f1926fd7d1ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f499544645494a74bfe020e282d7a2cc'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:24.825790 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 900/1795] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:25:24 2022] DELETE /identity/v3/users/f499544645494a74bfe020e282d7a2cc => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:24.827596 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21bc7b-0feb-411f-8bd1-f1926fd7d1ce admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:24.830098 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-1d21bc7b-0feb-411f-8bd1-f1926fd7d1ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:24.863982 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 896/1796] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:24 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:24.866105 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9f31f-939f-4d6b-9d0e-f83204752d2d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:24.868375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9f31f-939f-4d6b-9d0e-f83204752d2d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:24.869354 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba9f31f-939f-4d6b-9d0e-f83204752d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:24.965455 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-1ba9f31f-939f-4d6b-9d0e-f83204752d2d None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:24.968466 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1ba9f31f-939f-4d6b-9d0e-f83204752d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:24.991749 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:25.080909 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d21bc7b-0feb-411f-8bd1-f1926fd7d1ce admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:25.107400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a51ad2-169e-4462-99ca-69e5de80a066 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:25.108064 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a51ad2-169e-4462-99ca-69e5de80a066 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:25.108347 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a51ad2-169e-4462-99ca-69e5de80a066 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:25.108619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a51ad2-169e-4462-99ca-69e5de80a066 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:25.119422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-44a51ad2-169e-4462-99ca-69e5de80a066 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:25.236772 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 897/1797] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:25.236772 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9f31f-939f-4d6b-9d0e-f83204752d2d None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:25.247687 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1ba9f31f-939f-4d6b-9d0e-f83204752d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:25.319377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba9f31f-939f-4d6b-9d0e-f83204752d2d None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:25.353237 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f2a0f3-6237-4355-ab41-e3ae57150e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:25.353881 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2a0f3-6237-4355-ab41-e3ae57150e76 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:25.354163 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2a0f3-6237-4355-ab41-e3ae57150e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:25.354439 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f2a0f3-6237-4355-ab41-e3ae57150e76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:25.355176 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2a0f3-6237-4355-ab41-e3ae57150e76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:25.374471 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f2a0f3-6237-4355-ab41-e3ae57150e76 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:25.425194 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a51ad2-169e-4462-99ca-69e5de80a066 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:25.426655 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a51ad2-169e-4462-99ca-69e5de80a066 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:25.494202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 901/1798] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:25.504876 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a51ad2-169e-4462-99ca-69e5de80a066 service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:25.523281 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 898/1799] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:25:25 2022] POST /identity/v3/projects => generated 377 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:25.524715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c143ef-5410-4a99-a64b-52ed709c4ee8 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:25.524981 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c143ef-5410-4a99-a64b-52ed709c4ee8 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:25.525258 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c143ef-5410-4a99-a64b-52ed709c4ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:25.536329 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a51ad2-169e-4462-99ca-69e5de80a066 service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:25.623865 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:25.626285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-59c143ef-5410-4a99-a64b-52ed709c4ee8 None None] MFA Rules not processed for user `227dac1eaefc4d0a8d3cc8a6dee2ecba`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:25.627838 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-59c143ef-5410-4a99-a64b-52ed709c4ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:25.694893 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8792f-35a3-4ccf-8ede-886960727093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:25.695813 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8792f-35a3-4ccf-8ede-886960727093 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:25.696262 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8792f-35a3-4ccf-8ede-886960727093 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:25.696674 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c8792f-35a3-4ccf-8ede-886960727093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:25.729906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 899/1800] 10.222.0.57 () {58 vars in 1015 bytes} [Wed Jul 27 15:25:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:25.730955 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c143ef-5410-4a99-a64b-52ed709c4ee8 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:25.837319 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c143ef-5410-4a99-a64b-52ed709c4ee8 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:25.843419 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f09aff-8e22-4a84-9cec-1c6f59b43b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:25.844360 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f09aff-8e22-4a84-9cec-1c6f59b43b57 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:25.844825 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f09aff-8e22-4a84-9cec-1c6f59b43b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:25.845650 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f09aff-8e22-4a84-9cec-1c6f59b43b57 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:25.846598 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f09aff-8e22-4a84-9cec-1c6f59b43b57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:25.848765 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f09aff-8e22-4a84-9cec-1c6f59b43b57 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:25.886999 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 900/1801] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:25:25 2022] POST /identity/v3/users => generated 295 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:25.893160 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f09aff-8e22-4a84-9cec-1c6f59b43b57 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:25.937924 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f09aff-8e22-4a84-9cec-1c6f59b43b57 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:25.938099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8792f-35a3-4ccf-8ede-886960727093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:25.942169 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c8792f-35a3-4ccf-8ede-886960727093 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:25.945246 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c8294-06cd-46c8-9301-2332a9ec09ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:25.946186 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c8294-06cd-46c8-9301-2332a9ec09ab admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:25.946477 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c8294-06cd-46c8-9301-2332a9ec09ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:25.946756 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9c8294-06cd-46c8-9301-2332a9ec09ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:25.947973 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c8294-06cd-46c8-9301-2332a9ec09ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:25.952329 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9c8294-06cd-46c8-9301-2332a9ec09ab admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:25.974521 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 901/1802] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:25.983870 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 902/1803] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:26.008959 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c8294-06cd-46c8-9301-2332a9ec09ab admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:26.034302 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9c8294-06cd-46c8-9301-2332a9ec09ab admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:26.058494 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143dd18e-0973-44c5-9223-4adbbb0b0b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:26.059487 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143dd18e-0973-44c5-9223-4adbbb0b0b8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:26.060316 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143dd18e-0973-44c5-9223-4adbbb0b0b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:26.060713 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143dd18e-0973-44c5-9223-4adbbb0b0b8d admin admin] PATH_INFO: `/v3/projects/c066b11e81bb498bb365de64cc4bb072/users/ef9d6e27ae6b48e9a1b559795e53efa0/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:26.110358 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:26.127944 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143dd18e-0973-44c5-9223-4adbbb0b0b8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c066b11e81bb498bb365de64cc4bb072, user_id=ef9d6e27ae6b48e9a1b559795e53efa0, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:26.131982 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143dd18e-0973-44c5-9223-4adbbb0b0b8d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:26.165068 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8792f-35a3-4ccf-8ede-886960727093 service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:26.167861 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-96c8792f-35a3-4ccf-8ede-886960727093 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:26.182769 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 902/1804] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:26 2022] PUT /identity/v3/projects/c066b11e81bb498bb365de64cc4bb072/users/ef9d6e27ae6b48e9a1b559795e53efa0/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:26.184664 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143dd18e-0973-44c5-9223-4adbbb0b0b8d admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:26.203757 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c8792f-35a3-4ccf-8ede-886960727093 service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:26.462713 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305c76d-48db-4f65-b471-b0f3906f55bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:26.463355 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305c76d-48db-4f65-b471-b0f3906f55bd service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:26.463633 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305c76d-48db-4f65-b471-b0f3906f55bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:26.463923 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4305c76d-48db-4f65-b471-b0f3906f55bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:26.488468 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4305c76d-48db-4f65-b471-b0f3906f55bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:26.490121 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4305c76d-48db-4f65-b471-b0f3906f55bd service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:26.518573 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143dd18e-0973-44c5-9223-4adbbb0b0b8d admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:26.525350 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 903/1805] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:26.526366 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305c76d-48db-4f65-b471-b0f3906f55bd service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:26.531076 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210f036-ddbd-4b2c-aa90-ade5cd3b27b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:26.531903 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210f036-ddbd-4b2c-aa90-ade5cd3b27b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:26.532372 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210f036-ddbd-4b2c-aa90-ade5cd3b27b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:26.532815 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4210f036-ddbd-4b2c-aa90-ade5cd3b27b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:26.541039 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210f036-ddbd-4b2c-aa90-ade5cd3b27b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:26.548893 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4210f036-ddbd-4b2c-aa90-ade5cd3b27b2 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:26.550263 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4305c76d-48db-4f65-b471-b0f3906f55bd service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:26.569664 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520e394d-ac1a-4402-b1c6-cdba5c615efd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:26.570307 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e394d-ac1a-4402-b1c6-cdba5c615efd service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:26.570591 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e394d-ac1a-4402-b1c6-cdba5c615efd service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:26.570861 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520e394d-ac1a-4402-b1c6-cdba5c615efd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:26.587812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 903/1806] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:26 2022] GET /identity/v3/roles => generated 1420 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:26.588939 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210f036-ddbd-4b2c-aa90-ade5cd3b27b2 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:26.609051 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e394d-ac1a-4402-b1c6-cdba5c615efd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:26.614693 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520e394d-ac1a-4402-b1c6-cdba5c615efd service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:26.622058 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4210f036-ddbd-4b2c-aa90-ade5cd3b27b2 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:26.636750 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8fed14-9d0f-4b84-aab2-ca72b9fe94de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:26.637836 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fed14-9d0f-4b84-aab2-ca72b9fe94de admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:26.638107 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fed14-9d0f-4b84-aab2-ca72b9fe94de admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:26.638564 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fed14-9d0f-4b84-aab2-ca72b9fe94de admin admin] PATH_INFO: `/v3/projects/c066b11e81bb498bb365de64cc4bb072/users/ef9d6e27ae6b48e9a1b559795e53efa0/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:26.642802 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8fed14-9d0f-4b84-aab2-ca72b9fe94de admin admin] RBAC: Authorizing `identity:create_grant(project_id=c066b11e81bb498bb365de64cc4bb072, user_id=ef9d6e27ae6b48e9a1b559795e53efa0, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:26.646405 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8fed14-9d0f-4b84-aab2-ca72b9fe94de admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:26.647706 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 904/1807] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:26.701371 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 904/1808] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:26 2022] PUT /identity/v3/projects/c066b11e81bb498bb365de64cc4bb072/users/ef9d6e27ae6b48e9a1b559795e53efa0/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:26.708395 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6859fd-dce4-42d0-ac1d-0af1fb442124 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:26.708675 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6859fd-dce4-42d0-ac1d-0af1fb442124 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:26.710350 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6859fd-dce4-42d0-ac1d-0af1fb442124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:26.831655 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-9c6859fd-dce4-42d0-ac1d-0af1fb442124 None None] MFA Rules not processed for user `ef9d6e27ae6b48e9a1b559795e53efa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:26.837505 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9c6859fd-dce4-42d0-ac1d-0af1fb442124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:26.993007 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:27.023594 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 905/1809] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:26 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:27.037632 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8fed14-9d0f-4b84-aab2-ca72b9fe94de admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:27.039549 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7a8fed14-9d0f-4b84-aab2-ca72b9fe94de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:27.330894 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8fed14-9d0f-4b84-aab2-ca72b9fe94de admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:27.343335 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e99817-17bf-4368-acea-eefe19e1e75d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:27.343335 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e99817-17bf-4368-acea-eefe19e1e75d service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:27.343335 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e99817-17bf-4368-acea-eefe19e1e75d service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:27.343335 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e99817-17bf-4368-acea-eefe19e1e75d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:27.534874 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e99817-17bf-4368-acea-eefe19e1e75d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:27.535948 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e99817-17bf-4368-acea-eefe19e1e75d service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:27.562774 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 905/1810] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:27 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 15:25:28.346015 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6859fd-dce4-42d0-ac1d-0af1fb442124 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:28.348850 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9c6859fd-dce4-42d0-ac1d-0af1fb442124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:28.786695 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6859fd-dce4-42d0-ac1d-0af1fb442124 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:28.801757 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c249e43f-375d-40bf-ab56-3ee68111fa32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:28.802433 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249e43f-375d-40bf-ab56-3ee68111fa32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:28.802718 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249e43f-375d-40bf-ab56-3ee68111fa32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:28.803000 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249e43f-375d-40bf-ab56-3ee68111fa32 admin admin] PATH_INFO: `/v3/projects/53509d9b868b4729b88da9eab37bf513` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:28.804763 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c249e43f-375d-40bf-ab56-3ee68111fa32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=53509d9b868b4729b88da9eab37bf513)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:28.816041 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c249e43f-375d-40bf-ab56-3ee68111fa32 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:28.922052 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-c249e43f-375d-40bf-ab56-3ee68111fa32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53509d9b868b4729b88da9eab37bf513', 'request_id': 'req-c249e43f-375d-40bf-ab56-3ee68111fa32'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:28.938203 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-c249e43f-375d-40bf-ab56-3ee68111fa32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53509d9b868b4729b88da9eab37bf513', 'request_id': 'req-c249e43f-375d-40bf-ab56-3ee68111fa32'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:28.953862 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-c249e43f-375d-40bf-ab56-3ee68111fa32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53509d9b868b4729b88da9eab37bf513', 'request_id': 'req-c249e43f-375d-40bf-ab56-3ee68111fa32'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:28.985291 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-c249e43f-375d-40bf-ab56-3ee68111fa32 admin admin] The token cache is being invalidate because project 53509d9b868b4729b88da9eab37bf513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:25:28.985633 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-c249e43f-375d-40bf-ab56-3ee68111fa32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:28.988767 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-c249e43f-375d-40bf-ab56-3ee68111fa32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:29.002604 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce294ce4-bbe1-4dca-833a-64014eef758f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:29.003173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 906/1811] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:25:28 2022] DELETE /identity/v3/projects/53509d9b868b4729b88da9eab37bf513 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:29.003635 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce294ce4-bbe1-4dca-833a-64014eef758f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:29.004273 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce294ce4-bbe1-4dca-833a-64014eef758f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:29.073051 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-ce294ce4-bbe1-4dca-833a-64014eef758f None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:29.075434 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ce294ce4-bbe1-4dca-833a-64014eef758f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:29.169213 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:29.296892 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 906/1812] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:29.306322 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7dddd-5f67-4f6d-b916-10b8897e078a None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:29.306617 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7dddd-5f67-4f6d-b916-10b8897e078a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:29.306901 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f7dddd-5f67-4f6d-b916-10b8897e078a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:29.349283 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-13f7dddd-5f67-4f6d-b916-10b8897e078a None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:29.350775 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-13f7dddd-5f67-4f6d-b916-10b8897e078a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:29.384826 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce294ce4-bbe1-4dca-833a-64014eef758f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:29.392729 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 907/1813] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:29.397102 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce294ce4-bbe1-4dca-833a-64014eef758f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:29.406984 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4465d0-7d67-4cbd-b5db-2e071208c8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:29.407648 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4465d0-7d67-4cbd-b5db-2e071208c8ff admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:29.407955 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4465d0-7d67-4cbd-b5db-2e071208c8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:29.408274 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4465d0-7d67-4cbd-b5db-2e071208c8ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:29.410458 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4465d0-7d67-4cbd-b5db-2e071208c8ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:25:29.410802 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4465d0-7d67-4cbd-b5db-2e071208c8ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:29.412518 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4465d0-7d67-4cbd-b5db-2e071208c8ff admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:29.451733 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7dddd-5f67-4f6d-b916-10b8897e078a None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:29.458338 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 907/1814] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:25:29.463230 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f7dddd-5f67-4f6d-b916-10b8897e078a None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:29.477983 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1faf8-7ac9-4fad-8aa4-f1a979f40428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:29.478629 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1faf8-7ac9-4fad-8aa4-f1a979f40428 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:29.478913 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1faf8-7ac9-4fad-8aa4-f1a979f40428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:29.479237 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1faf8-7ac9-4fad-8aa4-f1a979f40428 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:29.479957 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1faf8-7ac9-4fad-8aa4-f1a979f40428 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:29.481951 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1faf8-7ac9-4fad-8aa4-f1a979f40428 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:29.563409 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4465d0-7d67-4cbd-b5db-2e071208c8ff admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:29.577705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4465d0-7d67-4cbd-b5db-2e071208c8ff admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:29.578469 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 908/1815] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:25:29 2022] POST /identity/v3/projects => generated 365 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:29.694178 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1faf8-7ac9-4fad-8aa4-f1a979f40428 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:29.696503 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f8c1faf8-7ac9-4fad-8aa4-f1a979f40428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:29.748339 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e15db-8319-491a-9d56-f29580b06917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:29.749077 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e15db-8319-491a-9d56-f29580b06917 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:29.749489 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e15db-8319-491a-9d56-f29580b06917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:29.749776 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6e15db-8319-491a-9d56-f29580b06917 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:29.750457 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e15db-8319-491a-9d56-f29580b06917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:29.753877 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6e15db-8319-491a-9d56-f29580b06917 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:29.788042 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 908/1816] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:25:29 2022] POST /identity/v3/users => generated 283 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:25:29.790840 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e15db-8319-491a-9d56-f29580b06917 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:29.829956 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6e15db-8319-491a-9d56-f29580b06917 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:29.837731 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:29.847551 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b914b-59b4-455a-b8e0-95a89592f355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:29.851328 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b914b-59b4-455a-b8e0-95a89592f355 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:29.851829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b914b-59b4-455a-b8e0-95a89592f355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:29.853412 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44b914b-59b4-455a-b8e0-95a89592f355 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:29.854318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b914b-59b4-455a-b8e0-95a89592f355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:29.859608 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44b914b-59b4-455a-b8e0-95a89592f355 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:29.864160 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1faf8-7ac9-4fad-8aa4-f1a979f40428 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:29.880340 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f02fb-62f2-4146-94c0-3ca23934fcee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:29.881072 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f02fb-62f2-4146-94c0-3ca23934fcee service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:29.881433 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f02fb-62f2-4146-94c0-3ca23934fcee service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:29.881719 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f02fb-62f2-4146-94c0-3ca23934fcee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:29.896844 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 909/1817] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:29.900847 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b914b-59b4-455a-b8e0-95a89592f355 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:29.913563 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-421f02fb-62f2-4146-94c0-3ca23934fcee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:29.964591 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44b914b-59b4-455a-b8e0-95a89592f355 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:29.986244 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4ba13-226a-4eea-ae99-6797e6c09706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:29.989905 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4ba13-226a-4eea-ae99-6797e6c09706 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:29.991805 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4ba13-226a-4eea-ae99-6797e6c09706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:29.993349 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4ba13-226a-4eea-ae99-6797e6c09706 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:30.008631 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc4ba13-226a-4eea-ae99-6797e6c09706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:30.024736 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc4ba13-226a-4eea-ae99-6797e6c09706 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:30.073684 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 910/1818] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:30.078248 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4ba13-226a-4eea-ae99-6797e6c09706 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:30.144680 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4ba13-226a-4eea-ae99-6797e6c09706 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:30.172686 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f02fb-62f2-4146-94c0-3ca23934fcee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:30.174512 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f02fb-62f2-4146-94c0-3ca23934fcee service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:30.191579 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e2c6d-d2da-4c60-bb57-862f11e233d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:30.203700 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e2c6d-d2da-4c60-bb57-862f11e233d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:30.204014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e2c6d-d2da-4c60-bb57-862f11e233d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:30.208828 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e2c6d-d2da-4c60-bb57-862f11e233d1 admin admin] PATH_INFO: `/v3/projects/47c6f6415594464d92f680bb255c35c9/users/6fc81a9c94d646c2bf473bb220e58619/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:30.240041 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 909/1819] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:29 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:30.262565 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f02fb-62f2-4146-94c0-3ca23934fcee service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:30.264487 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-421f02fb-62f2-4146-94c0-3ca23934fcee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:30.306548 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e2c6d-d2da-4c60-bb57-862f11e233d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47c6f6415594464d92f680bb255c35c9, user_id=6fc81a9c94d646c2bf473bb220e58619, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:30.311243 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e2c6d-d2da-4c60-bb57-862f11e233d1 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:30.332802 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f02fb-62f2-4146-94c0-3ca23934fcee service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:30.342439 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8dbe1-2015-402e-9ab2-35df89b3ff65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:30.343732 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8dbe1-2015-402e-9ab2-35df89b3ff65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:30.344346 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8dbe1-2015-402e-9ab2-35df89b3ff65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:30.344766 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8dbe1-2015-402e-9ab2-35df89b3ff65 admin admin] PATH_INFO: `/v3/projects/04ecbc93bb7e4e49bf018a8bf154ba71` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:30.346602 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8dbe1-2015-402e-9ab2-35df89b3ff65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04ecbc93bb7e4e49bf018a8bf154ba71)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:30.349174 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8dbe1-2015-402e-9ab2-35df89b3ff65 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:30.380534 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 911/1820] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:30 2022] PUT /identity/v3/projects/47c6f6415594464d92f680bb255c35c9/users/6fc81a9c94d646c2bf473bb220e58619/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:30.389979 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44467d2b-c23f-4dba-8fa3-62e3dc891de2 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:30.390272 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44467d2b-c23f-4dba-8fa3-62e3dc891de2 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:30.392360 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44467d2b-c23f-4dba-8fa3-62e3dc891de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:30.473707 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-57a8dbe1-2015-402e-9ab2-35df89b3ff65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04ecbc93bb7e4e49bf018a8bf154ba71', 'request_id': 'req-57a8dbe1-2015-402e-9ab2-35df89b3ff65'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:30.483170 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-57a8dbe1-2015-402e-9ab2-35df89b3ff65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04ecbc93bb7e4e49bf018a8bf154ba71', 'request_id': 'req-57a8dbe1-2015-402e-9ab2-35df89b3ff65'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:30.491294 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-57a8dbe1-2015-402e-9ab2-35df89b3ff65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04ecbc93bb7e4e49bf018a8bf154ba71', 'request_id': 'req-57a8dbe1-2015-402e-9ab2-35df89b3ff65'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:30.512746 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-57a8dbe1-2015-402e-9ab2-35df89b3ff65 admin admin] The token cache is being invalidate because project 04ecbc93bb7e4e49bf018a8bf154ba71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:25:30.514461 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-57a8dbe1-2015-402e-9ab2-35df89b3ff65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:30.515478 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-57a8dbe1-2015-402e-9ab2-35df89b3ff65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:30.517752 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 910/1821] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:25:30 2022] DELETE /identity/v3/projects/04ecbc93bb7e4e49bf018a8bf154ba71 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:30.518024 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-44467d2b-c23f-4dba-8fa3-62e3dc891de2 None None] MFA Rules not processed for user `6fc81a9c94d646c2bf473bb220e58619`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:30.519499 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-44467d2b-c23f-4dba-8fa3-62e3dc891de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:30.524854 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8dbe1-2015-402e-9ab2-35df89b3ff65 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:30.529368 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-57a8dbe1-2015-402e-9ab2-35df89b3ff65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:30.740117 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8dbe1-2015-402e-9ab2-35df89b3ff65 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:30.757051 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:30.781114 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fe032-a3b5-486b-8a55-f4d95c4f152f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:30.783288 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fe032-a3b5-486b-8a55-f4d95c4f152f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:30.783626 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fe032-a3b5-486b-8a55-f4d95c4f152f admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:30.783903 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fe032-a3b5-486b-8a55-f4d95c4f152f admin admin] PATH_INFO: `/v3/users/8a0675770a104f98a0b41fb17afc28a7` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:30.784506 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 912/1822] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:30 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 395 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:30.787134 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fe032-a3b5-486b-8a55-f4d95c4f152f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a0675770a104f98a0b41fb17afc28a7)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:30.789085 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44467d2b-c23f-4dba-8fa3-62e3dc891de2 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:30.791260 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fe032-a3b5-486b-8a55-f4d95c4f152f admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:30.793912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-44467d2b-c23f-4dba-8fa3-62e3dc891de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:30.837537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44467d2b-c23f-4dba-8fa3-62e3dc891de2 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:30.857814 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:30.861120 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7441362-68c0-423c-be31-ff807f5a5bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:30.862009 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7441362-68c0-423c-be31-ff807f5a5bee admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:30.862554 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7441362-68c0-423c-be31-ff807f5a5bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:30.862554 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7441362-68c0-423c-be31-ff807f5a5bee admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:30.863260 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7441362-68c0-423c-be31-ff807f5a5bee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:30.865382 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7441362-68c0-423c-be31-ff807f5a5bee admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:30.900435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-3c8fe032-a3b5-486b-8a55-f4d95c4f152f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a0675770a104f98a0b41fb17afc28a7'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:30.901430 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-3c8fe032-a3b5-486b-8a55-f4d95c4f152f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a0675770a104f98a0b41fb17afc28a7'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:30.913807 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-3c8fe032-a3b5-486b-8a55-f4d95c4f152f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a0675770a104f98a0b41fb17afc28a7'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:30.945616 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 913/1823] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:25:30 2022] POST /identity/v3/projects => generated 365 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:30.946175 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-3c8fe032-a3b5-486b-8a55-f4d95c4f152f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a0675770a104f98a0b41fb17afc28a7'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:30.948422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7441362-68c0-423c-be31-ff807f5a5bee admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:30.990831 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-3c8fe032-a3b5-486b-8a55-f4d95c4f152f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a0675770a104f98a0b41fb17afc28a7'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:31.001639 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 911/1824] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:25:30 2022] DELETE /identity/v3/users/8a0675770a104f98a0b41fb17afc28a7 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:31.133044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7441362-68c0-423c-be31-ff807f5a5bee admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:31.290418 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335456e-0783-4a9c-bd6a-85c664f274c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:31.296908 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335456e-0783-4a9c-bd6a-85c664f274c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:31.299392 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335456e-0783-4a9c-bd6a-85c664f274c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:31.300249 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e335456e-0783-4a9c-bd6a-85c664f274c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:31.301219 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335456e-0783-4a9c-bd6a-85c664f274c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:31.303335 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e335456e-0783-4a9c-bd6a-85c664f274c3 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:31.367360 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 914/1825] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:25:30 2022] POST /identity/v3/users => generated 289 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:31.373289 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fe032-a3b5-486b-8a55-f4d95c4f152f admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:31.374892 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-3c8fe032-a3b5-486b-8a55-f4d95c4f152f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:31.405742 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fe032-a3b5-486b-8a55-f4d95c4f152f admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:31.410709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489c3b8-630a-4260-91e9-1d88bf466a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:31.411365 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489c3b8-630a-4260-91e9-1d88bf466a43 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:31.411643 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489c3b8-630a-4260-91e9-1d88bf466a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:31.411914 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489c3b8-630a-4260-91e9-1d88bf466a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:31.412677 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489c3b8-630a-4260-91e9-1d88bf466a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:31.414391 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489c3b8-630a-4260-91e9-1d88bf466a43 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:31.436037 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 912/1826] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:31.437827 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335456e-0783-4a9c-bd6a-85c664f274c3 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:31.453384 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e335456e-0783-4a9c-bd6a-85c664f274c3 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:31.464518 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868a1b9b-32f8-410f-9e31-fec8d44dbbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:31.465228 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a1b9b-32f8-410f-9e31-fec8d44dbbef admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:31.465514 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a1b9b-32f8-410f-9e31-fec8d44dbbef admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:31.465890 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868a1b9b-32f8-410f-9e31-fec8d44dbbef admin admin] PATH_INFO: `/v3/projects/e3b32e023fcd43b5895ad59d83f57837/users/1b796c6a977d47adb046be1359cae122/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:31.498207 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a1b9b-32f8-410f-9e31-fec8d44dbbef admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3b32e023fcd43b5895ad59d83f57837, user_id=1b796c6a977d47adb046be1359cae122, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:31.501609 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868a1b9b-32f8-410f-9e31-fec8d44dbbef admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:31.523905 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 915/1827] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:31 2022] PUT /identity/v3/projects/e3b32e023fcd43b5895ad59d83f57837/users/1b796c6a977d47adb046be1359cae122/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:31.527862 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489c3b8-630a-4260-91e9-1d88bf466a43 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:31.546581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489c3b8-630a-4260-91e9-1d88bf466a43 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:31.565954 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3ddaa-c7f9-4892-9eae-9e397505c683 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:31.566347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3ddaa-c7f9-4892-9eae-9e397505c683 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:31.566800 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e3ddaa-c7f9-4892-9eae-9e397505c683 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:31.569610 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 916/1828] 10.222.0.40 () {54 vars in 921 bytes} [Wed Jul 27 15:25:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:25:31.664018 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27238b26-0d44-4c42-a8eb-49581ed1e5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:31.665206 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27238b26-0d44-4c42-a8eb-49581ed1e5ec admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:31.665633 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27238b26-0d44-4c42-a8eb-49581ed1e5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:31.666064 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27238b26-0d44-4c42-a8eb-49581ed1e5ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:31.667951 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27238b26-0d44-4c42-a8eb-49581ed1e5ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:31.670024 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27238b26-0d44-4c42-a8eb-49581ed1e5ec admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:31.684672 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 913/1829] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:31.688684 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3ddaa-c7f9-4892-9eae-9e397505c683 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:31.728394 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e3ddaa-c7f9-4892-9eae-9e397505c683 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:31.749713 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe836d09-3825-435f-b1a6-0160bbea6ff8 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:31.750273 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe836d09-3825-435f-b1a6-0160bbea6ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:31.750716 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe836d09-3825-435f-b1a6-0160bbea6ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:31.752699 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962cf50-63d1-4b4b-affc-7af2930a5dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:31.758050 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962cf50-63d1-4b4b-affc-7af2930a5dac admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:31.758368 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962cf50-63d1-4b4b-affc-7af2930a5dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:31.758675 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962cf50-63d1-4b4b-affc-7af2930a5dac admin admin] PATH_INFO: `/v3/projects/e3b32e023fcd43b5895ad59d83f57837/users/1b796c6a977d47adb046be1359cae122/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:31.766349 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962cf50-63d1-4b4b-affc-7af2930a5dac admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3b32e023fcd43b5895ad59d83f57837, user_id=1b796c6a977d47adb046be1359cae122, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:31.772139 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962cf50-63d1-4b4b-affc-7af2930a5dac admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:31.803388 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-fe836d09-3825-435f-b1a6-0160bbea6ff8 None None] MFA Rules not processed for user `d3e01aa0ef1340cbba7170bac4a82783`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:31.804629 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-fe836d09-3825-435f-b1a6-0160bbea6ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:31.829445 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 917/1830] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:31 2022] PUT /identity/v3/projects/e3b32e023fcd43b5895ad59d83f57837/users/1b796c6a977d47adb046be1359cae122/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:31.841824 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962cf50-63d1-4b4b-affc-7af2930a5dac admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:31.851894 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8962cf50-63d1-4b4b-affc-7af2930a5dac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:31.919089 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:31.967267 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962cf50-63d1-4b4b-affc-7af2930a5dac admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:31.974309 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46d103-9ad4-48ab-a04b-fcb119a877a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:31.975087 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46d103-9ad4-48ab-a04b-fcb119a877a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:31.975949 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46d103-9ad4-48ab-a04b-fcb119a877a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:31.976637 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46d103-9ad4-48ab-a04b-fcb119a877a1 admin admin] PATH_INFO: `/v3/projects/4494cdebe59f4d948718e90135ae3cc3` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:31.978741 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46d103-9ad4-48ab-a04b-fcb119a877a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4494cdebe59f4d948718e90135ae3cc3)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:31.981887 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46d103-9ad4-48ab-a04b-fcb119a877a1 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:31.993905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 914/1831] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Jul 27 15:25:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:31.994832 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c67045-264f-471d-ab79-7efafe5ed8da None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:31.995125 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c67045-264f-471d-ab79-7efafe5ed8da None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:31.995474 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c67045-264f-471d-ab79-7efafe5ed8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:32.088747 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-83c67045-264f-471d-ab79-7efafe5ed8da None None] MFA Rules not processed for user `1b796c6a977d47adb046be1359cae122`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:32.092525 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-83c67045-264f-471d-ab79-7efafe5ed8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:32.111746 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:32.125283 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4d46d103-9ad4-48ab-a04b-fcb119a877a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4494cdebe59f4d948718e90135ae3cc3', 'request_id': 'req-4d46d103-9ad4-48ab-a04b-fcb119a877a1'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:32.142722 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4d46d103-9ad4-48ab-a04b-fcb119a877a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4494cdebe59f4d948718e90135ae3cc3', 'request_id': 'req-4d46d103-9ad4-48ab-a04b-fcb119a877a1'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:32.157592 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4d46d103-9ad4-48ab-a04b-fcb119a877a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4494cdebe59f4d948718e90135ae3cc3', 'request_id': 'req-4d46d103-9ad4-48ab-a04b-fcb119a877a1'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:32.206549 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4d46d103-9ad4-48ab-a04b-fcb119a877a1 admin admin] The token cache is being invalidate because project 4494cdebe59f4d948718e90135ae3cc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:25:32.206938 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4d46d103-9ad4-48ab-a04b-fcb119a877a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:32.210581 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4d46d103-9ad4-48ab-a04b-fcb119a877a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:32.220721 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 918/1832] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:25:31 2022] DELETE /identity/v3/projects/4494cdebe59f4d948718e90135ae3cc3 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:32.224720 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46d103-9ad4-48ab-a04b-fcb119a877a1 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:32.230798 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 915/1833] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:31 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:32.241253 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4d46d103-9ad4-48ab-a04b-fcb119a877a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:32.243920 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c67045-264f-471d-ab79-7efafe5ed8da None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:32.245931 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-83c67045-264f-471d-ab79-7efafe5ed8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:32.318428 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c67045-264f-471d-ab79-7efafe5ed8da None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:32.323446 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b185f4-a8c6-4574-b50f-f66c96e14f47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:32.324377 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b185f4-a8c6-4574-b50f-f66c96e14f47 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:32.324767 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b185f4-a8c6-4574-b50f-f66c96e14f47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:32.325230 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b185f4-a8c6-4574-b50f-f66c96e14f47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:32.338026 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b185f4-a8c6-4574-b50f-f66c96e14f47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:32.340288 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b185f4-a8c6-4574-b50f-f66c96e14f47 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:32.367174 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 916/1834] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:32 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 15:25:32.544375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46d103-9ad4-48ab-a04b-fcb119a877a1 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:32.575864 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90d379-3d86-4e87-8e60-08995b0dd1fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:32.576490 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90d379-3d86-4e87-8e60-08995b0dd1fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:32.576927 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90d379-3d86-4e87-8e60-08995b0dd1fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:32.577044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90d379-3d86-4e87-8e60-08995b0dd1fe admin admin] PATH_INFO: `/v3/users/3db5867e16d842499ec4ed837d10270a` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:32.578374 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90d379-3d86-4e87-8e60-08995b0dd1fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=3db5867e16d842499ec4ed837d10270a)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:32.580380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90d379-3d86-4e87-8e60-08995b0dd1fe admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:32.772380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ff90d379-3d86-4e87-8e60-08995b0dd1fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3db5867e16d842499ec4ed837d10270a'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:32.785439 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ff90d379-3d86-4e87-8e60-08995b0dd1fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3db5867e16d842499ec4ed837d10270a'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:32.814070 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ff90d379-3d86-4e87-8e60-08995b0dd1fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3db5867e16d842499ec4ed837d10270a'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:32.820454 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ff90d379-3d86-4e87-8e60-08995b0dd1fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3db5867e16d842499ec4ed837d10270a'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:32.823078 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:32.874362 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ff90d379-3d86-4e87-8e60-08995b0dd1fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3db5867e16d842499ec4ed837d10270a'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:32.888452 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b185f4-a8c6-4574-b50f-f66c96e14f47 service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:32.890022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-30b185f4-a8c6-4574-b50f-f66c96e14f47 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:32.907768 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 919/1835] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:25:32 2022] DELETE /identity/v3/users/3db5867e16d842499ec4ed837d10270a => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:25:33.084338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b185f4-a8c6-4574-b50f-f66c96e14f47 service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:33.166977 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:33.204789 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035da7c-9189-40e1-be13-a28f676d93f8 None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:33.205367 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035da7c-9189-40e1-be13-a28f676d93f8 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:33.205367 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035da7c-9189-40e1-be13-a28f676d93f8 None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:33.206692 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 920/1836] 10.222.0.40 () {54 vars in 921 bytes} [Wed Jul 27 15:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:25:33.215511 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035da7c-9189-40e1-be13-a28f676d93f8 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:33.217737 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9035da7c-9189-40e1-be13-a28f676d93f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:33.221698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c1545-b17a-4308-9877-e8b0919db296 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:33.222548 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c1545-b17a-4308-9877-e8b0919db296 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:33.222942 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c1545-b17a-4308-9877-e8b0919db296 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:33.224456 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c1545-b17a-4308-9877-e8b0919db296 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:33.226811 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-792c1545-b17a-4308-9877-e8b0919db296 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:33.246793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c1545-b17a-4308-9877-e8b0919db296 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:33.248936 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c1545-b17a-4308-9877-e8b0919db296 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:33.314050 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 917/1837] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:33.395646 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035da7c-9189-40e1-be13-a28f676d93f8 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:33.405225 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f630969-ac20-46fa-9859-e6012937db3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:33.406218 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f630969-ac20-46fa-9859-e6012937db3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:33.406950 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f630969-ac20-46fa-9859-e6012937db3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:33.406950 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f630969-ac20-46fa-9859-e6012937db3c admin admin] PATH_INFO: `/v3/users/6fc81a9c94d646c2bf473bb220e58619` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:33.408315 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f630969-ac20-46fa-9859-e6012937db3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fc81a9c94d646c2bf473bb220e58619)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:33.410752 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f630969-ac20-46fa-9859-e6012937db3c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:33.470557 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2773fff-4523-41e7-92e3-c49474f70d70 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:33.471449 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2773fff-4523-41e7-92e3-c49474f70d70 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:33.471449 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2773fff-4523-41e7-92e3-c49474f70d70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:33.516255 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-d2773fff-4523-41e7-92e3-c49474f70d70 None None] MFA Rules not processed for user `d3e01aa0ef1340cbba7170bac4a82783`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:33.518551 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d2773fff-4523-41e7-92e3-c49474f70d70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:33.531393 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4f630969-ac20-46fa-9859-e6012937db3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fc81a9c94d646c2bf473bb220e58619'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:33.536922 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4f630969-ac20-46fa-9859-e6012937db3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fc81a9c94d646c2bf473bb220e58619'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:33.549838 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 918/1838] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Jul 27 15:25:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:33.556322 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4f630969-ac20-46fa-9859-e6012937db3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fc81a9c94d646c2bf473bb220e58619'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:33.559417 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4f630969-ac20-46fa-9859-e6012937db3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fc81a9c94d646c2bf473bb220e58619'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:33.616312 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4f630969-ac20-46fa-9859-e6012937db3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fc81a9c94d646c2bf473bb220e58619'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:33.638360 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 921/1839] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:25:33 2022] DELETE /identity/v3/users/6fc81a9c94d646c2bf473bb220e58619 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:25:33.642894 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e697c-9063-4708-80e2-950ff3c49eab None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:33.643518 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e697c-9063-4708-80e2-950ff3c49eab None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:33.644386 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8e697c-9063-4708-80e2-950ff3c49eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:33.676235 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-4f8e697c-9063-4708-80e2-950ff3c49eab None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:33.677934 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-4f8e697c-9063-4708-80e2-950ff3c49eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:33.939432 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 919/1840] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:25:34.026165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f630969-ac20-46fa-9859-e6012937db3c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:34.028035 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4f630969-ac20-46fa-9859-e6012937db3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:34.278706 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f630969-ac20-46fa-9859-e6012937db3c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:34.301140 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf2956-91ae-4a82-9591-fd274c4cb70b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:34.302699 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf2956-91ae-4a82-9591-fd274c4cb70b service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:34.303949 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf2956-91ae-4a82-9591-fd274c4cb70b service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:34.307044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bf2956-91ae-4a82-9591-fd274c4cb70b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:34.336145 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf2956-91ae-4a82-9591-fd274c4cb70b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:34.341769 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bf2956-91ae-4a82-9591-fd274c4cb70b service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:34.360598 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:34.381601 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 922/1841] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:34.724721 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e697c-9063-4708-80e2-950ff3c49eab None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:34.731355 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-4f8e697c-9063-4708-80e2-950ff3c49eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:34.902706 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8e697c-9063-4708-80e2-950ff3c49eab None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:34.912645 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8d9db-e15e-49d1-827c-736b60bb3431 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:34.913487 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8d9db-e15e-49d1-827c-736b60bb3431 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:34.914201 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8d9db-e15e-49d1-827c-736b60bb3431 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:34.914654 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8d9db-e15e-49d1-827c-736b60bb3431 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:34.919481 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-30b8d9db-e15e-49d1-827c-736b60bb3431 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:34.937194 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8d9db-e15e-49d1-827c-736b60bb3431 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:34.939070 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8d9db-e15e-49d1-827c-736b60bb3431 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:34.956580 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 920/1842] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:34.986080 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf2956-91ae-4a82-9591-fd274c4cb70b service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:34.987901 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-90bf2956-91ae-4a82-9591-fd274c4cb70b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:35.014600 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bf2956-91ae-4a82-9591-fd274c4cb70b service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:35.031824 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895543a-cfdd-401b-a2a5-d96deefbc97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:35.032974 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895543a-cfdd-401b-a2a5-d96deefbc97e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:35.033604 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895543a-cfdd-401b-a2a5-d96deefbc97e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:35.034220 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a895543a-cfdd-401b-a2a5-d96deefbc97e admin admin] PATH_INFO: `/v3/projects/b5b8eeaec55c4f3b8e65ab8eea4cdbf4` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:35.036167 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895543a-cfdd-401b-a2a5-d96deefbc97e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5b8eeaec55c4f3b8e65ab8eea4cdbf4)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:35.041106 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a895543a-cfdd-401b-a2a5-d96deefbc97e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:35.178897 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a895543a-cfdd-401b-a2a5-d96deefbc97e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5b8eeaec55c4f3b8e65ab8eea4cdbf4', 'request_id': 'req-a895543a-cfdd-401b-a2a5-d96deefbc97e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:35.193375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a895543a-cfdd-401b-a2a5-d96deefbc97e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5b8eeaec55c4f3b8e65ab8eea4cdbf4', 'request_id': 'req-a895543a-cfdd-401b-a2a5-d96deefbc97e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:35.205694 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a895543a-cfdd-401b-a2a5-d96deefbc97e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5b8eeaec55c4f3b8e65ab8eea4cdbf4', 'request_id': 'req-a895543a-cfdd-401b-a2a5-d96deefbc97e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:35.229265 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a895543a-cfdd-401b-a2a5-d96deefbc97e admin admin] The token cache is being invalidate because project b5b8eeaec55c4f3b8e65ab8eea4cdbf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:25:35.230057 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a895543a-cfdd-401b-a2a5-d96deefbc97e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:35.231321 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a895543a-cfdd-401b-a2a5-d96deefbc97e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:35.234622 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 923/1843] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:25:34 2022] DELETE /identity/v3/projects/b5b8eeaec55c4f3b8e65ab8eea4cdbf4 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:35.239728 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557ae66-df77-43a2-b30d-7c7dacec082b None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:35.239937 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557ae66-df77-43a2-b30d-7c7dacec082b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:35.240446 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6557ae66-df77-43a2-b30d-7c7dacec082b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:35.247964 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895543a-cfdd-401b-a2a5-d96deefbc97e admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:35.251462 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a895543a-cfdd-401b-a2a5-d96deefbc97e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:35.282760 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-6557ae66-df77-43a2-b30d-7c7dacec082b None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:35.284104 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6557ae66-df77-43a2-b30d-7c7dacec082b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:35.408477 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:35.455270 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a895543a-cfdd-401b-a2a5-d96deefbc97e admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:35.482299 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c735c7-ce94-4754-aed0-d6e24904e26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:35.483245 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c735c7-ce94-4754-aed0-d6e24904e26c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:35.483735 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c735c7-ce94-4754-aed0-d6e24904e26c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:35.484486 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c735c7-ce94-4754-aed0-d6e24904e26c admin admin] PATH_INFO: `/v3/projects/b75a9edc8b49455a8a2b65bab7e701e6` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:35.486597 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c735c7-ce94-4754-aed0-d6e24904e26c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b75a9edc8b49455a8a2b65bab7e701e6)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:35.492132 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c735c7-ce94-4754-aed0-d6e24904e26c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:35.499743 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 921/1844] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:35.517633 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910257cd-b42a-4756-953f-c76aee1e7ce5 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:35.518627 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910257cd-b42a-4756-953f-c76aee1e7ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:35.519777 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910257cd-b42a-4756-953f-c76aee1e7ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:35.569486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-910257cd-b42a-4756-953f-c76aee1e7ce5 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:35.572458 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-910257cd-b42a-4756-953f-c76aee1e7ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:35.611036 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 922/1845] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:35.615954 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910257cd-b42a-4756-953f-c76aee1e7ce5 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:35.622679 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-910257cd-b42a-4756-953f-c76aee1e7ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:35.656797 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-11c735c7-ce94-4754-aed0-d6e24904e26c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b75a9edc8b49455a8a2b65bab7e701e6', 'request_id': 'req-11c735c7-ce94-4754-aed0-d6e24904e26c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:35.658690 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910257cd-b42a-4756-953f-c76aee1e7ce5 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:35.674142 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-11c735c7-ce94-4754-aed0-d6e24904e26c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b75a9edc8b49455a8a2b65bab7e701e6', 'request_id': 'req-11c735c7-ce94-4754-aed0-d6e24904e26c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:35.685443 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-11c735c7-ce94-4754-aed0-d6e24904e26c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b75a9edc8b49455a8a2b65bab7e701e6', 'request_id': 'req-11c735c7-ce94-4754-aed0-d6e24904e26c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:35.707088 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-11c735c7-ce94-4754-aed0-d6e24904e26c admin admin] The token cache is being invalidate because project b75a9edc8b49455a8a2b65bab7e701e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:25:35.707597 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-11c735c7-ce94-4754-aed0-d6e24904e26c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:35.708776 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-11c735c7-ce94-4754-aed0-d6e24904e26c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:35.714394 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 924/1846] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:25:35 2022] DELETE /identity/v3/projects/b75a9edc8b49455a8a2b65bab7e701e6 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:35.714394 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c735c7-ce94-4754-aed0-d6e24904e26c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:35.715314 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-11c735c7-ce94-4754-aed0-d6e24904e26c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:35.736109 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:35.832136 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea2eba-ba8c-4db7-bb23-dae02a4f23a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:35.833196 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea2eba-ba8c-4db7-bb23-dae02a4f23a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:35.833511 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea2eba-ba8c-4db7-bb23-dae02a4f23a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:35.833823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea2eba-ba8c-4db7-bb23-dae02a4f23a9 admin admin] PATH_INFO: `/v3/users/f2bde016741340b98d9ecc1ab420c8b4` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:35.836713 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea2eba-ba8c-4db7-bb23-dae02a4f23a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2bde016741340b98d9ecc1ab420c8b4)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:35.838821 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea2eba-ba8c-4db7-bb23-dae02a4f23a9 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:35.909043 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c735c7-ce94-4754-aed0-d6e24904e26c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:35.920420 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d761e1-83dd-4ad1-911a-85af075ff676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:35.922468 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d761e1-83dd-4ad1-911a-85af075ff676 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:35.922630 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d761e1-83dd-4ad1-911a-85af075ff676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:35.922952 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d761e1-83dd-4ad1-911a-85af075ff676 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:35.925871 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d761e1-83dd-4ad1-911a-85af075ff676 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:25:35.926402 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d761e1-83dd-4ad1-911a-85af075ff676 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:35.930868 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d761e1-83dd-4ad1-911a-85af075ff676 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:35.946321 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-76ea2eba-ba8c-4db7-bb23-dae02a4f23a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2bde016741340b98d9ecc1ab420c8b4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:35.948183 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-76ea2eba-ba8c-4db7-bb23-dae02a4f23a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2bde016741340b98d9ecc1ab420c8b4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:35.957444 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 925/1847] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:25:35.960295 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed78985-80ca-48e4-9ecc-f1b38a59d88a None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:35.960710 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed78985-80ca-48e4-9ecc-f1b38a59d88a None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:35.961634 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed78985-80ca-48e4-9ecc-f1b38a59d88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:35.966733 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-76ea2eba-ba8c-4db7-bb23-dae02a4f23a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2bde016741340b98d9ecc1ab420c8b4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:35.983882 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-76ea2eba-ba8c-4db7-bb23-dae02a4f23a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2bde016741340b98d9ecc1ab420c8b4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:36.011666 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-76ea2eba-ba8c-4db7-bb23-dae02a4f23a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2bde016741340b98d9ecc1ab420c8b4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:36.022878 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 923/1848] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:25:35 2022] DELETE /identity/v3/users/f2bde016741340b98d9ecc1ab420c8b4 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:36.023837 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea2eba-ba8c-4db7-bb23-dae02a4f23a9 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:36.027416 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-76ea2eba-ba8c-4db7-bb23-dae02a4f23a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:36.029344 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-fed78985-80ca-48e4-9ecc-f1b38a59d88a None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:36.030545 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-fed78985-80ca-48e4-9ecc-f1b38a59d88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:36.113879 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea2eba-ba8c-4db7-bb23-dae02a4f23a9 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:36.120097 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a6751-bd41-457f-8d2a-a87da9976c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:36.120097 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a6751-bd41-457f-8d2a-a87da9976c0c admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:36.123106 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a6751-bd41-457f-8d2a-a87da9976c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:36.123106 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a6751-bd41-457f-8d2a-a87da9976c0c admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:36.123106 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a6751-bd41-457f-8d2a-a87da9976c0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:36.124537 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87a6751-bd41-457f-8d2a-a87da9976c0c admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:36.131219 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:36.182607 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 924/1849] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:25:36 2022] POST /identity/v3/projects => generated 367 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:36.185245 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9575a7-4ed6-423c-8c4d-12a13029deea None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:36.185573 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9575a7-4ed6-423c-8c4d-12a13029deea None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:36.187443 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9575a7-4ed6-423c-8c4d-12a13029deea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:36.193930 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 926/1850] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:36.194801 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed78985-80ca-48e4-9ecc-f1b38a59d88a None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:36.217499 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed78985-80ca-48e4-9ecc-f1b38a59d88a None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:36.218341 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-ef9575a7-4ed6-423c-8c4d-12a13029deea None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:36.219755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ef9575a7-4ed6-423c-8c4d-12a13029deea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:36.332332 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 925/1851] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:36.335667 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb29536-b535-47dd-a0a5-66cd680dcabf None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:36.335667 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb29536-b535-47dd-a0a5-66cd680dcabf None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:36.335667 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb29536-b535-47dd-a0a5-66cd680dcabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:36.344295 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6727b09-c06e-46b9-9641-e8753ba8d3ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:36.345310 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6727b09-c06e-46b9-9641-e8753ba8d3ca admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:36.345703 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6727b09-c06e-46b9-9641-e8753ba8d3ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:36.346095 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6727b09-c06e-46b9-9641-e8753ba8d3ca admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:36.346970 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6727b09-c06e-46b9-9641-e8753ba8d3ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:36.350261 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6727b09-c06e-46b9-9641-e8753ba8d3ca admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:36.363922 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-ceb29536-b535-47dd-a0a5-66cd680dcabf None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:36.365710 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ceb29536-b535-47dd-a0a5-66cd680dcabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:36.378804 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 926/1852] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:36.379824 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb29536-b535-47dd-a0a5-66cd680dcabf None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:36.384864 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 927/1853] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:25:36 2022] POST /identity/v3/users => generated 284 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:36.385029 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ceb29536-b535-47dd-a0a5-66cd680dcabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:36.385109 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6727b09-c06e-46b9-9641-e8753ba8d3ca admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:36.387877 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c6727b09-c06e-46b9-9641-e8753ba8d3ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:36.395793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb29536-b535-47dd-a0a5-66cd680dcabf None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:36.401629 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655be5dc-df35-4482-94dc-664378b47e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:36.402426 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655be5dc-df35-4482-94dc-664378b47e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:36.402746 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655be5dc-df35-4482-94dc-664378b47e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:36.403111 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655be5dc-df35-4482-94dc-664378b47e32 admin admin] PATH_INFO: `/v3/projects/47c6f6415594464d92f680bb255c35c9` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:36.404465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655be5dc-df35-4482-94dc-664378b47e32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47c6f6415594464d92f680bb255c35c9)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:36.406567 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655be5dc-df35-4482-94dc-664378b47e32 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:36.439411 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:36.466384 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6727b09-c06e-46b9-9641-e8753ba8d3ca admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:36.474687 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-655be5dc-df35-4482-94dc-664378b47e32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47c6f6415594464d92f680bb255c35c9', 'request_id': 'req-655be5dc-df35-4482-94dc-664378b47e32'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:36.488371 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-655be5dc-df35-4482-94dc-664378b47e32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47c6f6415594464d92f680bb255c35c9', 'request_id': 'req-655be5dc-df35-4482-94dc-664378b47e32'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:36.500313 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-655be5dc-df35-4482-94dc-664378b47e32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47c6f6415594464d92f680bb255c35c9', 'request_id': 'req-655be5dc-df35-4482-94dc-664378b47e32'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:36.528849 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-655be5dc-df35-4482-94dc-664378b47e32 admin admin] The token cache is being invalidate because project 47c6f6415594464d92f680bb255c35c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:25:36.529799 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-655be5dc-df35-4482-94dc-664378b47e32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:36.531412 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-655be5dc-df35-4482-94dc-664378b47e32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:36.534236 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 927/1854] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:25:36 2022] DELETE /identity/v3/projects/47c6f6415594464d92f680bb255c35c9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:36.539397 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655be5dc-df35-4482-94dc-664378b47e32 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:36.543762 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-655be5dc-df35-4482-94dc-664378b47e32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:36.625793 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faebdf5-bc5d-42e1-ac47-10181a04cf0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:36.627320 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faebdf5-bc5d-42e1-ac47-10181a04cf0a service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:36.627320 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faebdf5-bc5d-42e1-ac47-10181a04cf0a service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:36.627509 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faebdf5-bc5d-42e1-ac47-10181a04cf0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:36.631750 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2faebdf5-bc5d-42e1-ac47-10181a04cf0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:36.673022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655be5dc-df35-4482-94dc-664378b47e32 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:36.683133 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7adcf-22c7-47b9-ab46-a0966a3568aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:36.684235 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7adcf-22c7-47b9-ab46-a0966a3568aa admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:36.684660 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7adcf-22c7-47b9-ab46-a0966a3568aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:36.685220 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd7adcf-22c7-47b9-ab46-a0966a3568aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:36.686083 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7adcf-22c7-47b9-ab46-a0966a3568aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:25:36.686541 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7adcf-22c7-47b9-ab46-a0966a3568aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:36.688555 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd7adcf-22c7-47b9-ab46-a0966a3568aa admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:36.691489 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:36.712887 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 928/1855] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:25:36.714899 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7adcf-22c7-47b9-ab46-a0966a3568aa admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:36.717434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-0fd7adcf-22c7-47b9-ab46-a0966a3568aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:36.750737 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd7adcf-22c7-47b9-ab46-a0966a3568aa admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:36.757654 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faebdf5-bc5d-42e1-ac47-10181a04cf0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:36.759188 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faebdf5-bc5d-42e1-ac47-10181a04cf0a service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:36.773090 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e64bc-01f5-46dd-a33f-71708e636d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:36.773766 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e64bc-01f5-46dd-a33f-71708e636d5d admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:36.774055 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e64bc-01f5-46dd-a33f-71708e636d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:36.774336 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e64bc-01f5-46dd-a33f-71708e636d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:36.775059 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e64bc-01f5-46dd-a33f-71708e636d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:36.777445 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7e64bc-01f5-46dd-a33f-71708e636d5d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:36.779491 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 928/1856] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:36.780960 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faebdf5-bc5d-42e1-ac47-10181a04cf0a service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:36.784476 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2faebdf5-bc5d-42e1-ac47-10181a04cf0a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:36.795411 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 929/1857] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:36.796524 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e64bc-01f5-46dd-a33f-71708e636d5d admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:36.799327 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faebdf5-bc5d-42e1-ac47-10181a04cf0a service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:36.806353 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015b4bb-d239-42ca-96f9-71afc1a5b9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:36.807317 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015b4bb-d239-42ca-96f9-71afc1a5b9cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:36.807643 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015b4bb-d239-42ca-96f9-71afc1a5b9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:36.807921 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015b4bb-d239-42ca-96f9-71afc1a5b9cc admin admin] PATH_INFO: `/v3/users/1b796c6a977d47adb046be1359cae122` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:36.809354 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7e64bc-01f5-46dd-a33f-71708e636d5d admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:36.809497 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7015b4bb-d239-42ca-96f9-71afc1a5b9cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b796c6a977d47adb046be1359cae122)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:36.811936 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7015b4bb-d239-42ca-96f9-71afc1a5b9cc admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:36.827471 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec8d41-cc69-467e-92b6-20a041f8b1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:36.828154 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec8d41-cc69-467e-92b6-20a041f8b1d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:36.828448 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec8d41-cc69-467e-92b6-20a041f8b1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:36.828717 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bec8d41-cc69-467e-92b6-20a041f8b1d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:36.829398 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec8d41-cc69-467e-92b6-20a041f8b1d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:36.835060 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bec8d41-cc69-467e-92b6-20a041f8b1d6 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:36.889366 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 930/1858] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:25:36 2022] POST /identity/v3/projects => generated 381 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:36.890245 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec8d41-cc69-467e-92b6-20a041f8b1d6 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:36.907763 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7015b4bb-d239-42ca-96f9-71afc1a5b9cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b796c6a977d47adb046be1359cae122'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:36.910158 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7015b4bb-d239-42ca-96f9-71afc1a5b9cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b796c6a977d47adb046be1359cae122'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:36.931279 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7015b4bb-d239-42ca-96f9-71afc1a5b9cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b796c6a977d47adb046be1359cae122'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:36.932368 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7015b4bb-d239-42ca-96f9-71afc1a5b9cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b796c6a977d47adb046be1359cae122'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:36.954070 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7015b4bb-d239-42ca-96f9-71afc1a5b9cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b796c6a977d47adb046be1359cae122'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:36.977071 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 929/1859] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:25:36 2022] DELETE /identity/v3/users/1b796c6a977d47adb046be1359cae122 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:36.978313 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015b4bb-d239-42ca-96f9-71afc1a5b9cc admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:36.980002 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7015b4bb-d239-42ca-96f9-71afc1a5b9cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:36.989191 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bec8d41-cc69-467e-92b6-20a041f8b1d6 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:37.034765 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:37.115941 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eaa9c1-9cbd-4e04-ad0b-3fd4815073df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:37.116896 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eaa9c1-9cbd-4e04-ad0b-3fd4815073df admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:37.117806 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eaa9c1-9cbd-4e04-ad0b-3fd4815073df admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:37.118475 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19eaa9c1-9cbd-4e04-ad0b-3fd4815073df admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:37.119338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eaa9c1-9cbd-4e04-ad0b-3fd4815073df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:37.122824 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19eaa9c1-9cbd-4e04-ad0b-3fd4815073df admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:37.153907 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 931/1860] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:36 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:37.159490 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eaa9c1-9cbd-4e04-ad0b-3fd4815073df admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:37.167258 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-19eaa9c1-9cbd-4e04-ad0b-3fd4815073df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:37.196358 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19eaa9c1-9cbd-4e04-ad0b-3fd4815073df admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:37.213208 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a200b-315e-4447-b2c6-2830e284a3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:37.213946 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a200b-315e-4447-b2c6-2830e284a3a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:37.214230 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a200b-315e-4447-b2c6-2830e284a3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:37.214509 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a200b-315e-4447-b2c6-2830e284a3a1 admin admin] PATH_INFO: `/v3/projects/5352475cb6a24ebb98131c44e6885147/users/7390f799dbe14e868b6317cef8efd294/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:37.220348 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015b4bb-d239-42ca-96f9-71afc1a5b9cc admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:37.233471 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16c3a41-3f18-4139-b533-4e4b11017cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:37.234133 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c3a41-3f18-4139-b533-4e4b11017cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:37.234412 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c3a41-3f18-4139-b533-4e4b11017cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:37.234687 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c3a41-3f18-4139-b533-4e4b11017cf2 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:37.235624 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c3a41-3f18-4139-b533-4e4b11017cf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:37.239215 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16c3a41-3f18-4139-b533-4e4b11017cf2 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:37.249313 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a200b-315e-4447-b2c6-2830e284a3a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5352475cb6a24ebb98131c44e6885147, user_id=7390f799dbe14e868b6317cef8efd294, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:37.251885 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a200b-315e-4447-b2c6-2830e284a3a1 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:37.283596 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 932/1861] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:37 2022] PUT /identity/v3/projects/5352475cb6a24ebb98131c44e6885147/users/7390f799dbe14e868b6317cef8efd294/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:37.288115 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 930/1862] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:25:36 2022] POST /identity/v3/users => generated 291 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:37.293017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a200b-315e-4447-b2c6-2830e284a3a1 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:37.297922 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a53d42-90a9-4691-8f81-0b4156f17810 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:37.300480 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a53d42-90a9-4691-8f81-0b4156f17810 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:37.301027 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a53d42-90a9-4691-8f81-0b4156f17810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:37.379214 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f3a53d42-90a9-4691-8f81-0b4156f17810 None None] MFA Rules not processed for user `7390f799dbe14e868b6317cef8efd294`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:37.380707 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f3a53d42-90a9-4691-8f81-0b4156f17810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:37.409115 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:37.457751 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a200b-315e-4447-b2c6-2830e284a3a1 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:37.472059 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3ee9d-892e-429c-9f7f-e15cd73c3ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:37.473066 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3ee9d-892e-429c-9f7f-e15cd73c3ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:37.473539 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3ee9d-892e-429c-9f7f-e15cd73c3ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:37.474103 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3ee9d-892e-429c-9f7f-e15cd73c3ee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:37.475007 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3ee9d-892e-429c-9f7f-e15cd73c3ee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:37.477511 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3ee9d-892e-429c-9f7f-e15cd73c3ee8 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:37.495399 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 933/1863] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:37.496795 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3ee9d-892e-429c-9f7f-e15cd73c3ee8 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:37.498901 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-73f3ee9d-892e-429c-9f7f-e15cd73c3ee8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:37.542082 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3ee9d-892e-429c-9f7f-e15cd73c3ee8 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:37.548423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ce7df-6243-4eb2-ae4f-e03a2f3e2417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:37.549721 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ce7df-6243-4eb2-ae4f-e03a2f3e2417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:37.550152 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ce7df-6243-4eb2-ae4f-e03a2f3e2417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:37.550501 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ce7df-6243-4eb2-ae4f-e03a2f3e2417 admin admin] PATH_INFO: `/v3/projects/0822e5d1ae5f4a34ab832bb5111e81b0` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:37.566334 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ce7df-6243-4eb2-ae4f-e03a2f3e2417 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0822e5d1ae5f4a34ab832bb5111e81b0)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:37.568968 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ce7df-6243-4eb2-ae4f-e03a2f3e2417 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:37.570029 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 931/1864] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:37 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:37.572171 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a53d42-90a9-4691-8f81-0b4156f17810 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:37.600116 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a53d42-90a9-4691-8f81-0b4156f17810 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:37.606523 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976eae78-94b8-4323-aebb-751dc43ef1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:37.607444 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976eae78-94b8-4323-aebb-751dc43ef1be admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:37.607944 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976eae78-94b8-4323-aebb-751dc43ef1be admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:37.608979 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976eae78-94b8-4323-aebb-751dc43ef1be admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:37.613553 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976eae78-94b8-4323-aebb-751dc43ef1be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:37.615624 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976eae78-94b8-4323-aebb-751dc43ef1be admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:37.628877 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 932/1865] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:37.629847 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976eae78-94b8-4323-aebb-751dc43ef1be admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:37.650845 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976eae78-94b8-4323-aebb-751dc43ef1be admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:37.670582 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6d1ce7df-6243-4eb2-ae4f-e03a2f3e2417 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0822e5d1ae5f4a34ab832bb5111e81b0', 'request_id': 'req-6d1ce7df-6243-4eb2-ae4f-e03a2f3e2417'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:37.677832 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6d1ce7df-6243-4eb2-ae4f-e03a2f3e2417 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0822e5d1ae5f4a34ab832bb5111e81b0', 'request_id': 'req-6d1ce7df-6243-4eb2-ae4f-e03a2f3e2417'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:37.684093 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6d1ce7df-6243-4eb2-ae4f-e03a2f3e2417 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0822e5d1ae5f4a34ab832bb5111e81b0', 'request_id': 'req-6d1ce7df-6243-4eb2-ae4f-e03a2f3e2417'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:37.711271 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6d1ce7df-6243-4eb2-ae4f-e03a2f3e2417 admin admin] The token cache is being invalidate because project 0822e5d1ae5f4a34ab832bb5111e81b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:25:37.711624 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6d1ce7df-6243-4eb2-ae4f-e03a2f3e2417 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:37.712407 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6d1ce7df-6243-4eb2-ae4f-e03a2f3e2417 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:37.717950 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 934/1866] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:25:37 2022] DELETE /identity/v3/projects/0822e5d1ae5f4a34ab832bb5111e81b0 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:37.717950 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ce7df-6243-4eb2-ae4f-e03a2f3e2417 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:37.719353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6d1ce7df-6243-4eb2-ae4f-e03a2f3e2417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:37.741377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91063514-711c-4064-a916-55881dc510a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:37.741377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91063514-711c-4064-a916-55881dc510a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:37.741377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91063514-711c-4064-a916-55881dc510a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:37.753088 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91063514-711c-4064-a916-55881dc510a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:37.753875 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91063514-711c-4064-a916-55881dc510a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:37.759843 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91063514-711c-4064-a916-55881dc510a0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:37.805422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 933/1867] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:25:37 2022] POST /identity/v3/projects => generated 365 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:37.806777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91063514-711c-4064-a916-55881dc510a0 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:37.809733 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-91063514-711c-4064-a916-55881dc510a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:37.819117 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ce7df-6243-4eb2-ae4f-e03a2f3e2417 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:37.821169 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:37.902311 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91063514-711c-4064-a916-55881dc510a0 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:37.907713 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ce575-ed22-45cf-8e6b-91f608f6062d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:37.908481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ce575-ed22-45cf-8e6b-91f608f6062d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:37.908768 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ce575-ed22-45cf-8e6b-91f608f6062d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:37.909167 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39ce575-ed22-45cf-8e6b-91f608f6062d admin admin] PATH_INFO: `/v3/users/ef9d6e27ae6b48e9a1b559795e53efa0` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:37.910478 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ce575-ed22-45cf-8e6b-91f608f6062d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef9d6e27ae6b48e9a1b559795e53efa0)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:37.912602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39ce575-ed22-45cf-8e6b-91f608f6062d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:37.923161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1c9bb-9ba7-4437-b4d9-0417bd4fc1f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:37.923530 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1c9bb-9ba7-4437-b4d9-0417bd4fc1f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:37.923719 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1c9bb-9ba7-4437-b4d9-0417bd4fc1f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:37.923947 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1c9bb-9ba7-4437-b4d9-0417bd4fc1f8 admin admin] PATH_INFO: `/v3/projects/ec8b328eb0bd4038aa39a0a181654b90/users/e68e7024faee4fc599bd111eaaf3f875/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:37.939503 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:37.943934 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b1c9bb-9ba7-4437-b4d9-0417bd4fc1f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec8b328eb0bd4038aa39a0a181654b90, user_id=e68e7024faee4fc599bd111eaaf3f875, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:37.947275 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b1c9bb-9ba7-4437-b4d9-0417bd4fc1f8 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:37.965148 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 935/1868] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:37 2022] PUT /identity/v3/projects/ec8b328eb0bd4038aa39a0a181654b90/users/e68e7024faee4fc599bd111eaaf3f875/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:37.966411 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1c9bb-9ba7-4437-b4d9-0417bd4fc1f8 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:37.970116 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a39ce575-ed22-45cf-8e6b-91f608f6062d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef9d6e27ae6b48e9a1b559795e53efa0'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:37.970782 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a39ce575-ed22-45cf-8e6b-91f608f6062d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef9d6e27ae6b48e9a1b559795e53efa0'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:37.974670 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-c6b1c9bb-9ba7-4437-b4d9-0417bd4fc1f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:37.977783 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a39ce575-ed22-45cf-8e6b-91f608f6062d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef9d6e27ae6b48e9a1b559795e53efa0'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:37.978434 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a39ce575-ed22-45cf-8e6b-91f608f6062d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef9d6e27ae6b48e9a1b559795e53efa0'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:38.005403 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a39ce575-ed22-45cf-8e6b-91f608f6062d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef9d6e27ae6b48e9a1b559795e53efa0'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:38.020312 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 934/1869] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:25:37 2022] DELETE /identity/v3/users/ef9d6e27ae6b48e9a1b559795e53efa0 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:38.021225 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ce575-ed22-45cf-8e6b-91f608f6062d admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:38.024804 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a39ce575-ed22-45cf-8e6b-91f608f6062d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:38.045908 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1c9bb-9ba7-4437-b4d9-0417bd4fc1f8 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:38.106903 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39ce575-ed22-45cf-8e6b-91f608f6062d admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:38.111854 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5762d-6379-45a8-abd7-7355c024ae37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:38.112390 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5762d-6379-45a8-abd7-7355c024ae37 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:38.112686 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5762d-6379-45a8-abd7-7355c024ae37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:38.112937 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5762d-6379-45a8-abd7-7355c024ae37 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:38.113729 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5762d-6379-45a8-abd7-7355c024ae37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:38.115644 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5762d-6379-45a8-abd7-7355c024ae37 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:38.123757 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e855f-287b-48d6-b61c-85aee0923de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:38.124612 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e855f-287b-48d6-b61c-85aee0923de1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:38.124898 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e855f-287b-48d6-b61c-85aee0923de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:38.125536 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e855f-287b-48d6-b61c-85aee0923de1 admin admin] PATH_INFO: `/v3/projects/e3b32e023fcd43b5895ad59d83f57837` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:38.126803 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e855f-287b-48d6-b61c-85aee0923de1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3b32e023fcd43b5895ad59d83f57837)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:38.129293 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183e855f-287b-48d6-b61c-85aee0923de1 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:38.142621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 935/1870] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:25:38 2022] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:38.142621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c7477-0057-4def-a392-f4a8a5c0574e None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:38.142621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c7477-0057-4def-a392-f4a8a5c0574e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:38.142621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c7477-0057-4def-a392-f4a8a5c0574e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:38.174369 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-608c7477-0057-4def-a392-f4a8a5c0574e None None] MFA Rules not processed for user `e68e7024faee4fc599bd111eaaf3f875`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:38.175845 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-608c7477-0057-4def-a392-f4a8a5c0574e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:38.181013 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:38.205519 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-183e855f-287b-48d6-b61c-85aee0923de1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3b32e023fcd43b5895ad59d83f57837', 'request_id': 'req-183e855f-287b-48d6-b61c-85aee0923de1'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:38.216894 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-183e855f-287b-48d6-b61c-85aee0923de1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3b32e023fcd43b5895ad59d83f57837', 'request_id': 'req-183e855f-287b-48d6-b61c-85aee0923de1'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:38.223730 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-183e855f-287b-48d6-b61c-85aee0923de1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3b32e023fcd43b5895ad59d83f57837', 'request_id': 'req-183e855f-287b-48d6-b61c-85aee0923de1'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:38.244209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-183e855f-287b-48d6-b61c-85aee0923de1 admin admin] The token cache is being invalidate because project e3b32e023fcd43b5895ad59d83f57837 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:25:38.244519 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-183e855f-287b-48d6-b61c-85aee0923de1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:38.245735 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-183e855f-287b-48d6-b61c-85aee0923de1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:38.247648 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 936/1871] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:25:37 2022] DELETE /identity/v3/projects/e3b32e023fcd43b5895ad59d83f57837 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:38.248858 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e855f-287b-48d6-b61c-85aee0923de1 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:38.250875 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-183e855f-287b-48d6-b61c-85aee0923de1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:38.268823 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 936/1872] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:38.270356 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166db5c3-dea9-4050-83e7-f5d226661415 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:38.270762 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166db5c3-dea9-4050-83e7-f5d226661415 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:38.271116 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166db5c3-dea9-4050-83e7-f5d226661415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:38.288287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:38.297344 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-166db5c3-dea9-4050-83e7-f5d226661415 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:38.298693 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-166db5c3-dea9-4050-83e7-f5d226661415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:38.329636 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e855f-287b-48d6-b61c-85aee0923de1 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:38.336246 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53dfa96-9ac5-4554-9d9d-b47b48123e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:38.337028 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53dfa96-9ac5-4554-9d9d-b47b48123e69 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:38.337434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53dfa96-9ac5-4554-9d9d-b47b48123e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:38.337671 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53dfa96-9ac5-4554-9d9d-b47b48123e69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:38.338382 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53dfa96-9ac5-4554-9d9d-b47b48123e69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:38.340227 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53dfa96-9ac5-4554-9d9d-b47b48123e69 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:38.355002 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 937/1873] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:38.355002 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53dfa96-9ac5-4554-9d9d-b47b48123e69 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:38.355002 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f53dfa96-9ac5-4554-9d9d-b47b48123e69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:38.380553 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 937/1874] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:38.380553 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166db5c3-dea9-4050-83e7-f5d226661415 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:38.386758 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166db5c3-dea9-4050-83e7-f5d226661415 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:38.389786 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53dfa96-9ac5-4554-9d9d-b47b48123e69 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:38.393005 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6434a9b-d469-4a2e-a919-577a62a85982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:38.394346 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6434a9b-d469-4a2e-a919-577a62a85982 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:38.395040 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6434a9b-d469-4a2e-a919-577a62a85982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:38.395682 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6434a9b-d469-4a2e-a919-577a62a85982 admin admin] PATH_INFO: `/v3/projects/51fcc621e844417584994da6c37806a7/users/c5a2db0576444698adfbfecf75480c23/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:38.396253 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1b997-4da7-4dd4-aab4-89c90986b54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:38.397181 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1b997-4da7-4dd4-aab4-89c90986b54c admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:38.397835 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1b997-4da7-4dd4-aab4-89c90986b54c admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:38.398213 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1b997-4da7-4dd4-aab4-89c90986b54c admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:38.399211 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1b997-4da7-4dd4-aab4-89c90986b54c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:38.402118 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1b997-4da7-4dd4-aab4-89c90986b54c admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:38.415400 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6434a9b-d469-4a2e-a919-577a62a85982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51fcc621e844417584994da6c37806a7, user_id=c5a2db0576444698adfbfecf75480c23, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:38.420755 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6434a9b-d469-4a2e-a919-577a62a85982 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:38.439511 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 938/1875] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:38 2022] PUT /identity/v3/projects/51fcc621e844417584994da6c37806a7/users/c5a2db0576444698adfbfecf75480c23/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:38.441042 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6434a9b-d469-4a2e-a919-577a62a85982 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:38.443903 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d6434a9b-d469-4a2e-a919-577a62a85982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:38.444833 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 938/1876] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:25:38 2022] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:38.446951 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e1074-d486-44be-a7fe-a40cf7242e3f None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:38.447868 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e1074-d486-44be-a7fe-a40cf7242e3f None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:38.449800 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e1074-d486-44be-a7fe-a40cf7242e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:38.472765 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-720e1074-d486-44be-a7fe-a40cf7242e3f None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:38.474056 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-720e1074-d486-44be-a7fe-a40cf7242e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:38.583260 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 939/1877] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:38.587548 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e1074-d486-44be-a7fe-a40cf7242e3f None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:38.597394 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6434a9b-d469-4a2e-a919-577a62a85982 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:38.602234 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10013cd9-f467-4d61-899e-c8660ad71a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:38.602960 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10013cd9-f467-4d61-899e-c8660ad71a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:38.603314 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10013cd9-f467-4d61-899e-c8660ad71a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:38.603433 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e1074-d486-44be-a7fe-a40cf7242e3f None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:38.603977 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10013cd9-f467-4d61-899e-c8660ad71a0d admin admin] PATH_INFO: `/v3/projects/c066b11e81bb498bb365de64cc4bb072` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:38.606371 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10013cd9-f467-4d61-899e-c8660ad71a0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c066b11e81bb498bb365de64cc4bb072)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:38.608409 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10013cd9-f467-4d61-899e-c8660ad71a0d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:38.610271 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b332d-bb62-4f06-86b4-8979ae574c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:38.611403 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b332d-bb62-4f06-86b4-8979ae574c7b admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:38.611838 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b332d-bb62-4f06-86b4-8979ae574c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:38.612698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b332d-bb62-4f06-86b4-8979ae574c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:38.613806 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b332d-bb62-4f06-86b4-8979ae574c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:38.615624 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b332d-bb62-4f06-86b4-8979ae574c7b admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:38.634936 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 940/1878] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:38.636653 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b332d-bb62-4f06-86b4-8979ae574c7b admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:38.638535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:38.657932 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b332d-bb62-4f06-86b4-8979ae574c7b admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:38.672914 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-10013cd9-f467-4d61-899e-c8660ad71a0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c066b11e81bb498bb365de64cc4bb072', 'request_id': 'req-10013cd9-f467-4d61-899e-c8660ad71a0d'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:38.682382 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-10013cd9-f467-4d61-899e-c8660ad71a0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c066b11e81bb498bb365de64cc4bb072', 'request_id': 'req-10013cd9-f467-4d61-899e-c8660ad71a0d'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:38.689303 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-10013cd9-f467-4d61-899e-c8660ad71a0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c066b11e81bb498bb365de64cc4bb072', 'request_id': 'req-10013cd9-f467-4d61-899e-c8660ad71a0d'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:38.712800 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-10013cd9-f467-4d61-899e-c8660ad71a0d admin admin] The token cache is being invalidate because project c066b11e81bb498bb365de64cc4bb072 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:25:38.715388 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-10013cd9-f467-4d61-899e-c8660ad71a0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:38.716312 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-10013cd9-f467-4d61-899e-c8660ad71a0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:38.722033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 939/1879] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:25:38 2022] DELETE /identity/v3/projects/c066b11e81bb498bb365de64cc4bb072 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:38.726709 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10013cd9-f467-4d61-899e-c8660ad71a0d admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:38.727275 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fecaf5-1b43-4360-b83b-c059a877f080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:38.727889 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fecaf5-1b43-4360-b83b-c059a877f080 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:38.728434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fecaf5-1b43-4360-b83b-c059a877f080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:38.728713 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fecaf5-1b43-4360-b83b-c059a877f080 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:38.728880 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-10013cd9-f467-4d61-899e-c8660ad71a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:38.729448 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fecaf5-1b43-4360-b83b-c059a877f080 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:38.732487 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fecaf5-1b43-4360-b83b-c059a877f080 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:38.743910 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10013cd9-f467-4d61-899e-c8660ad71a0d admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:38.750138 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b9259d-d7aa-4e1f-a6cd-5b9d6bfc9adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:38.750877 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9259d-d7aa-4e1f-a6cd-5b9d6bfc9adf admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:38.751519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9259d-d7aa-4e1f-a6cd-5b9d6bfc9adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:38.751868 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b9259d-d7aa-4e1f-a6cd-5b9d6bfc9adf admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:38.752696 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9259d-d7aa-4e1f-a6cd-5b9d6bfc9adf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:25:38.752993 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9259d-d7aa-4e1f-a6cd-5b9d6bfc9adf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:38.754739 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b9259d-d7aa-4e1f-a6cd-5b9d6bfc9adf admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:38.763001 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 941/1880] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:25:38 2022] POST /identity/v3/users => generated 296 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:38.764296 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fecaf5-1b43-4360-b83b-c059a877f080 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:38.766846 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-63fecaf5-1b43-4360-b83b-c059a877f080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:38.768860 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 940/1881] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:25:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:25:38.770263 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137d2b5-0c52-469f-af5a-3c4e7db30172 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:38.770624 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137d2b5-0c52-469f-af5a-3c4e7db30172 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:38.770975 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e137d2b5-0c52-469f-af5a-3c4e7db30172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:38.781846 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fecaf5-1b43-4360-b83b-c059a877f080 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:38.791196 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356bc52-2afa-4c10-8af6-9eabf5e9c52f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:38.793055 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356bc52-2afa-4c10-8af6-9eabf5e9c52f admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:38.793559 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356bc52-2afa-4c10-8af6-9eabf5e9c52f admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:38.794190 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7356bc52-2afa-4c10-8af6-9eabf5e9c52f admin admin] PATH_INFO: `/v3/projects/51fcc621e844417584994da6c37806a7/users/c5a2db0576444698adfbfecf75480c23/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:38.794299 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-e137d2b5-0c52-469f-af5a-3c4e7db30172 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:38.795532 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e137d2b5-0c52-469f-af5a-3c4e7db30172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:38.796778 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356bc52-2afa-4c10-8af6-9eabf5e9c52f admin admin] RBAC: Authorizing `identity:create_grant(project_id=51fcc621e844417584994da6c37806a7, user_id=c5a2db0576444698adfbfecf75480c23, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:38.799761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7356bc52-2afa-4c10-8af6-9eabf5e9c52f admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:38.811707 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 941/1882] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:38.813049 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137d2b5-0c52-469f-af5a-3c4e7db30172 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:38.814850 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e137d2b5-0c52-469f-af5a-3c4e7db30172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:38.817715 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 942/1883] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:38 2022] PUT /identity/v3/projects/51fcc621e844417584994da6c37806a7/users/c5a2db0576444698adfbfecf75480c23/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:38.818849 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356bc52-2afa-4c10-8af6-9eabf5e9c52f admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:38.828339 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e137d2b5-0c52-469f-af5a-3c4e7db30172 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:38.845684 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:38.908128 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d71a07-656a-4eaf-bc9a-5aab96166f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:38.909022 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d71a07-656a-4eaf-bc9a-5aab96166f79 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:38.909319 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d71a07-656a-4eaf-bc9a-5aab96166f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:38.909597 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d71a07-656a-4eaf-bc9a-5aab96166f79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:38.910357 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d71a07-656a-4eaf-bc9a-5aab96166f79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:38.911888 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d71a07-656a-4eaf-bc9a-5aab96166f79 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:38.927943 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 942/1884] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:38.928116 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7356bc52-2afa-4c10-8af6-9eabf5e9c52f admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:38.928214 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7b94a-2c44-4e1b-91f0-5b872815aa4f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:38.928214 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7b94a-2c44-4e1b-91f0-5b872815aa4f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:38.928214 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7b94a-2c44-4e1b-91f0-5b872815aa4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:38.933092 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c7572-b0fe-4db3-9fa7-758c18d12422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:38.933795 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c7572-b0fe-4db3-9fa7-758c18d12422 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:38.934194 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c7572-b0fe-4db3-9fa7-758c18d12422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:38.934572 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c7572-b0fe-4db3-9fa7-758c18d12422 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:38.935470 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c7572-b0fe-4db3-9fa7-758c18d12422 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:38.937826 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c7572-b0fe-4db3-9fa7-758c18d12422 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:38.952808 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-cec7b94a-2c44-4e1b-91f0-5b872815aa4f None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:38.954096 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-cec7b94a-2c44-4e1b-91f0-5b872815aa4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:38.963883 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 943/1885] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:38.965384 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9507a65-e5ea-4f5f-8673-b8befb406a69 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:38.966200 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9507a65-e5ea-4f5f-8673-b8befb406a69 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:38.966316 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9507a65-e5ea-4f5f-8673-b8befb406a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:38.977404 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 943/1886] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:25:38 2022] POST /identity/v3/projects => generated 377 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:38.977404 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c7572-b0fe-4db3-9fa7-758c18d12422 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:39.018844 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-a9507a65-e5ea-4f5f-8673-b8befb406a69 None None] MFA Rules not processed for user `c5a2db0576444698adfbfecf75480c23`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:39.020115 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a9507a65-e5ea-4f5f-8673-b8befb406a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:39.076935 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c7572-b0fe-4db3-9fa7-758c18d12422 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:39.084184 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a80a3-d0ed-4d85-adad-52d291a519c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:39.085185 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a80a3-d0ed-4d85-adad-52d291a519c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:39.085567 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a80a3-d0ed-4d85-adad-52d291a519c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:39.086238 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156a80a3-d0ed-4d85-adad-52d291a519c3 admin admin] PATH_INFO: `/v3/projects/58e055d57639434784b78bc668031a77/users/b53dcf750c4a4aea972019a1e15efbb8/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:39.108443 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 944/1887] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:38 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:39.109452 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9507a65-e5ea-4f5f-8673-b8befb406a69 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:39.122213 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a80a3-d0ed-4d85-adad-52d291a519c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58e055d57639434784b78bc668031a77, user_id=b53dcf750c4a4aea972019a1e15efbb8, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:39.122413 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9507a65-e5ea-4f5f-8673-b8befb406a69 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:39.125311 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156a80a3-d0ed-4d85-adad-52d291a519c3 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:39.139613 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf02784-267b-4204-92df-d6190c4970bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:39.140451 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf02784-267b-4204-92df-d6190c4970bf admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:39.140920 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf02784-267b-4204-92df-d6190c4970bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:39.141266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf02784-267b-4204-92df-d6190c4970bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:39.142052 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf02784-267b-4204-92df-d6190c4970bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:25:39.142629 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf02784-267b-4204-92df-d6190c4970bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:39.146143 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf02784-267b-4204-92df-d6190c4970bf admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:39.148387 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:39.153933 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 944/1888] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:38 2022] PUT /identity/v3/projects/58e055d57639434784b78bc668031a77/users/b53dcf750c4a4aea972019a1e15efbb8/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:39.154851 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a80a3-d0ed-4d85-adad-52d291a519c3 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:39.169956 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 945/1889] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:25:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:25:39.171038 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf02784-267b-4204-92df-d6190c4970bf admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:39.176824 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-baf02784-267b-4204-92df-d6190c4970bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:39.228364 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156a80a3-d0ed-4d85-adad-52d291a519c3 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:39.233549 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309da88-ca26-45b7-ba9e-a83d49ee8daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:39.234167 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309da88-ca26-45b7-ba9e-a83d49ee8daf admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:39.234447 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309da88-ca26-45b7-ba9e-a83d49ee8daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:39.234719 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309da88-ca26-45b7-ba9e-a83d49ee8daf admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:39.235376 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309da88-ca26-45b7-ba9e-a83d49ee8daf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:39.237309 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309da88-ca26-45b7-ba9e-a83d49ee8daf admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:39.246806 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf02784-267b-4204-92df-d6190c4970bf admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:39.258110 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 945/1890] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:25:39 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:39.259273 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309da88-ca26-45b7-ba9e-a83d49ee8daf admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:39.269054 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309da88-ca26-45b7-ba9e-a83d49ee8daf admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:39.273871 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5e8ae-e8c8-434e-adf1-b244510598bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:39.274473 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5e8ae-e8c8-434e-adf1-b244510598bc admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:39.274758 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5e8ae-e8c8-434e-adf1-b244510598bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:39.275059 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5e8ae-e8c8-434e-adf1-b244510598bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:39.275754 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5e8ae-e8c8-434e-adf1-b244510598bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:39.277918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5e8ae-e8c8-434e-adf1-b244510598bc admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:39.279202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:39.292778 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 946/1891] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:39.292778 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5e8ae-e8c8-434e-adf1-b244510598bc admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:39.300929 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5e8ae-e8c8-434e-adf1-b244510598bc admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:39.301108 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01dd7c-7e59-46c1-908f-b2dad339e881 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:39.301800 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01dd7c-7e59-46c1-908f-b2dad339e881 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:39.302144 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01dd7c-7e59-46c1-908f-b2dad339e881 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:39.302491 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01dd7c-7e59-46c1-908f-b2dad339e881 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:39.305591 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d12e51-a957-43ca-b14f-7ac70934a0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:39.306179 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d12e51-a957-43ca-b14f-7ac70934a0d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:39.306469 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d12e51-a957-43ca-b14f-7ac70934a0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:39.306747 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d12e51-a957-43ca-b14f-7ac70934a0d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:39.307400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d12e51-a957-43ca-b14f-7ac70934a0d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:39.309837 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d12e51-a957-43ca-b14f-7ac70934a0d1 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:39.337772 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 947/1892] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:25:39 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:39.338602 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d12e51-a957-43ca-b14f-7ac70934a0d1 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:39.364790 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01dd7c-7e59-46c1-908f-b2dad339e881 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:39.366350 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f01dd7c-7e59-46c1-908f-b2dad339e881 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:39.378263 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 946/1893] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:39 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:39.379403 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01dd7c-7e59-46c1-908f-b2dad339e881 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:39.391646 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f01dd7c-7e59-46c1-908f-b2dad339e881 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:39.406176 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d12e51-a957-43ca-b14f-7ac70934a0d1 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:39.413956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e972d-a1b5-4c05-9f0c-ea6c1b9ddfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:39.414358 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e972d-a1b5-4c05-9f0c-ea6c1b9ddfe2 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:39.414655 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e972d-a1b5-4c05-9f0c-ea6c1b9ddfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:39.414979 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1e972d-a1b5-4c05-9f0c-ea6c1b9ddfe2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:39.415681 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e972d-a1b5-4c05-9f0c-ea6c1b9ddfe2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:39.421580 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1e972d-a1b5-4c05-9f0c-ea6c1b9ddfe2 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:39.434115 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 948/1894] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:39.434994 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e972d-a1b5-4c05-9f0c-ea6c1b9ddfe2 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:39.451198 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1e972d-a1b5-4c05-9f0c-ea6c1b9ddfe2 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:39.456515 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec043ec-1b35-4bb8-a00f-ee14d293aca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:39.457220 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec043ec-1b35-4bb8-a00f-ee14d293aca8 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:39.457602 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec043ec-1b35-4bb8-a00f-ee14d293aca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:39.457700 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d6f25-fceb-4dcc-a880-b7d9a2d28a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:39.458018 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec043ec-1b35-4bb8-a00f-ee14d293aca8 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:39.458530 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d6f25-fceb-4dcc-a880-b7d9a2d28a91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:39.458897 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d6f25-fceb-4dcc-a880-b7d9a2d28a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:39.459126 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec043ec-1b35-4bb8-a00f-ee14d293aca8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:39.459406 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460d6f25-fceb-4dcc-a880-b7d9a2d28a91 admin admin] PATH_INFO: `/v3/projects/58e055d57639434784b78bc668031a77/users/b53dcf750c4a4aea972019a1e15efbb8/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:39.461410 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec043ec-1b35-4bb8-a00f-ee14d293aca8 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:39.468674 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d6f25-fceb-4dcc-a880-b7d9a2d28a91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58e055d57639434784b78bc668031a77, user_id=b53dcf750c4a4aea972019a1e15efbb8, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:39.471458 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460d6f25-fceb-4dcc-a880-b7d9a2d28a91 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:39.474218 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:39.486865 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 949/1895] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:25:39 2022] POST /identity/v3/users => generated 292 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:39.487040 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 947/1896] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:39 2022] PUT /identity/v3/projects/58e055d57639434784b78bc668031a77/users/b53dcf750c4a4aea972019a1e15efbb8/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:39.487131 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec043ec-1b35-4bb8-a00f-ee14d293aca8 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:39.487231 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d6f25-fceb-4dcc-a880-b7d9a2d28a91 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:39.499395 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec043ec-1b35-4bb8-a00f-ee14d293aca8 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:39.547120 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460d6f25-fceb-4dcc-a880-b7d9a2d28a91 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:39.551335 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf552d9-5150-41a1-954d-b9bb75169e16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:39.552090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf552d9-5150-41a1-954d-b9bb75169e16 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:39.552476 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf552d9-5150-41a1-954d-b9bb75169e16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:39.552751 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf552d9-5150-41a1-954d-b9bb75169e16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:39.554522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3bf552d9-5150-41a1-954d-b9bb75169e16 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:39.556761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669118b1-b8e9-408a-994f-09aaf7685cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:39.557409 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669118b1-b8e9-408a-994f-09aaf7685cae admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:39.558210 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669118b1-b8e9-408a-994f-09aaf7685cae admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:39.558515 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669118b1-b8e9-408a-994f-09aaf7685cae admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:39.559213 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669118b1-b8e9-408a-994f-09aaf7685cae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:39.561014 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669118b1-b8e9-408a-994f-09aaf7685cae admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:39.570831 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 950/1897] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:39.571637 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669118b1-b8e9-408a-994f-09aaf7685cae admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:39.582015 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669118b1-b8e9-408a-994f-09aaf7685cae admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:39.586725 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79db27-5aa2-41b6-98bd-2258fa605de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:39.587307 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79db27-5aa2-41b6-98bd-2258fa605de8 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:39.587589 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79db27-5aa2-41b6-98bd-2258fa605de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:39.587864 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79db27-5aa2-41b6-98bd-2258fa605de8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:39.588591 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79db27-5aa2-41b6-98bd-2258fa605de8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:39.590242 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79db27-5aa2-41b6-98bd-2258fa605de8 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:39.600405 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 951/1898] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:39.601739 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0ffc2-9cc8-4652-8b13-3e8e369ce275 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:39.602029 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0ffc2-9cc8-4652-8b13-3e8e369ce275 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:39.602306 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0ffc2-9cc8-4652-8b13-3e8e369ce275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:39.622018 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf552d9-5150-41a1-954d-b9bb75169e16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:39.623461 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf552d9-5150-41a1-954d-b9bb75169e16 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:39.630303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-05e0ffc2-9cc8-4652-8b13-3e8e369ce275 None None] MFA Rules not processed for user `b53dcf750c4a4aea972019a1e15efbb8`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:39.631542 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-05e0ffc2-9cc8-4652-8b13-3e8e369ce275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:39.632588 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 948/1899] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:39 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:39.633201 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf552d9-5150-41a1-954d-b9bb75169e16 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:39.643524 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf552d9-5150-41a1-954d-b9bb75169e16 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:39.649103 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39e296-0a34-4855-be76-18b7a1edb55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:39.649763 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39e296-0a34-4855-be76-18b7a1edb55c admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:39.650047 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39e296-0a34-4855-be76-18b7a1edb55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:39.650378 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39e296-0a34-4855-be76-18b7a1edb55c admin admin] PATH_INFO: `/v3/projects/e777d8f842a74d87a05be7f492339a55/users/6f6a34eacf784b85bad2ecb39e6fc8cb/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:39.661585 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:39.665786 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39e296-0a34-4855-be76-18b7a1edb55c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e777d8f842a74d87a05be7f492339a55, user_id=6f6a34eacf784b85bad2ecb39e6fc8cb, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:39.669297 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39e296-0a34-4855-be76-18b7a1edb55c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:39.684236 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 949/1900] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:39 2022] PUT /identity/v3/projects/e777d8f842a74d87a05be7f492339a55/users/6f6a34eacf784b85bad2ecb39e6fc8cb/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:39.685060 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39e296-0a34-4855-be76-18b7a1edb55c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:39.726317 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 952/1901] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:39 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:39.728547 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d22b80-1139-46c0-91ba-aa956f50a901 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:39.729275 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d22b80-1139-46c0-91ba-aa956f50a901 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:39.730104 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d22b80-1139-46c0-91ba-aa956f50a901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:39.762191 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-77d22b80-1139-46c0-91ba-aa956f50a901 None None] MFA Rules not processed for user `6f6a34eacf784b85bad2ecb39e6fc8cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:39.763412 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-77d22b80-1139-46c0-91ba-aa956f50a901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:39.764224 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39e296-0a34-4855-be76-18b7a1edb55c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:39.770619 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216a9e7-0744-490c-a4b1-f6954d4ad235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:39.771762 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216a9e7-0744-490c-a4b1-f6954d4ad235 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:39.772190 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216a9e7-0744-490c-a4b1-f6954d4ad235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:39.772569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216a9e7-0744-490c-a4b1-f6954d4ad235 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:39.773396 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216a9e7-0744-490c-a4b1-f6954d4ad235 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:39.776074 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216a9e7-0744-490c-a4b1-f6954d4ad235 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:39.788982 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 950/1902] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:39 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:39.789941 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216a9e7-0744-490c-a4b1-f6954d4ad235 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:39.795190 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0216a9e7-0744-490c-a4b1-f6954d4ad235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:39.821233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:39.840378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 953/1903] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:39.841067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d22b80-1139-46c0-91ba-aa956f50a901 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:39.852318 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d22b80-1139-46c0-91ba-aa956f50a901 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:39.857724 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763039c2-844e-4317-8050-7ffb1b56bcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:39.858326 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763039c2-844e-4317-8050-7ffb1b56bcee admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:39.858611 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763039c2-844e-4317-8050-7ffb1b56bcee admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:39.858891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763039c2-844e-4317-8050-7ffb1b56bcee admin admin] PATH_INFO: `/v3/projects/570f0e40c0fc4712b457ea84f246ac5d/users/f11706bff55847f2973f81bceb571abf/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:39.862813 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216a9e7-0744-490c-a4b1-f6954d4ad235 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:39.866734 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f52eb62-d57f-4f5e-9ca7-58abd5c3a9a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:39.867479 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52eb62-d57f-4f5e-9ca7-58abd5c3a9a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:39.867776 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52eb62-d57f-4f5e-9ca7-58abd5c3a9a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:39.868759 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f52eb62-d57f-4f5e-9ca7-58abd5c3a9a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:39.876397 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763039c2-844e-4317-8050-7ffb1b56bcee admin admin] RBAC: Authorizing `identity:create_grant(project_id=570f0e40c0fc4712b457ea84f246ac5d, user_id=f11706bff55847f2973f81bceb571abf, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:39.879709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763039c2-844e-4317-8050-7ffb1b56bcee admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:39.896085 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 954/1904] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:39 2022] PUT /identity/v3/projects/570f0e40c0fc4712b457ea84f246ac5d/users/f11706bff55847f2973f81bceb571abf/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:39.896962 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763039c2-844e-4317-8050-7ffb1b56bcee admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:39.973237 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f52eb62-d57f-4f5e-9ca7-58abd5c3a9a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:39.975060 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f52eb62-d57f-4f5e-9ca7-58abd5c3a9a9 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:39.988607 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 951/1905] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:39 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:39.998066 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228666dc-5d59-4cd1-8ee8-1539f9f0ab79 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:39.998620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228666dc-5d59-4cd1-8ee8-1539f9f0ab79 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:39.999046 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228666dc-5d59-4cd1-8ee8-1539f9f0ab79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:39.999667 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763039c2-844e-4317-8050-7ffb1b56bcee admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:40.006661 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9357e-7185-4920-b6b0-4e052f56bcd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:40.007554 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9357e-7185-4920-b6b0-4e052f56bcd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:40.007939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9357e-7185-4920-b6b0-4e052f56bcd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:40.008378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9357e-7185-4920-b6b0-4e052f56bcd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:40.009813 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc9357e-7185-4920-b6b0-4e052f56bcd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:40.012990 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc9357e-7185-4920-b6b0-4e052f56bcd5 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:40.070877 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-228666dc-5d59-4cd1-8ee8-1539f9f0ab79 None None] MFA Rules not processed for user `f11706bff55847f2973f81bceb571abf`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:40.071569 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 955/1906] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:25:39 2022] POST /identity/v3/projects => generated 377 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:40.075133 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-228666dc-5d59-4cd1-8ee8-1539f9f0ab79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:40.076258 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9357e-7185-4920-b6b0-4e052f56bcd5 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:40.093788 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:40.170011 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9357e-7185-4920-b6b0-4e052f56bcd5 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:40.175660 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0993a-3abf-491f-b6ac-e0fc437e0d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:40.176501 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0993a-3abf-491f-b6ac-e0fc437e0d68 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:40.177043 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0993a-3abf-491f-b6ac-e0fc437e0d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:40.177411 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db0993a-3abf-491f-b6ac-e0fc437e0d68 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:40.178225 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0993a-3abf-491f-b6ac-e0fc437e0d68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:40.180325 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db0993a-3abf-491f-b6ac-e0fc437e0d68 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:40.219041 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 956/1907] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:25:40 2022] POST /identity/v3/users => generated 295 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:40.219896 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0993a-3abf-491f-b6ac-e0fc437e0d68 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:40.240525 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db0993a-3abf-491f-b6ac-e0fc437e0d68 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:40.240758 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 952/1908] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:40.241820 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228666dc-5d59-4cd1-8ee8-1539f9f0ab79 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:40.246092 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560b6b6-8cdf-48f9-9f5d-b14ec5451574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:40.246719 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560b6b6-8cdf-48f9-9f5d-b14ec5451574 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:40.246996 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560b6b6-8cdf-48f9-9f5d-b14ec5451574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:40.247271 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560b6b6-8cdf-48f9-9f5d-b14ec5451574 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:40.247970 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560b6b6-8cdf-48f9-9f5d-b14ec5451574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:40.249623 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560b6b6-8cdf-48f9-9f5d-b14ec5451574 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:40.261134 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228666dc-5d59-4cd1-8ee8-1539f9f0ab79 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:40.266659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c3e7f-b2e8-482f-b168-f03a1b3299e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:40.267520 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c3e7f-b2e8-482f-b168-f03a1b3299e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:40.267881 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c3e7f-b2e8-482f-b168-f03a1b3299e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:40.268256 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c3e7f-b2e8-482f-b168-f03a1b3299e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:40.269871 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c3e7f-b2e8-482f-b168-f03a1b3299e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:40.271967 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c3e7f-b2e8-482f-b168-f03a1b3299e6 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:40.275276 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 957/1909] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:40.276977 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560b6b6-8cdf-48f9-9f5d-b14ec5451574 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:40.302380 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560b6b6-8cdf-48f9-9f5d-b14ec5451574 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:40.308593 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d0efd-fbef-4964-8e39-ef75b50bd966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:40.309346 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d0efd-fbef-4964-8e39-ef75b50bd966 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:40.309701 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d0efd-fbef-4964-8e39-ef75b50bd966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:40.310046 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d0efd-fbef-4964-8e39-ef75b50bd966 admin admin] PATH_INFO: `/v3/projects/9108ef15d65947cca73e6f7f9ee3be71/users/9fc8dc1b803540719d4e3f910b05e7ba/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:40.322124 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 953/1910] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:25:40 2022] POST /identity/v3/projects => generated 381 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:40.326748 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c3e7f-b2e8-482f-b168-f03a1b3299e6 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:40.331763 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d0efd-fbef-4964-8e39-ef75b50bd966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9108ef15d65947cca73e6f7f9ee3be71, user_id=9fc8dc1b803540719d4e3f910b05e7ba, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:40.342424 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d0efd-fbef-4964-8e39-ef75b50bd966 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:40.360569 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 958/1911] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:40 2022] PUT /identity/v3/projects/9108ef15d65947cca73e6f7f9ee3be71/users/9fc8dc1b803540719d4e3f910b05e7ba/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:25:40.365494 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d0efd-fbef-4964-8e39-ef75b50bd966 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:40.424079 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:40.461274 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c3e7f-b2e8-482f-b168-f03a1b3299e6 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:40.463764 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d0efd-fbef-4964-8e39-ef75b50bd966 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:40.469730 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442b485-f71e-485a-9f98-830bb12045ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:40.470383 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442b485-f71e-485a-9f98-830bb12045ca admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:40.470687 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442b485-f71e-485a-9f98-830bb12045ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:40.471042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d442b485-f71e-485a-9f98-830bb12045ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:40.471792 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d442b485-f71e-485a-9f98-830bb12045ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:40.473422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d442b485-f71e-485a-9f98-830bb12045ca admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:40.474002 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d823bea-91ed-4eeb-9209-7967ca22e251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:40.475227 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d823bea-91ed-4eeb-9209-7967ca22e251 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:40.475696 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d823bea-91ed-4eeb-9209-7967ca22e251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:40.476172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d823bea-91ed-4eeb-9209-7967ca22e251 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:40.477320 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d823bea-91ed-4eeb-9209-7967ca22e251 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:40.480602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d823bea-91ed-4eeb-9209-7967ca22e251 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:40.497781 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 959/1912] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:40.501775 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442b485-f71e-485a-9f98-830bb12045ca admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:40.511286 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 954/1913] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:25:40 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:40.512482 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d823bea-91ed-4eeb-9209-7967ca22e251 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:40.513358 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d442b485-f71e-485a-9f98-830bb12045ca admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:40.518597 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d983dd-b922-4731-8435-4e8d21681056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:40.519687 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d983dd-b922-4731-8435-4e8d21681056 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:40.519687 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d983dd-b922-4731-8435-4e8d21681056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:40.520015 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d983dd-b922-4731-8435-4e8d21681056 admin admin] PATH_INFO: `/v3/projects/9108ef15d65947cca73e6f7f9ee3be71/users/9fc8dc1b803540719d4e3f910b05e7ba/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:40.521830 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d983dd-b922-4731-8435-4e8d21681056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9108ef15d65947cca73e6f7f9ee3be71, user_id=9fc8dc1b803540719d4e3f910b05e7ba, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:40.523782 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d823bea-91ed-4eeb-9209-7967ca22e251 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:40.525754 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d983dd-b922-4731-8435-4e8d21681056 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:40.528619 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea98c2-b2e5-4ad8-9577-ed1ab20c50a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:40.529559 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea98c2-b2e5-4ad8-9577-ed1ab20c50a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:40.529996 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea98c2-b2e5-4ad8-9577-ed1ab20c50a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:40.530399 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea98c2-b2e5-4ad8-9577-ed1ab20c50a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:40.531101 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea98c2-b2e5-4ad8-9577-ed1ab20c50a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:40.533191 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea98c2-b2e5-4ad8-9577-ed1ab20c50a2 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:40.537311 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 960/1914] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:40 2022] PUT /identity/v3/projects/9108ef15d65947cca73e6f7f9ee3be71/users/9fc8dc1b803540719d4e3f910b05e7ba/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:25:40.541392 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d983dd-b922-4731-8435-4e8d21681056 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:40.554876 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 955/1915] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:40.556197 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9730e-2587-4d65-9a66-04a0b06a44fd None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:40.556454 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9730e-2587-4d65-9a66-04a0b06a44fd None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:40.556867 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc9730e-2587-4d65-9a66-04a0b06a44fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:40.584300 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-7bc9730e-2587-4d65-9a66-04a0b06a44fd None None] MFA Rules not processed for user `9fc8dc1b803540719d4e3f910b05e7ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:40.585519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7bc9730e-2587-4d65-9a66-04a0b06a44fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:40.598330 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:40.611876 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d983dd-b922-4731-8435-4e8d21681056 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:40.617102 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353bc5f-8039-4e4d-9fbc-72ec70253a94 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dcf750c4a4aea972019a1e15efbb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e055d57639434784b78bc668031a77', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:40.617954 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353bc5f-8039-4e4d-9fbc-72ec70253a94 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:40.618250 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353bc5f-8039-4e4d-9fbc-72ec70253a94 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:40.618510 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353bc5f-8039-4e4d-9fbc-72ec70253a94 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:40.619235 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353bc5f-8039-4e4d-9fbc-72ec70253a94 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:25:40.619539 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353bc5f-8039-4e4d-9fbc-72ec70253a94 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:40.621800 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353bc5f-8039-4e4d-9fbc-72ec70253a94 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:40.634236 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 961/1916] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:25:40.637239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353bc5f-8039-4e4d-9fbc-72ec70253a94 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:40.659448 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 956/1917] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:40.660916 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9730e-2587-4d65-9a66-04a0b06a44fd None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:40.672257 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc9730e-2587-4d65-9a66-04a0b06a44fd None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:40.681788 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd736e53-fbbd-4e94-ba2f-32ed26390b62 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dcf750c4a4aea972019a1e15efbb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e055d57639434784b78bc668031a77', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:40.681788 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd736e53-fbbd-4e94-ba2f-32ed26390b62 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:40.681788 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd736e53-fbbd-4e94-ba2f-32ed26390b62 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:40.687358 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd736e53-fbbd-4e94-ba2f-32ed26390b62 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:40.687358 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd736e53-fbbd-4e94-ba2f-32ed26390b62 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:40.687358 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd736e53-fbbd-4e94-ba2f-32ed26390b62 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:40.718973 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353bc5f-8039-4e4d-9fbc-72ec70253a94 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:40.728378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53dbfb-a2a2-4d97-99ec-fb67dc919b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:40.730061 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53dbfb-a2a2-4d97-99ec-fb67dc919b1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:40.730226 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53dbfb-a2a2-4d97-99ec-fb67dc919b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:40.731794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53dbfb-a2a2-4d97-99ec-fb67dc919b1c admin admin] PATH_INFO: `/v3/projects/a227cd22b5824ab8a7459ca628527403/users/230d2471a0874d8daf0c9952e0a5fdd5/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:40.749696 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53dbfb-a2a2-4d97-99ec-fb67dc919b1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a227cd22b5824ab8a7459ca628527403, user_id=230d2471a0874d8daf0c9952e0a5fdd5, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:40.761479 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53dbfb-a2a2-4d97-99ec-fb67dc919b1c admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:40.811918 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 957/1918] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:25:40 2022] POST /identity/v3/projects => generated 354 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:40.815926 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd736e53-fbbd-4e94-ba2f-32ed26390b62 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:40.827240 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 962/1919] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:40 2022] PUT /identity/v3/projects/a227cd22b5824ab8a7459ca628527403/users/230d2471a0874d8daf0c9952e0a5fdd5/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:40.828272 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53dbfb-a2a2-4d97-99ec-fb67dc919b1c admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:40.873058 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd736e53-fbbd-4e94-ba2f-32ed26390b62 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:40.889411 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53dbfb-a2a2-4d97-99ec-fb67dc919b1c admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:40.894077 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250b872-c846-40b8-bd6d-f078233b2660 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dcf750c4a4aea972019a1e15efbb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e055d57639434784b78bc668031a77', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:40.894782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250b872-c846-40b8-bd6d-f078233b2660 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:40.895063 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250b872-c846-40b8-bd6d-f078233b2660 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:40.895366 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250b872-c846-40b8-bd6d-f078233b2660 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:40.896111 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250b872-c846-40b8-bd6d-f078233b2660 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:25:40.896413 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250b872-c846-40b8-bd6d-f078233b2660 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:40.897990 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250b872-c846-40b8-bd6d-f078233b2660 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:40.904696 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:40.910811 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 963/1920] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:25:40.911718 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250b872-c846-40b8-bd6d-f078233b2660 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:40.926495 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa65b60-6d24-4c11-8b27-ada85112e930 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:40.927233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa65b60-6d24-4c11-8b27-ada85112e930 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:40.927609 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa65b60-6d24-4c11-8b27-ada85112e930 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:40.927979 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa65b60-6d24-4c11-8b27-ada85112e930 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:40.974892 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250b872-c846-40b8-bd6d-f078233b2660 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:40.980291 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78b6c3-0853-4fe3-9a44-bb95a420925c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:40.981002 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78b6c3-0853-4fe3-9a44-bb95a420925c admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:40.981562 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78b6c3-0853-4fe3-9a44-bb95a420925c admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:40.981834 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78b6c3-0853-4fe3-9a44-bb95a420925c admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:40.982524 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78b6c3-0853-4fe3-9a44-bb95a420925c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:40.984126 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78b6c3-0853-4fe3-9a44-bb95a420925c admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:40.986274 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:40.991511 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa65b60-6d24-4c11-8b27-ada85112e930 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:40.993207 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa65b60-6d24-4c11-8b27-ada85112e930 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:40.996988 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 964/1921] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:40.998073 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78b6c3-0853-4fe3-9a44-bb95a420925c admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:41.003888 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 958/1922] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:41.004842 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa65b60-6d24-4c11-8b27-ada85112e930 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:41.013600 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78b6c3-0853-4fe3-9a44-bb95a420925c admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:41.016848 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa65b60-6d24-4c11-8b27-ada85112e930 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:41.019673 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9309fc-f80d-49c1-85f4-0d3d4922dd24 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b53dcf750c4a4aea972019a1e15efbb8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '58e055d57639434784b78bc668031a77', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:41.020622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9309fc-f80d-49c1-85f4-0d3d4922dd24 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:41.021129 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9309fc-f80d-49c1-85f4-0d3d4922dd24 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:41.021506 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9309fc-f80d-49c1-85f4-0d3d4922dd24 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] PATH_INFO: `/v3/projects/172d681a475d4731b3881b7e1531ceec` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:41.022982 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9309fc-f80d-49c1-85f4-0d3d4922dd24 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] RBAC: Authorizing `identity:delete_project(project_id=172d681a475d4731b3881b7e1531ceec)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:41.023143 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc3d88-9fae-42e8-b628-028477feee3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:41.023828 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc3d88-9fae-42e8-b628-028477feee3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:41.024146 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc3d88-9fae-42e8-b628-028477feee3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:41.024428 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc3d88-9fae-42e8-b628-028477feee3b admin admin] PATH_INFO: `/v3/projects/a227cd22b5824ab8a7459ca628527403/users/230d2471a0874d8daf0c9952e0a5fdd5/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:41.028763 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9309fc-f80d-49c1-85f4-0d3d4922dd24 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:41.031942 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc3d88-9fae-42e8-b628-028477feee3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a227cd22b5824ab8a7459ca628527403, user_id=230d2471a0874d8daf0c9952e0a5fdd5, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:41.034594 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fc3d88-9fae-42e8-b628-028477feee3b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:41.050939 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 959/1923] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:41 2022] PUT /identity/v3/projects/a227cd22b5824ab8a7459ca628527403/users/230d2471a0874d8daf0c9952e0a5fdd5/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:41.064080 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c7428-2999-4f4b-90a8-73f4c319d313 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:41.064080 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c7428-2999-4f4b-90a8-73f4c319d313 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:41.065235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c7428-2999-4f4b-90a8-73f4c319d313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:41.103107 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-bd7c7428-2999-4f4b-90a8-73f4c319d313 None None] MFA Rules not processed for user `230d2471a0874d8daf0c9952e0a5fdd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:41.105283 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bd7c7428-2999-4f4b-90a8-73f4c319d313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:41.107787 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ba9309fc-f80d-49c1-85f4-0d3d4922dd24 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '172d681a475d4731b3881b7e1531ceec', 'request_id': 'req-ba9309fc-f80d-49c1-85f4-0d3d4922dd24'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:41.120132 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ba9309fc-f80d-49c1-85f4-0d3d4922dd24 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '172d681a475d4731b3881b7e1531ceec', 'request_id': 'req-ba9309fc-f80d-49c1-85f4-0d3d4922dd24'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:41.130659 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ba9309fc-f80d-49c1-85f4-0d3d4922dd24 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '172d681a475d4731b3881b7e1531ceec', 'request_id': 'req-ba9309fc-f80d-49c1-85f4-0d3d4922dd24'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:41.148356 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ba9309fc-f80d-49c1-85f4-0d3d4922dd24 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] The token cache is being invalidate because project 172d681a475d4731b3881b7e1531ceec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:25:41.149871 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ba9309fc-f80d-49c1-85f4-0d3d4922dd24 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:41.150811 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ba9309fc-f80d-49c1-85f4-0d3d4922dd24 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:41.156676 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 965/1924] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:25:40 2022] DELETE /identity/v3/projects/172d681a475d4731b3881b7e1531ceec => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:41.218348 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 960/1925] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:41.322048 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9309fc-f80d-49c1-85f4-0d3d4922dd24 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:41.324550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ba9309fc-f80d-49c1-85f4-0d3d4922dd24 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:41.453343 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9309fc-f80d-49c1-85f4-0d3d4922dd24 tempest-VolumeQuotaClassesTest-704636260 tempest-VolumeQuotaClassesTest-704636260-project-admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:41.457719 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a7a91-43be-4f06-a593-2849fe4a9263 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:41.458403 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a7a91-43be-4f06-a593-2849fe4a9263 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:41.458735 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a7a91-43be-4f06-a593-2849fe4a9263 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:41.459412 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a7a91-43be-4f06-a593-2849fe4a9263 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:41.471038 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a7a91-43be-4f06-a593-2849fe4a9263 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:41.472811 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a7a91-43be-4f06-a593-2849fe4a9263 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:41.485134 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 966/1926] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:41 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:41.712752 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c7428-2999-4f4b-90a8-73f4c319d313 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:41.714338 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bd7c7428-2999-4f4b-90a8-73f4c319d313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:41.744573 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a7a91-43be-4f06-a593-2849fe4a9263 service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:41.754187 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a7a91-43be-4f06-a593-2849fe4a9263 service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:41.758387 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223db2a8-9863-4fee-b7ce-f26662cf0e84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:41.759044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223db2a8-9863-4fee-b7ce-f26662cf0e84 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:41.759297 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223db2a8-9863-4fee-b7ce-f26662cf0e84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:41.759571 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223db2a8-9863-4fee-b7ce-f26662cf0e84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:41.761996 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-223db2a8-9863-4fee-b7ce-f26662cf0e84 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:41.799010 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c7428-2999-4f4b-90a8-73f4c319d313 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:41.804121 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3eeeb-4915-4878-865f-634f3d1ca51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:41.804728 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3eeeb-4915-4878-865f-634f3d1ca51e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:41.805071 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3eeeb-4915-4878-865f-634f3d1ca51e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:41.805312 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3eeeb-4915-4878-865f-634f3d1ca51e admin admin] PATH_INFO: `/v3/users/e68e7024faee4fc599bd111eaaf3f875` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:41.806723 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd3eeeb-4915-4878-865f-634f3d1ca51e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e68e7024faee4fc599bd111eaaf3f875)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:41.809375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd3eeeb-4915-4878-865f-634f3d1ca51e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:41.812227 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:41.833491 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223db2a8-9863-4fee-b7ce-f26662cf0e84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:41.835138 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223db2a8-9863-4fee-b7ce-f26662cf0e84 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:41.846733 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 967/1927] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 15:25:41.864467 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7cd3eeeb-4915-4878-865f-634f3d1ca51e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e68e7024faee4fc599bd111eaaf3f875'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:41.866091 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7cd3eeeb-4915-4878-865f-634f3d1ca51e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e68e7024faee4fc599bd111eaaf3f875'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:41.873986 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7cd3eeeb-4915-4878-865f-634f3d1ca51e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e68e7024faee4fc599bd111eaaf3f875'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:41.874725 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7cd3eeeb-4915-4878-865f-634f3d1ca51e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e68e7024faee4fc599bd111eaaf3f875'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:41.890871 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7cd3eeeb-4915-4878-865f-634f3d1ca51e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e68e7024faee4fc599bd111eaaf3f875'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:41.907433 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 961/1928] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:25:41 2022] DELETE /identity/v3/users/e68e7024faee4fc599bd111eaaf3f875 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:41.912198 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f86ad5-64e8-4752-a0c6-d6d9c6605983 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:41.912493 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f86ad5-64e8-4752-a0c6-d6d9c6605983 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:41.912775 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f86ad5-64e8-4752-a0c6-d6d9c6605983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:41.937453 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-54f86ad5-64e8-4752-a0c6-d6d9c6605983 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:41.938898 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-54f86ad5-64e8-4752-a0c6-d6d9c6605983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:41.959479 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:42.026340 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 968/1929] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:25:42.035911 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3eeeb-4915-4878-865f-634f3d1ca51e admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:42.037632 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7cd3eeeb-4915-4878-865f-634f3d1ca51e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:42.114980 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3eeeb-4915-4878-865f-634f3d1ca51e admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:42.118898 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496894e-0fc1-44a2-840e-68acf344c4ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:42.119524 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496894e-0fc1-44a2-840e-68acf344c4ed service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:42.119811 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496894e-0fc1-44a2-840e-68acf344c4ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:42.120399 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496894e-0fc1-44a2-840e-68acf344c4ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:42.132856 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5496894e-0fc1-44a2-840e-68acf344c4ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:42.134349 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5496894e-0fc1-44a2-840e-68acf344c4ed service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:42.163173 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 962/1930] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:42.512553 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f86ad5-64e8-4752-a0c6-d6d9c6605983 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:42.514001 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-54f86ad5-64e8-4752-a0c6-d6d9c6605983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:42.530207 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f86ad5-64e8-4752-a0c6-d6d9c6605983 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:42.534103 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dafac4-ced8-4b0f-aceb-654c3ca36327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:42.534900 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dafac4-ced8-4b0f-aceb-654c3ca36327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:42.535475 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dafac4-ced8-4b0f-aceb-654c3ca36327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:42.535595 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dafac4-ced8-4b0f-aceb-654c3ca36327 admin admin] PATH_INFO: `/v3/projects/ec8b328eb0bd4038aa39a0a181654b90` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:42.537090 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dafac4-ced8-4b0f-aceb-654c3ca36327 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec8b328eb0bd4038aa39a0a181654b90)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:42.548884 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dafac4-ced8-4b0f-aceb-654c3ca36327 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:42.630508 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-a8dafac4-ced8-4b0f-aceb-654c3ca36327 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec8b328eb0bd4038aa39a0a181654b90', 'request_id': 'req-a8dafac4-ced8-4b0f-aceb-654c3ca36327'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:42.639647 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-a8dafac4-ced8-4b0f-aceb-654c3ca36327 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec8b328eb0bd4038aa39a0a181654b90', 'request_id': 'req-a8dafac4-ced8-4b0f-aceb-654c3ca36327'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:42.649404 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-a8dafac4-ced8-4b0f-aceb-654c3ca36327 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec8b328eb0bd4038aa39a0a181654b90', 'request_id': 'req-a8dafac4-ced8-4b0f-aceb-654c3ca36327'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:42.669307 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-a8dafac4-ced8-4b0f-aceb-654c3ca36327 admin admin] The token cache is being invalidate because project ec8b328eb0bd4038aa39a0a181654b90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:25:42.672789 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-a8dafac4-ced8-4b0f-aceb-654c3ca36327 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:42.680764 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-a8dafac4-ced8-4b0f-aceb-654c3ca36327 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:42.686910 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 969/1931] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:25:42 2022] DELETE /identity/v3/projects/ec8b328eb0bd4038aa39a0a181654b90 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:42.693104 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496894e-0fc1-44a2-840e-68acf344c4ed service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:42.713619 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496894e-0fc1-44a2-840e-68acf344c4ed service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:42.807460 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce29daf-aba9-4bf7-9745-1e6730381e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:42.808252 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce29daf-aba9-4bf7-9745-1e6730381e31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:42.808668 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce29daf-aba9-4bf7-9745-1e6730381e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:42.808951 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce29daf-aba9-4bf7-9745-1e6730381e31 admin admin] PATH_INFO: `/v3/users/b53dcf750c4a4aea972019a1e15efbb8` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:42.810235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce29daf-aba9-4bf7-9745-1e6730381e31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b53dcf750c4a4aea972019a1e15efbb8)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:42.812353 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce29daf-aba9-4bf7-9745-1e6730381e31 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:42.845330 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:42.870078 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5ce29daf-aba9-4bf7-9745-1e6730381e31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b53dcf750c4a4aea972019a1e15efbb8'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:42.871193 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5ce29daf-aba9-4bf7-9745-1e6730381e31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b53dcf750c4a4aea972019a1e15efbb8'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:42.881411 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5ce29daf-aba9-4bf7-9745-1e6730381e31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b53dcf750c4a4aea972019a1e15efbb8'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:42.881411 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5ce29daf-aba9-4bf7-9745-1e6730381e31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b53dcf750c4a4aea972019a1e15efbb8'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:42.900381 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5ce29daf-aba9-4bf7-9745-1e6730381e31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b53dcf750c4a4aea972019a1e15efbb8'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:42.937220 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 963/1932] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:25:42 2022] DELETE /identity/v3/users/b53dcf750c4a4aea972019a1e15efbb8 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:43.254941 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dafac4-ced8-4b0f-aceb-654c3ca36327 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:43.256797 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a8dafac4-ced8-4b0f-aceb-654c3ca36327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:43.288117 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dafac4-ced8-4b0f-aceb-654c3ca36327 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:43.355920 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac72bfd5-bb76-41c5-bef0-783d73ffee2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:43.356647 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72bfd5-bb76-41c5-bef0-783d73ffee2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:43.356923 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72bfd5-bb76-41c5-bef0-783d73ffee2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:43.357194 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac72bfd5-bb76-41c5-bef0-783d73ffee2e admin admin] PATH_INFO: `/v3/projects/58e055d57639434784b78bc668031a77` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:43.358364 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72bfd5-bb76-41c5-bef0-783d73ffee2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=58e055d57639434784b78bc668031a77)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:43.360293 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac72bfd5-bb76-41c5-bef0-783d73ffee2e admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:43.412786 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:43.414511 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ac72bfd5-bb76-41c5-bef0-783d73ffee2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58e055d57639434784b78bc668031a77', 'request_id': 'req-ac72bfd5-bb76-41c5-bef0-783d73ffee2e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:43.422324 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ac72bfd5-bb76-41c5-bef0-783d73ffee2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58e055d57639434784b78bc668031a77', 'request_id': 'req-ac72bfd5-bb76-41c5-bef0-783d73ffee2e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:43.429219 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ac72bfd5-bb76-41c5-bef0-783d73ffee2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58e055d57639434784b78bc668031a77', 'request_id': 'req-ac72bfd5-bb76-41c5-bef0-783d73ffee2e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:43.442620 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ac72bfd5-bb76-41c5-bef0-783d73ffee2e admin admin] The token cache is being invalidate because project 58e055d57639434784b78bc668031a77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:25:43.442907 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ac72bfd5-bb76-41c5-bef0-783d73ffee2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:43.443541 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ac72bfd5-bb76-41c5-bef0-783d73ffee2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:43.448874 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 970/1933] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:25:43 2022] DELETE /identity/v3/projects/58e055d57639434784b78bc668031a77 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:43.450984 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018c794-9592-420a-818c-56f0bcf6a777 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:43.451420 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018c794-9592-420a-818c-56f0bcf6a777 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:43.451848 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018c794-9592-420a-818c-56f0bcf6a777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:43.472355 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-e018c794-9592-420a-818c-56f0bcf6a777 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:43.473549 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e018c794-9592-420a-818c-56f0bcf6a777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:43.534299 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 964/1934] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:43.542209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133401cf-b33c-4a8d-971f-9d013d00a344 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:43.542710 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133401cf-b33c-4a8d-971f-9d013d00a344 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:43.542800 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133401cf-b33c-4a8d-971f-9d013d00a344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:43.562109 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-133401cf-b33c-4a8d-971f-9d013d00a344 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:43.563293 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-133401cf-b33c-4a8d-971f-9d013d00a344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:43.571410 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 971/1935] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:43.576210 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018c794-9592-420a-818c-56f0bcf6a777 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:43.586409 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018c794-9592-420a-818c-56f0bcf6a777 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:43.591725 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be420cf-1447-4872-bb82-c3e9b848f9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:43.592385 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be420cf-1447-4872-bb82-c3e9b848f9bb admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:43.592667 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be420cf-1447-4872-bb82-c3e9b848f9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:43.592939 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be420cf-1447-4872-bb82-c3e9b848f9bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:43.593636 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be420cf-1447-4872-bb82-c3e9b848f9bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:25:43.593937 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be420cf-1447-4872-bb82-c3e9b848f9bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:43.595514 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be420cf-1447-4872-bb82-c3e9b848f9bb admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:43.607477 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 965/1936] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:25:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:25:43.613176 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133401cf-b33c-4a8d-971f-9d013d00a344 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:43.624108 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133401cf-b33c-4a8d-971f-9d013d00a344 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:43.629417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f258edb-6d0d-48b7-a828-86216fcdb621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:43.630145 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f258edb-6d0d-48b7-a828-86216fcdb621 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:43.630485 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f258edb-6d0d-48b7-a828-86216fcdb621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:43.630924 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f258edb-6d0d-48b7-a828-86216fcdb621 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:43.631644 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f258edb-6d0d-48b7-a828-86216fcdb621 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:43.633767 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f258edb-6d0d-48b7-a828-86216fcdb621 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:43.670077 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 972/1937] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:25:43 2022] POST /identity/v3/projects => generated 393 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:43.674281 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be420cf-1447-4872-bb82-c3e9b848f9bb admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:43.692857 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be420cf-1447-4872-bb82-c3e9b848f9bb admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:43.781778 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d20e39-14a0-41b1-b8f0-efd8d12a5d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:43.782528 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d20e39-14a0-41b1-b8f0-efd8d12a5d4d admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:43.782784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d20e39-14a0-41b1-b8f0-efd8d12a5d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:43.783064 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d20e39-14a0-41b1-b8f0-efd8d12a5d4d admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:43.783816 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d20e39-14a0-41b1-b8f0-efd8d12a5d4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:43.785777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d20e39-14a0-41b1-b8f0-efd8d12a5d4d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:43.827254 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 966/1938] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:25:43 2022] POST /identity/v3/users => generated 297 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:43.832209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f258edb-6d0d-48b7-a828-86216fcdb621 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:43.852499 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f258edb-6d0d-48b7-a828-86216fcdb621 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:43.864343 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12508a72-08ed-452a-ab24-4bc210e9f967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:43.865945 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12508a72-08ed-452a-ab24-4bc210e9f967 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:43.867968 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12508a72-08ed-452a-ab24-4bc210e9f967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:43.868434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12508a72-08ed-452a-ab24-4bc210e9f967 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:43.870988 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12508a72-08ed-452a-ab24-4bc210e9f967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:43.873536 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12508a72-08ed-452a-ab24-4bc210e9f967 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:43.894508 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d20e39-14a0-41b1-b8f0-efd8d12a5d4d admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:43.902704 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 973/1939] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:43.907821 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d20e39-14a0-41b1-b8f0-efd8d12a5d4d admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:43.914118 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a921e9-3a27-4e2d-aea7-4aae2fff4888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:43.914939 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a921e9-3a27-4e2d-aea7-4aae2fff4888 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:43.915384 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a921e9-3a27-4e2d-aea7-4aae2fff4888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:43.916407 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a921e9-3a27-4e2d-aea7-4aae2fff4888 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:43.917666 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a921e9-3a27-4e2d-aea7-4aae2fff4888 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:43.919940 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a921e9-3a27-4e2d-aea7-4aae2fff4888 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:43.942107 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12508a72-08ed-452a-ab24-4bc210e9f967 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:43.948929 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 967/1940] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:43.965946 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12508a72-08ed-452a-ab24-4bc210e9f967 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:43.979464 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92711ec8-48ca-4206-afa8-bc28f70db4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:43.980336 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92711ec8-48ca-4206-afa8-bc28f70db4c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:43.980623 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92711ec8-48ca-4206-afa8-bc28f70db4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:43.980906 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92711ec8-48ca-4206-afa8-bc28f70db4c8 admin admin] PATH_INFO: `/v3/projects/4ebc22a8bded4d56a7aa5fa9ae439d33/users/b74c372047ee4a5f94668f6df2d7cf08/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:44.005930 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a921e9-3a27-4e2d-aea7-4aae2fff4888 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:44.008169 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-69a921e9-3a27-4e2d-aea7-4aae2fff4888 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:44.019470 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92711ec8-48ca-4206-afa8-bc28f70db4c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ebc22a8bded4d56a7aa5fa9ae439d33, user_id=b74c372047ee4a5f94668f6df2d7cf08, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:44.022495 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92711ec8-48ca-4206-afa8-bc28f70db4c8 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:44.022981 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a921e9-3a27-4e2d-aea7-4aae2fff4888 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:44.028086 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b9c5e-ee5e-410b-9f69-7248525a1e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:44.029608 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b9c5e-ee5e-410b-9f69-7248525a1e77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:44.030157 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b9c5e-ee5e-410b-9f69-7248525a1e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:44.030680 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b9c5e-ee5e-410b-9f69-7248525a1e77 admin admin] PATH_INFO: `/v3/users/7390f799dbe14e868b6317cef8efd294` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:44.033317 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b9c5e-ee5e-410b-9f69-7248525a1e77 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7390f799dbe14e868b6317cef8efd294)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:44.035501 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b9c5e-ee5e-410b-9f69-7248525a1e77 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:44.038703 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:44.076348 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 974/1941] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:43 2022] PUT /identity/v3/projects/4ebc22a8bded4d56a7aa5fa9ae439d33/users/b74c372047ee4a5f94668f6df2d7cf08/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:44.077617 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92711ec8-48ca-4206-afa8-bc28f70db4c8 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:44.079739 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-92711ec8-48ca-4206-afa8-bc28f70db4c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:44.135937 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-524b9c5e-ee5e-410b-9f69-7248525a1e77 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7390f799dbe14e868b6317cef8efd294'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:44.136835 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-524b9c5e-ee5e-410b-9f69-7248525a1e77 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7390f799dbe14e868b6317cef8efd294'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:44.149200 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-524b9c5e-ee5e-410b-9f69-7248525a1e77 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7390f799dbe14e868b6317cef8efd294'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:44.150126 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-524b9c5e-ee5e-410b-9f69-7248525a1e77 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7390f799dbe14e868b6317cef8efd294'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:44.170318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-524b9c5e-ee5e-410b-9f69-7248525a1e77 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7390f799dbe14e868b6317cef8efd294'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:44.173166 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92711ec8-48ca-4206-afa8-bc28f70db4c8 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:44.177572 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e214477-7bbf-4be1-a81d-4661d2670671 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:44.178678 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e214477-7bbf-4be1-a81d-4661d2670671 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:44.179017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e214477-7bbf-4be1-a81d-4661d2670671 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:44.179411 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e214477-7bbf-4be1-a81d-4661d2670671 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:44.184420 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-2e214477-7bbf-4be1-a81d-4661d2670671 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:44.192823 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 968/1942] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:25:44 2022] DELETE /identity/v3/users/7390f799dbe14e868b6317cef8efd294 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:25:44.195962 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f17274-5d6b-4711-a728-63afb2ee36de None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:44.195962 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f17274-5d6b-4711-a728-63afb2ee36de None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:44.195962 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f17274-5d6b-4711-a728-63afb2ee36de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:44.227039 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-39f17274-5d6b-4711-a728-63afb2ee36de None None] MFA Rules not processed for user `b74c372047ee4a5f94668f6df2d7cf08`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:44.228443 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-39f17274-5d6b-4711-a728-63afb2ee36de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:44.267201 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e214477-7bbf-4be1-a81d-4661d2670671 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:44.268614 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e214477-7bbf-4be1-a81d-4661d2670671 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:44.292646 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 975/1943] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:44.294364 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2bf96-bf12-4938-a5f6-be080b029e4a None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:44.299295 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2bf96-bf12-4938-a5f6-be080b029e4a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:44.299831 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed2bf96-bf12-4938-a5f6-be080b029e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:44.332746 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 969/1944] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:44.337137 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f17274-5d6b-4711-a728-63afb2ee36de None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:44.342527 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-39f17274-5d6b-4711-a728-63afb2ee36de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:44.345912 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-eed2bf96-bf12-4938-a5f6-be080b029e4a None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:44.347686 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-eed2bf96-bf12-4938-a5f6-be080b029e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:44.391415 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:44.457048 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 976/1945] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:44.466765 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2bf96-bf12-4938-a5f6-be080b029e4a None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:44.469771 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-eed2bf96-bf12-4938-a5f6-be080b029e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:44.509131 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f17274-5d6b-4711-a728-63afb2ee36de None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:44.516336 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb918f6-9da2-4d94-9cbb-e355117caf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:44.517182 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb918f6-9da2-4d94-9cbb-e355117caf09 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:44.517614 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb918f6-9da2-4d94-9cbb-e355117caf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:44.517930 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb918f6-9da2-4d94-9cbb-e355117caf09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:44.518830 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb918f6-9da2-4d94-9cbb-e355117caf09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:44.521050 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb918f6-9da2-4d94-9cbb-e355117caf09 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:44.546796 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:44.578091 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 970/1946] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:25:44 2022] POST /identity/v3/projects => generated 391 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:44.579968 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb918f6-9da2-4d94-9cbb-e355117caf09 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:44.582622 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8bb918f6-9da2-4d94-9cbb-e355117caf09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:44.606904 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed2bf96-bf12-4938-a5f6-be080b029e4a None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:44.680835 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb918f6-9da2-4d94-9cbb-e355117caf09 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:44.688235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e82740-60e6-4a53-86bb-ef3339aad9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:44.689019 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e82740-60e6-4a53-86bb-ef3339aad9c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:44.689525 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e82740-60e6-4a53-86bb-ef3339aad9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:44.689906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e82740-60e6-4a53-86bb-ef3339aad9c8 admin admin] PATH_INFO: `/v3/users/f11706bff55847f2973f81bceb571abf` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:44.691260 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e82740-60e6-4a53-86bb-ef3339aad9c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f11706bff55847f2973f81bceb571abf)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:44.693297 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e82740-60e6-4a53-86bb-ef3339aad9c8 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:44.701022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a746672-e036-4b38-a5c8-ba8f50037b1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:44.702026 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a746672-e036-4b38-a5c8-ba8f50037b1e service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:44.702463 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a746672-e036-4b38-a5c8-ba8f50037b1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:44.703090 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a746672-e036-4b38-a5c8-ba8f50037b1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:44.714238 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a746672-e036-4b38-a5c8-ba8f50037b1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:44.716890 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a746672-e036-4b38-a5c8-ba8f50037b1e service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:44.729235 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 977/1947] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 15:25:44.730055 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a746672-e036-4b38-a5c8-ba8f50037b1e service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:44.740665 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a746672-e036-4b38-a5c8-ba8f50037b1e service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:44.746275 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46f796-49bc-4790-b9a4-7077e36d234b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:44.746896 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46f796-49bc-4790-b9a4-7077e36d234b admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:44.747182 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46f796-49bc-4790-b9a4-7077e36d234b admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:44.747516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46f796-49bc-4790-b9a4-7077e36d234b admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:44.748215 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46f796-49bc-4790-b9a4-7077e36d234b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:44.750433 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46f796-49bc-4790-b9a4-7077e36d234b admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:44.759299 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e7e82740-60e6-4a53-86bb-ef3339aad9c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f11706bff55847f2973f81bceb571abf'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:44.761143 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e7e82740-60e6-4a53-86bb-ef3339aad9c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f11706bff55847f2973f81bceb571abf'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:44.771223 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e7e82740-60e6-4a53-86bb-ef3339aad9c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f11706bff55847f2973f81bceb571abf'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:44.772104 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e7e82740-60e6-4a53-86bb-ef3339aad9c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f11706bff55847f2973f81bceb571abf'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:44.789241 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 978/1948] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:25:44 2022] POST /identity/v3/users => generated 302 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:44.790673 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46f796-49bc-4790-b9a4-7077e36d234b admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:44.794171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-db46f796-49bc-4790-b9a4-7077e36d234b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:44.803243 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e7e82740-60e6-4a53-86bb-ef3339aad9c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f11706bff55847f2973f81bceb571abf'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:44.818298 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46f796-49bc-4790-b9a4-7077e36d234b admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:44.825790 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fab01f-76ee-4026-a88f-6f9b1ce6213e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:44.826687 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fab01f-76ee-4026-a88f-6f9b1ce6213e admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:44.827169 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fab01f-76ee-4026-a88f-6f9b1ce6213e admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:44.827610 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fab01f-76ee-4026-a88f-6f9b1ce6213e admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:44.828397 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fab01f-76ee-4026-a88f-6f9b1ce6213e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:44.832037 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 971/1949] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:25:44 2022] DELETE /identity/v3/users/f11706bff55847f2973f81bceb571abf => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:44.832169 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fab01f-76ee-4026-a88f-6f9b1ce6213e admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:44.833916 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65026e04-2129-4954-85fa-f28b4294bc39 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:44.834207 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65026e04-2129-4954-85fa-f28b4294bc39 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:44.837049 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65026e04-2129-4954-85fa-f28b4294bc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:44.841797 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 979/1950] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 15:25:44.846477 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fab01f-76ee-4026-a88f-6f9b1ce6213e admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:44.858278 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fab01f-76ee-4026-a88f-6f9b1ce6213e admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:44.863726 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-65026e04-2129-4954-85fa-f28b4294bc39 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:44.865002 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-65026e04-2129-4954-85fa-f28b4294bc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:44.927515 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:44.940829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 972/1951] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:44.941913 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7ecc5-d5cc-4c86-a0ae-1dde24d4b011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:44.942602 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7ecc5-d5cc-4c86-a0ae-1dde24d4b011 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:44.943091 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7ecc5-d5cc-4c86-a0ae-1dde24d4b011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:44.943298 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe7ecc5-d5cc-4c86-a0ae-1dde24d4b011 admin admin] PATH_INFO: `/v3/projects/e149463d45db413aa1cd78f097e83546/users/d0a70f4fa0004eb8bc9a76b5a4e362c2/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:44.950573 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65026e04-2129-4954-85fa-f28b4294bc39 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:44.951961 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-65026e04-2129-4954-85fa-f28b4294bc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:44.962135 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7ecc5-d5cc-4c86-a0ae-1dde24d4b011 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e149463d45db413aa1cd78f097e83546, user_id=d0a70f4fa0004eb8bc9a76b5a4e362c2, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:44.965406 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe7ecc5-d5cc-4c86-a0ae-1dde24d4b011 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:44.971304 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:44.984422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 980/1952] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:44 2022] PUT /identity/v3/projects/e149463d45db413aa1cd78f097e83546/users/d0a70f4fa0004eb8bc9a76b5a4e362c2/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:44.988936 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7ecc5-d5cc-4c86-a0ae-1dde24d4b011 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:45.036442 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65026e04-2129-4954-85fa-f28b4294bc39 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:45.079652 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe7ecc5-d5cc-4c86-a0ae-1dde24d4b011 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:45.090845 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d32c2-08a1-47a2-a008-3e4fd2ec98b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:45.091475 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d32c2-08a1-47a2-a008-3e4fd2ec98b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:45.091789 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d32c2-08a1-47a2-a008-3e4fd2ec98b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:45.092201 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d32c2-08a1-47a2-a008-3e4fd2ec98b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:45.092787 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d32c2-08a1-47a2-a008-3e4fd2ec98b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:45.094397 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d32c2-08a1-47a2-a008-3e4fd2ec98b2 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:45.101047 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091dddb-7fed-4743-a47e-7be057a43fb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:45.101718 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091dddb-7fed-4743-a47e-7be057a43fb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:45.102045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091dddb-7fed-4743-a47e-7be057a43fb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:45.102392 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091dddb-7fed-4743-a47e-7be057a43fb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:45.109459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 981/1953] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:44 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 15:25:45.109459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d32c2-08a1-47a2-a008-3e4fd2ec98b2 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:45.109459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-730d32c2-08a1-47a2-a008-3e4fd2ec98b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:45.117549 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091dddb-7fed-4743-a47e-7be057a43fb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:45.119803 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091dddb-7fed-4743-a47e-7be057a43fb0 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:45.130901 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 973/1954] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 15:25:45.131769 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091dddb-7fed-4743-a47e-7be057a43fb0 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:45.132663 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d32c2-08a1-47a2-a008-3e4fd2ec98b2 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:45.139531 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140efdb0-ca0f-4c17-9aa1-9d43c24b0f47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:45.140205 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140efdb0-ca0f-4c17-9aa1-9d43c24b0f47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:45.140469 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140efdb0-ca0f-4c17-9aa1-9d43c24b0f47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:45.140752 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140efdb0-ca0f-4c17-9aa1-9d43c24b0f47 admin admin] PATH_INFO: `/v3/projects/5352475cb6a24ebb98131c44e6885147` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:45.141990 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140efdb0-ca0f-4c17-9aa1-9d43c24b0f47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5352475cb6a24ebb98131c44e6885147)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:45.144033 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140efdb0-ca0f-4c17-9aa1-9d43c24b0f47 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:45.144439 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091dddb-7fed-4743-a47e-7be057a43fb0 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:45.149564 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd3b38-b3fd-4d6b-89c4-f3bc0af6998e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:45.150318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd3b38-b3fd-4d6b-89c4-f3bc0af6998e admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:45.150672 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd3b38-b3fd-4d6b-89c4-f3bc0af6998e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:45.151611 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd3b38-b3fd-4d6b-89c4-f3bc0af6998e admin admin] PATH_INFO: `/v3/projects/e149463d45db413aa1cd78f097e83546/users/d0a70f4fa0004eb8bc9a76b5a4e362c2/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:45.153741 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd3b38-b3fd-4d6b-89c4-f3bc0af6998e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e149463d45db413aa1cd78f097e83546, user_id=d0a70f4fa0004eb8bc9a76b5a4e362c2, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:45.156744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd3b38-b3fd-4d6b-89c4-f3bc0af6998e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:45.179068 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 974/1955] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:45 2022] PUT /identity/v3/projects/e149463d45db413aa1cd78f097e83546/users/d0a70f4fa0004eb8bc9a76b5a4e362c2/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:45.180749 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824969f-7dd7-4a17-8c71-2718d170ef68 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:45.181142 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824969f-7dd7-4a17-8c71-2718d170ef68 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:45.181539 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f824969f-7dd7-4a17-8c71-2718d170ef68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:45.225310 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-140efdb0-ca0f-4c17-9aa1-9d43c24b0f47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5352475cb6a24ebb98131c44e6885147', 'request_id': 'req-140efdb0-ca0f-4c17-9aa1-9d43c24b0f47'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:45.227849 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f824969f-7dd7-4a17-8c71-2718d170ef68 None None] MFA Rules not processed for user `d0a70f4fa0004eb8bc9a76b5a4e362c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:45.229170 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f824969f-7dd7-4a17-8c71-2718d170ef68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:45.235546 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-140efdb0-ca0f-4c17-9aa1-9d43c24b0f47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5352475cb6a24ebb98131c44e6885147', 'request_id': 'req-140efdb0-ca0f-4c17-9aa1-9d43c24b0f47'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:45.245640 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-140efdb0-ca0f-4c17-9aa1-9d43c24b0f47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5352475cb6a24ebb98131c44e6885147', 'request_id': 'req-140efdb0-ca0f-4c17-9aa1-9d43c24b0f47'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:45.263316 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-140efdb0-ca0f-4c17-9aa1-9d43c24b0f47 admin admin] The token cache is being invalidate because project 5352475cb6a24ebb98131c44e6885147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:25:45.263733 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-140efdb0-ca0f-4c17-9aa1-9d43c24b0f47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:45.264583 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-140efdb0-ca0f-4c17-9aa1-9d43c24b0f47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:45.266278 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 982/1956] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:25:45 2022] DELETE /identity/v3/projects/5352475cb6a24ebb98131c44e6885147 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:45.270889 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140efdb0-ca0f-4c17-9aa1-9d43c24b0f47 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:45.273170 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-140efdb0-ca0f-4c17-9aa1-9d43c24b0f47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:45.351051 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:45.359106 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140efdb0-ca0f-4c17-9aa1-9d43c24b0f47 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:45.361291 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 975/1957] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:45 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:45.374047 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930205f-fcd2-4370-bd18-aea36c11cdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:45.374047 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930205f-fcd2-4370-bd18-aea36c11cdcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:45.374047 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930205f-fcd2-4370-bd18-aea36c11cdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:45.374047 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5930205f-fcd2-4370-bd18-aea36c11cdcd admin admin] PATH_INFO: `/v3/users/c5a2db0576444698adfbfecf75480c23` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:45.375983 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930205f-fcd2-4370-bd18-aea36c11cdcd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5a2db0576444698adfbfecf75480c23)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:45.378315 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824969f-7dd7-4a17-8c71-2718d170ef68 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:45.378660 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5930205f-fcd2-4370-bd18-aea36c11cdcd admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:45.380207 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f824969f-7dd7-4a17-8c71-2718d170ef68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:45.467454 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-5930205f-fcd2-4370-bd18-aea36c11cdcd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5a2db0576444698adfbfecf75480c23'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:45.468464 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-5930205f-fcd2-4370-bd18-aea36c11cdcd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5a2db0576444698adfbfecf75480c23'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:45.473652 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:45.481973 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-5930205f-fcd2-4370-bd18-aea36c11cdcd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5a2db0576444698adfbfecf75480c23'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:45.488283 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f824969f-7dd7-4a17-8c71-2718d170ef68 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:45.494082 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42075b6-654c-484a-aa64-550d40af5c49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:45.495126 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-5930205f-fcd2-4370-bd18-aea36c11cdcd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5a2db0576444698adfbfecf75480c23'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:45.495366 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42075b6-654c-484a-aa64-550d40af5c49 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:45.495728 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42075b6-654c-484a-aa64-550d40af5c49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:45.496151 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42075b6-654c-484a-aa64-550d40af5c49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:45.510090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42075b6-654c-484a-aa64-550d40af5c49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:45.511706 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-5930205f-fcd2-4370-bd18-aea36c11cdcd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5a2db0576444698adfbfecf75480c23'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:45.512667 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42075b6-654c-484a-aa64-550d40af5c49 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:45.533584 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 983/1958] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:25:45 2022] DELETE /identity/v3/users/c5a2db0576444698adfbfecf75480c23 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:45.543108 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 976/1959] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:45 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:45.603396 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930205f-fcd2-4370-bd18-aea36c11cdcd admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:45.605806 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5930205f-fcd2-4370-bd18-aea36c11cdcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:45.697209 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42075b6-654c-484a-aa64-550d40af5c49 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:45.699334 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a42075b6-654c-484a-aa64-550d40af5c49 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:45.721391 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42075b6-654c-484a-aa64-550d40af5c49 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:45.727473 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5930205f-fcd2-4370-bd18-aea36c11cdcd admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:45.748997 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a19881-cfcb-456a-b892-4e1ec7c8dd2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:45.749652 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a19881-cfcb-456a-b892-4e1ec7c8dd2b service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:45.749979 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a19881-cfcb-456a-b892-4e1ec7c8dd2b service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:45.750260 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a19881-cfcb-456a-b892-4e1ec7c8dd2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:45.752255 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-51a19881-cfcb-456a-b892-4e1ec7c8dd2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:45.809372 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c0788-7105-4b52-8824-ba9e3197bc4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:45.810336 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c0788-7105-4b52-8824-ba9e3197bc4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:45.810694 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c0788-7105-4b52-8824-ba9e3197bc4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:45.811043 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6c0788-7105-4b52-8824-ba9e3197bc4b admin admin] PATH_INFO: `/v3/projects/570f0e40c0fc4712b457ea84f246ac5d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:45.813246 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c0788-7105-4b52-8824-ba9e3197bc4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=570f0e40c0fc4712b457ea84f246ac5d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:45.815679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6c0788-7105-4b52-8824-ba9e3197bc4b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:45.891010 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a19881-cfcb-456a-b892-4e1ec7c8dd2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:45.892790 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a19881-cfcb-456a-b892-4e1ec7c8dd2b service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:45.903097 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 984/1960] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:45.905320 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e86fd4-fe27-4b96-b92d-fcb56a4fd494 None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:45.905599 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e86fd4-fe27-4b96-b92d-fcb56a4fd494 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:45.906524 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e86fd4-fe27-4b96-b92d-fcb56a4fd494 None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:45.907860 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 985/1961] 10.222.0.40 () {54 vars in 921 bytes} [Wed Jul 27 15:25:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:25:45.929826 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3f6c0788-7105-4b52-8824-ba9e3197bc4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '570f0e40c0fc4712b457ea84f246ac5d', 'request_id': 'req-3f6c0788-7105-4b52-8824-ba9e3197bc4b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:45.930866 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d1e11-3f44-4fd9-ad63-f496ebcd51a2 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:45.931236 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d1e11-3f44-4fd9-ad63-f496ebcd51a2 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:45.931644 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d1e11-3f44-4fd9-ad63-f496ebcd51a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:45.949334 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3f6c0788-7105-4b52-8824-ba9e3197bc4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '570f0e40c0fc4712b457ea84f246ac5d', 'request_id': 'req-3f6c0788-7105-4b52-8824-ba9e3197bc4b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:45.961987 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3f6c0788-7105-4b52-8824-ba9e3197bc4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '570f0e40c0fc4712b457ea84f246ac5d', 'request_id': 'req-3f6c0788-7105-4b52-8824-ba9e3197bc4b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:45.982677 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-ca2d1e11-3f44-4fd9-ad63-f496ebcd51a2 None None] MFA Rules not processed for user `d3e01aa0ef1340cbba7170bac4a82783`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:45.986719 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ca2d1e11-3f44-4fd9-ad63-f496ebcd51a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:45.993812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3f6c0788-7105-4b52-8824-ba9e3197bc4b admin admin] The token cache is being invalidate because project 570f0e40c0fc4712b457ea84f246ac5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:25:45.994182 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3f6c0788-7105-4b52-8824-ba9e3197bc4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:45.995709 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3f6c0788-7105-4b52-8824-ba9e3197bc4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:45.998640 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 977/1962] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:25:45 2022] DELETE /identity/v3/projects/570f0e40c0fc4712b457ea84f246ac5d => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:46.002275 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c0788-7105-4b52-8824-ba9e3197bc4b admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:46.006554 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3f6c0788-7105-4b52-8824-ba9e3197bc4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:46.040913 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:46.166107 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6c0788-7105-4b52-8824-ba9e3197bc4b admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:46.178601 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 986/1963] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Jul 27 15:25:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:46.181073 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c1363-a008-4d1a-a9fd-e8a52dff88b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:46.182749 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c1363-a008-4d1a-a9fd-e8a52dff88b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:46.183151 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c1363-a008-4d1a-a9fd-e8a52dff88b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:46.183434 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c1363-a008-4d1a-a9fd-e8a52dff88b1 admin admin] PATH_INFO: `/v3/users/230d2471a0874d8daf0c9952e0a5fdd5` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:46.184904 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c1363-a008-4d1a-a9fd-e8a52dff88b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=230d2471a0874d8daf0c9952e0a5fdd5)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:46.188017 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c1363-a008-4d1a-a9fd-e8a52dff88b1 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:46.192365 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d1e11-3f44-4fd9-ad63-f496ebcd51a2 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:46.198285 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ca2d1e11-3f44-4fd9-ad63-f496ebcd51a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:46.240366 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:46.265499 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d1e11-3f44-4fd9-ad63-f496ebcd51a2 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:46.273388 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28071a0e-7482-4099-a311-9fc2daea55d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:46.274192 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28071a0e-7482-4099-a311-9fc2daea55d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:46.275280 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28071a0e-7482-4099-a311-9fc2daea55d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:46.275691 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28071a0e-7482-4099-a311-9fc2daea55d7 admin admin] PATH_INFO: `/v3/projects/51fcc621e844417584994da6c37806a7` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:46.280219 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28071a0e-7482-4099-a311-9fc2daea55d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51fcc621e844417584994da6c37806a7)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:46.282304 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28071a0e-7482-4099-a311-9fc2daea55d7 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:46.289047 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-b59c1363-a008-4d1a-a9fd-e8a52dff88b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '230d2471a0874d8daf0c9952e0a5fdd5'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:46.290012 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-b59c1363-a008-4d1a-a9fd-e8a52dff88b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '230d2471a0874d8daf0c9952e0a5fdd5'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:46.311046 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-b59c1363-a008-4d1a-a9fd-e8a52dff88b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '230d2471a0874d8daf0c9952e0a5fdd5'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:46.312922 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-b59c1363-a008-4d1a-a9fd-e8a52dff88b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '230d2471a0874d8daf0c9952e0a5fdd5'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:46.404721 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-28071a0e-7482-4099-a311-9fc2daea55d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51fcc621e844417584994da6c37806a7', 'request_id': 'req-28071a0e-7482-4099-a311-9fc2daea55d7'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:46.405565 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-b59c1363-a008-4d1a-a9fd-e8a52dff88b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '230d2471a0874d8daf0c9952e0a5fdd5'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:46.422713 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-28071a0e-7482-4099-a311-9fc2daea55d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51fcc621e844417584994da6c37806a7', 'request_id': 'req-28071a0e-7482-4099-a311-9fc2daea55d7'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:46.434610 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-28071a0e-7482-4099-a311-9fc2daea55d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51fcc621e844417584994da6c37806a7', 'request_id': 'req-28071a0e-7482-4099-a311-9fc2daea55d7'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:46.435370 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 978/1964] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:25:46 2022] DELETE /identity/v3/users/230d2471a0874d8daf0c9952e0a5fdd5 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:25:46.436451 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c1363-a008-4d1a-a9fd-e8a52dff88b1 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:46.439015 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b59c1363-a008-4d1a-a9fd-e8a52dff88b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:46.455639 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-28071a0e-7482-4099-a311-9fc2daea55d7 admin admin] The token cache is being invalidate because project 51fcc621e844417584994da6c37806a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:25:46.456196 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-28071a0e-7482-4099-a311-9fc2daea55d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:46.457513 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-28071a0e-7482-4099-a311-9fc2daea55d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:46.459557 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 987/1965] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:25:46 2022] DELETE /identity/v3/projects/51fcc621e844417584994da6c37806a7 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:46.469808 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886e7de-682d-4b4d-8632-7350e99db4af None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:46.470107 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886e7de-682d-4b4d-8632-7350e99db4af None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:46.470381 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6886e7de-682d-4b4d-8632-7350e99db4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:46.511740 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-6886e7de-682d-4b4d-8632-7350e99db4af None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:46.512992 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6886e7de-682d-4b4d-8632-7350e99db4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:46.611090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c1363-a008-4d1a-a9fd-e8a52dff88b1 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:46.622933 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335125fa-8722-4d5a-8f60-a10b8e09b85f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:46.623935 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335125fa-8722-4d5a-8f60-a10b8e09b85f service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:46.624413 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335125fa-8722-4d5a-8f60-a10b8e09b85f service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:46.624788 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335125fa-8722-4d5a-8f60-a10b8e09b85f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:46.626994 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-335125fa-8722-4d5a-8f60-a10b8e09b85f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:46.641749 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335125fa-8722-4d5a-8f60-a10b8e09b85f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:46.642180 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 988/1966] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:46.644136 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335125fa-8722-4d5a-8f60-a10b8e09b85f service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:46.651745 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18889341-1019-4dd6-9485-9b3a17d0f545 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:46.652204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18889341-1019-4dd6-9485-9b3a17d0f545 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:46.652634 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18889341-1019-4dd6-9485-9b3a17d0f545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:46.656870 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 979/1967] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:46.674187 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-18889341-1019-4dd6-9485-9b3a17d0f545 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:46.676042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-18889341-1019-4dd6-9485-9b3a17d0f545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:46.686302 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 989/1968] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:46.691518 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335125fa-8722-4d5a-8f60-a10b8e09b85f service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:46.706782 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335125fa-8722-4d5a-8f60-a10b8e09b85f service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:46.711663 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f75ca-01aa-4b76-bb08-4df469883b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:46.712452 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f75ca-01aa-4b76-bb08-4df469883b80 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:46.712740 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f75ca-01aa-4b76-bb08-4df469883b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:46.713235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f75ca-01aa-4b76-bb08-4df469883b80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:46.713995 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f75ca-01aa-4b76-bb08-4df469883b80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:25:46.714303 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f75ca-01aa-4b76-bb08-4df469883b80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:46.715881 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f75ca-01aa-4b76-bb08-4df469883b80 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:46.733910 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 980/1969] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:25:46.735331 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18889341-1019-4dd6-9485-9b3a17d0f545 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:46.745913 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18889341-1019-4dd6-9485-9b3a17d0f545 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:46.751460 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ec276-fc11-466e-8bad-88e1b304b9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:46.752120 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ec276-fc11-466e-8bad-88e1b304b9a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:46.752404 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ec276-fc11-466e-8bad-88e1b304b9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:46.752679 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14ec276-fc11-466e-8bad-88e1b304b9a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:46.753633 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ec276-fc11-466e-8bad-88e1b304b9a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:46.755789 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14ec276-fc11-466e-8bad-88e1b304b9a3 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:46.789063 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 990/1970] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:25:46 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:25:46.795513 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f75ca-01aa-4b76-bb08-4df469883b80 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:46.829892 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f75ca-01aa-4b76-bb08-4df469883b80 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:46.895533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb03ac1-3499-456f-9762-814360ab1a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:46.896217 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb03ac1-3499-456f-9762-814360ab1a4d admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:46.897052 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb03ac1-3499-456f-9762-814360ab1a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:46.897350 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb03ac1-3499-456f-9762-814360ab1a4d admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:46.898033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb03ac1-3499-456f-9762-814360ab1a4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:46.899961 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb03ac1-3499-456f-9762-814360ab1a4d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:46.919588 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:46.926112 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 981/1971] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:25:46 2022] POST /identity/v3/users => generated 290 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:46.930413 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ec276-fc11-466e-8bad-88e1b304b9a3 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:46.943216 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14ec276-fc11-466e-8bad-88e1b304b9a3 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:46.949189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3801528-acf2-49ca-978f-104f6c5def2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:46.949869 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3801528-acf2-49ca-978f-104f6c5def2d admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:46.950097 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3801528-acf2-49ca-978f-104f6c5def2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:46.950372 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3801528-acf2-49ca-978f-104f6c5def2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:46.951106 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3801528-acf2-49ca-978f-104f6c5def2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:46.952742 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3801528-acf2-49ca-978f-104f6c5def2d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:46.964280 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 991/1972] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:46.968113 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb03ac1-3499-456f-9762-814360ab1a4d admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:46.978297 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb03ac1-3499-456f-9762-814360ab1a4d admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:46.983645 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b271e0-1213-4743-8581-356bca392d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:46.984402 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b271e0-1213-4743-8581-356bca392d41 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:46.984688 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b271e0-1213-4743-8581-356bca392d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:46.985078 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b271e0-1213-4743-8581-356bca392d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:46.985815 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b271e0-1213-4743-8581-356bca392d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:46.987423 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b271e0-1213-4743-8581-356bca392d41 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:46.999173 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 982/1973] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 15:25:47.003359 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3801528-acf2-49ca-978f-104f6c5def2d admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:47.007521 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b271e0-1213-4743-8581-356bca392d41 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:47.009871 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-84b271e0-1213-4743-8581-356bca392d41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:47.011620 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:47.020799 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3801528-acf2-49ca-978f-104f6c5def2d admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:47.029516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52f37a-aa9e-4c22-9476-81e343786be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:47.030725 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52f37a-aa9e-4c22-9476-81e343786be6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:47.031028 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52f37a-aa9e-4c22-9476-81e343786be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:47.031716 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52f37a-aa9e-4c22-9476-81e343786be6 admin admin] PATH_INFO: `/v3/projects/8012a507c2b6481395a8eae49646d132/users/2daf9e7a1f374c4b908e365c19bf61fa/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:47.032863 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b271e0-1213-4743-8581-356bca392d41 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:47.040526 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c3989-2965-495a-9e3e-d95583d4ead2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:47.041301 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c3989-2965-495a-9e3e-d95583d4ead2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:47.041973 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c3989-2965-495a-9e3e-d95583d4ead2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:47.042318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c3989-2965-495a-9e3e-d95583d4ead2 admin admin] PATH_INFO: `/v3/projects/a227cd22b5824ab8a7459ca628527403` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:47.043651 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c3989-2965-495a-9e3e-d95583d4ead2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a227cd22b5824ab8a7459ca628527403)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:47.045773 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c3989-2965-495a-9e3e-d95583d4ead2 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:47.052286 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a52f37a-aa9e-4c22-9476-81e343786be6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8012a507c2b6481395a8eae49646d132, user_id=2daf9e7a1f374c4b908e365c19bf61fa, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:47.054959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a52f37a-aa9e-4c22-9476-81e343786be6 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:47.071937 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 992/1974] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:47 2022] PUT /identity/v3/projects/8012a507c2b6481395a8eae49646d132/users/2daf9e7a1f374c4b908e365c19bf61fa/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:47.082639 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dafd16-23cc-493d-887d-5808de76e339 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:47.082962 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dafd16-23cc-493d-887d-5808de76e339 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:47.083289 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dafd16-23cc-493d-887d-5808de76e339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:47.111259 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c75c3989-2965-495a-9e3e-d95583d4ead2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a227cd22b5824ab8a7459ca628527403', 'request_id': 'req-c75c3989-2965-495a-9e3e-d95583d4ead2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:47.120953 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-26dafd16-23cc-493d-887d-5808de76e339 None None] MFA Rules not processed for user `2daf9e7a1f374c4b908e365c19bf61fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:47.122187 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-26dafd16-23cc-493d-887d-5808de76e339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:47.124706 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c75c3989-2965-495a-9e3e-d95583d4ead2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a227cd22b5824ab8a7459ca628527403', 'request_id': 'req-c75c3989-2965-495a-9e3e-d95583d4ead2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:47.134015 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c75c3989-2965-495a-9e3e-d95583d4ead2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a227cd22b5824ab8a7459ca628527403', 'request_id': 'req-c75c3989-2965-495a-9e3e-d95583d4ead2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:47.160194 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c75c3989-2965-495a-9e3e-d95583d4ead2 admin admin] The token cache is being invalidate because project a227cd22b5824ab8a7459ca628527403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:25:47.160763 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c75c3989-2965-495a-9e3e-d95583d4ead2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:47.162090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c75c3989-2965-495a-9e3e-d95583d4ead2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:47.164005 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 983/1975] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:25:47 2022] DELETE /identity/v3/projects/a227cd22b5824ab8a7459ca628527403 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:25:47.169446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4464aa5-5a83-403d-970a-f69c213d945f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:47.169842 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4464aa5-5a83-403d-970a-f69c213d945f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:47.170218 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4464aa5-5a83-403d-970a-f69c213d945f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:47.197294 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b4464aa5-5a83-403d-970a-f69c213d945f None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:47.199764 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b4464aa5-5a83-403d-970a-f69c213d945f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:47.203674 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 993/1976] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:25:47.208666 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dafd16-23cc-493d-887d-5808de76e339 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:47.211459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-26dafd16-23cc-493d-887d-5808de76e339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:47.300511 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 984/1977] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:47.309249 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664605f2-f4d0-4a04-8003-d5d07ef10f71 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:47.309697 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664605f2-f4d0-4a04-8003-d5d07ef10f71 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:47.310139 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664605f2-f4d0-4a04-8003-d5d07ef10f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:47.336875 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-664605f2-f4d0-4a04-8003-d5d07ef10f71 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:47.338111 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-664605f2-f4d0-4a04-8003-d5d07ef10f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:47.350621 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dafd16-23cc-493d-887d-5808de76e339 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:47.354877 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 985/1978] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:47.356772 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a06e49-a353-45b5-a58a-fb03e9ad7864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:47.357395 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a06e49-a353-45b5-a58a-fb03e9ad7864 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:47.357678 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a06e49-a353-45b5-a58a-fb03e9ad7864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:47.357948 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a06e49-a353-45b5-a58a-fb03e9ad7864 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:47.358890 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a06e49-a353-45b5-a58a-fb03e9ad7864 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:47.359695 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664605f2-f4d0-4a04-8003-d5d07ef10f71 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:47.371435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a06e49-a353-45b5-a58a-fb03e9ad7864 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:47.372411 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664605f2-f4d0-4a04-8003-d5d07ef10f71 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:47.382599 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508fb7d-9183-4ed2-8de5-abfbe8b6e631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:47.383652 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508fb7d-9183-4ed2-8de5-abfbe8b6e631 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:47.385138 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508fb7d-9183-4ed2-8de5-abfbe8b6e631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:47.387939 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a508fb7d-9183-4ed2-8de5-abfbe8b6e631 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:47.388862 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508fb7d-9183-4ed2-8de5-abfbe8b6e631 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:25:47.389418 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508fb7d-9183-4ed2-8de5-abfbe8b6e631 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:47.392716 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a508fb7d-9183-4ed2-8de5-abfbe8b6e631 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:47.420044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 986/1979] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:25:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:25:47.423879 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508fb7d-9183-4ed2-8de5-abfbe8b6e631 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:47.433695 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 994/1980] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:25:47 2022] POST /identity/v3/projects => generated 381 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:47.439050 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a06e49-a353-45b5-a58a-fb03e9ad7864 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:47.445727 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a508fb7d-9183-4ed2-8de5-abfbe8b6e631 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:47.528036 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:47.548460 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4664d0-cbaa-4a5a-a236-a5db3aa51450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:47.549107 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4664d0-cbaa-4a5a-a236-a5db3aa51450 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:47.549385 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4664d0-cbaa-4a5a-a236-a5db3aa51450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:47.549711 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4664d0-cbaa-4a5a-a236-a5db3aa51450 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:47.561299 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4664d0-cbaa-4a5a-a236-a5db3aa51450 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:47.561299 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4664d0-cbaa-4a5a-a236-a5db3aa51450 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:47.567387 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:47.573988 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a06e49-a353-45b5-a58a-fb03e9ad7864 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:47.593020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfabaa71-5e53-4b6a-8f31-325ee2ce5477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:47.594390 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabaa71-5e53-4b6a-8f31-325ee2ce5477 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:47.594700 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabaa71-5e53-4b6a-8f31-325ee2ce5477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:47.594978 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabaa71-5e53-4b6a-8f31-325ee2ce5477 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:47.595656 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfabaa71-5e53-4b6a-8f31-325ee2ce5477 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:47.598093 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 987/1981] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:25:47 2022] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:47.599782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfabaa71-5e53-4b6a-8f31-325ee2ce5477 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:47.602129 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4664d0-cbaa-4a5a-a236-a5db3aa51450 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:47.643168 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 995/1982] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:25:47 2022] POST /identity/v3/users => generated 297 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:47.644104 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfabaa71-5e53-4b6a-8f31-325ee2ce5477 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:47.656400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfabaa71-5e53-4b6a-8f31-325ee2ce5477 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:47.689972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4664d0-cbaa-4a5a-a236-a5db3aa51450 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:47.696498 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f135bb6-b9f6-4560-9bd8-76f9ac2a725a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:47.697108 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f135bb6-b9f6-4560-9bd8-76f9ac2a725a admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:47.697392 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f135bb6-b9f6-4560-9bd8-76f9ac2a725a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:47.697664 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f135bb6-b9f6-4560-9bd8-76f9ac2a725a admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:47.698359 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f135bb6-b9f6-4560-9bd8-76f9ac2a725a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:47.700272 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f135bb6-b9f6-4560-9bd8-76f9ac2a725a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:47.722270 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce45a34-ca3b-4ebb-ac73-8cd384f0b11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:47.723003 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce45a34-ca3b-4ebb-ac73-8cd384f0b11b admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:47.723382 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce45a34-ca3b-4ebb-ac73-8cd384f0b11b admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:47.723753 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce45a34-ca3b-4ebb-ac73-8cd384f0b11b admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:47.727469 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 988/1983] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:25:47 2022] POST /identity/v3/users => generated 292 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:25:47.727718 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce45a34-ca3b-4ebb-ac73-8cd384f0b11b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:47.727718 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce45a34-ca3b-4ebb-ac73-8cd384f0b11b admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:47.728939 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f135bb6-b9f6-4560-9bd8-76f9ac2a725a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:47.740678 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 996/1984] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:47.741218 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f135bb6-b9f6-4560-9bd8-76f9ac2a725a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:47.741903 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce45a34-ca3b-4ebb-ac73-8cd384f0b11b admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:47.745949 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e024729-0080-440b-a820-4c1e11d3206a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:47.746656 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e024729-0080-440b-a820-4c1e11d3206a admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:47.747025 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e024729-0080-440b-a820-4c1e11d3206a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:47.747390 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e024729-0080-440b-a820-4c1e11d3206a admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:47.748191 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e024729-0080-440b-a820-4c1e11d3206a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:47.750091 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e024729-0080-440b-a820-4c1e11d3206a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:47.753979 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce45a34-ca3b-4ebb-ac73-8cd384f0b11b admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:47.759391 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b3e5a-e2c8-4aef-9f1c-b46834001fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:47.760352 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b3e5a-e2c8-4aef-9f1c-b46834001fc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:47.761276 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b3e5a-e2c8-4aef-9f1c-b46834001fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:47.761947 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560b3e5a-e2c8-4aef-9f1c-b46834001fc7 admin admin] PATH_INFO: `/v3/projects/d1d57f7c129943879623e93cefa6e4a3/users/3e2ef00309dc4511aeaf621ad68bfbb4/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:47.765498 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 989/1985] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:47.766807 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e024729-0080-440b-a820-4c1e11d3206a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:47.777548 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e024729-0080-440b-a820-4c1e11d3206a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:47.777901 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b3e5a-e2c8-4aef-9f1c-b46834001fc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1d57f7c129943879623e93cefa6e4a3, user_id=3e2ef00309dc4511aeaf621ad68bfbb4, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:47.780753 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560b3e5a-e2c8-4aef-9f1c-b46834001fc7 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:47.782154 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bdbcb2-8f55-45d7-a5c2-94221e23efe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:47.782753 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdbcb2-8f55-45d7-a5c2-94221e23efe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:47.783033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdbcb2-8f55-45d7-a5c2-94221e23efe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:47.783304 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdbcb2-8f55-45d7-a5c2-94221e23efe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:47.783983 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bdbcb2-8f55-45d7-a5c2-94221e23efe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:47.785597 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bdbcb2-8f55-45d7-a5c2-94221e23efe5 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:47.797961 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 990/1986] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:47.802098 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bdbcb2-8f55-45d7-a5c2-94221e23efe5 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:47.804769 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 997/1987] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:47 2022] PUT /identity/v3/projects/d1d57f7c129943879623e93cefa6e4a3/users/3e2ef00309dc4511aeaf621ad68bfbb4/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:47.808972 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b3e5a-e2c8-4aef-9f1c-b46834001fc7 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:47.815412 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bdbcb2-8f55-45d7-a5c2-94221e23efe5 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:47.879346 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560b3e5a-e2c8-4aef-9f1c-b46834001fc7 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:47.884340 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56749e-a9c7-4a8d-9e27-114c66287471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:47.885038 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56749e-a9c7-4a8d-9e27-114c66287471 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:47.885919 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56749e-a9c7-4a8d-9e27-114c66287471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:47.886263 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56749e-a9c7-4a8d-9e27-114c66287471 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:47.887012 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce56749e-a9c7-4a8d-9e27-114c66287471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:47.888719 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce56749e-a9c7-4a8d-9e27-114c66287471 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:47.899265 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 998/1988] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:47 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 15:25:47.899823 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bed55e-cb9d-4675-951e-6cbbb4259bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:47.900644 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bed55e-cb9d-4675-951e-6cbbb4259bf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:47.901072 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bed55e-cb9d-4675-951e-6cbbb4259bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:47.901916 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bed55e-cb9d-4675-951e-6cbbb4259bf1 admin admin] PATH_INFO: `/v3/projects/07d2d6ab46874fc58b93b6f9bc5d32b8/users/3022f6056d7b46f5ad259a3fdf991e09/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:47.903936 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56749e-a9c7-4a8d-9e27-114c66287471 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:47.916266 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56749e-a9c7-4a8d-9e27-114c66287471 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:47.922488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e39b062-2553-4492-8b18-edb1bfc5e81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:47.923312 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39b062-2553-4492-8b18-edb1bfc5e81d admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:47.923609 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39b062-2553-4492-8b18-edb1bfc5e81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:47.923894 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e39b062-2553-4492-8b18-edb1bfc5e81d admin admin] PATH_INFO: `/v3/projects/d1d57f7c129943879623e93cefa6e4a3/users/3e2ef00309dc4511aeaf621ad68bfbb4/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:47.925686 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bed55e-cb9d-4675-951e-6cbbb4259bf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07d2d6ab46874fc58b93b6f9bc5d32b8, user_id=3022f6056d7b46f5ad259a3fdf991e09, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:47.926367 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39b062-2553-4492-8b18-edb1bfc5e81d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1d57f7c129943879623e93cefa6e4a3, user_id=3e2ef00309dc4511aeaf621ad68bfbb4, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:47.929537 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e39b062-2553-4492-8b18-edb1bfc5e81d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:47.935493 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bed55e-cb9d-4675-951e-6cbbb4259bf1 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:47.945550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 999/1989] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:47 2022] PUT /identity/v3/projects/d1d57f7c129943879623e93cefa6e4a3/users/3e2ef00309dc4511aeaf621ad68bfbb4/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:47.957959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d026b8-da2c-4873-879e-5e1e3f09d2cb None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:47.958397 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d026b8-da2c-4873-879e-5e1e3f09d2cb None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:47.958789 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d026b8-da2c-4873-879e-5e1e3f09d2cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:47.969487 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 991/1990] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:47 2022] PUT /identity/v3/projects/07d2d6ab46874fc58b93b6f9bc5d32b8/users/3022f6056d7b46f5ad259a3fdf991e09/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:47.980576 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b359b5-07fa-4617-ba42-d3a24bd05e64 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:47.980872 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b359b5-07fa-4617-ba42-d3a24bd05e64 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:47.981155 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b359b5-07fa-4617-ba42-d3a24bd05e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:48.013111 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f5b359b5-07fa-4617-ba42-d3a24bd05e64 None None] MFA Rules not processed for user `3022f6056d7b46f5ad259a3fdf991e09`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:48.014330 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f5b359b5-07fa-4617-ba42-d3a24bd05e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:48.030860 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-82d026b8-da2c-4873-879e-5e1e3f09d2cb None None] MFA Rules not processed for user `3e2ef00309dc4511aeaf621ad68bfbb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:48.032576 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-82d026b8-da2c-4873-879e-5e1e3f09d2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:48.032987 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:48.073806 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:48.116124 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 992/1991] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:25:48.119482 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b359b5-07fa-4617-ba42-d3a24bd05e64 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:48.131319 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1000/1992] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:47 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:48.144107 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d026b8-da2c-4873-879e-5e1e3f09d2cb None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:48.146199 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-82d026b8-da2c-4873-879e-5e1e3f09d2cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:48.212915 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b359b5-07fa-4617-ba42-d3a24bd05e64 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:48.220696 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad1a83-04b2-4760-bcd1-d24df1b85ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:48.220821 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d026b8-da2c-4873-879e-5e1e3f09d2cb None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:48.220906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad1a83-04b2-4760-bcd1-d24df1b85ff9 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:48.220906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad1a83-04b2-4760-bcd1-d24df1b85ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:48.220906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad1a83-04b2-4760-bcd1-d24df1b85ff9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:48.220906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad1a83-04b2-4760-bcd1-d24df1b85ff9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:48.222388 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad1a83-04b2-4760-bcd1-d24df1b85ff9 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:48.223564 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97612559-bc9d-43b2-b1bc-0b7ec081fdde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:48.224323 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97612559-bc9d-43b2-b1bc-0b7ec081fdde service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:48.224703 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97612559-bc9d-43b2-b1bc-0b7ec081fdde service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:48.225076 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97612559-bc9d-43b2-b1bc-0b7ec081fdde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:48.236952 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97612559-bc9d-43b2-b1bc-0b7ec081fdde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:48.238843 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97612559-bc9d-43b2-b1bc-0b7ec081fdde service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:48.250051 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1001/1993] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:48 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 15:25:48.256028 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 993/1994] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:25:48 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:48.260205 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97612559-bc9d-43b2-b1bc-0b7ec081fdde service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:48.274914 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97612559-bc9d-43b2-b1bc-0b7ec081fdde service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:48.376580 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8825240-f263-485e-a6f3-2e784295d071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:48.376797 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8825240-f263-485e-a6f3-2e784295d071 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:48.377028 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8825240-f263-485e-a6f3-2e784295d071 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:48.378019 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8825240-f263-485e-a6f3-2e784295d071 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:48.378156 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8825240-f263-485e-a6f3-2e784295d071 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:48.381449 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8825240-f263-485e-a6f3-2e784295d071 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:48.428995 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1002/1995] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:25:48 2022] POST /identity/v3/users => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:25:48.430601 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad1a83-04b2-4760-bcd1-d24df1b85ff9 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:48.445138 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad1a83-04b2-4760-bcd1-d24df1b85ff9 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:48.451195 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca0e95-0c3f-4314-adba-53988a564327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:48.451935 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca0e95-0c3f-4314-adba-53988a564327 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:48.452351 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca0e95-0c3f-4314-adba-53988a564327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:48.452722 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fca0e95-0c3f-4314-adba-53988a564327 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:48.453549 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca0e95-0c3f-4314-adba-53988a564327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:48.455280 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fca0e95-0c3f-4314-adba-53988a564327 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:48.472622 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 994/1996] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:48.478327 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8825240-f263-485e-a6f3-2e784295d071 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:48.497925 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8825240-f263-485e-a6f3-2e784295d071 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:48.514605 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6ee3b-8fc1-4649-b331-b4f5b00e7596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:48.515310 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6ee3b-8fc1-4649-b331-b4f5b00e7596 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:48.515644 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6ee3b-8fc1-4649-b331-b4f5b00e7596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:48.516252 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a6ee3b-8fc1-4649-b331-b4f5b00e7596 admin admin] PATH_INFO: `/v3/projects/676041b2a92c446b80cb74f81b41006c/users/c44e5cc269874ce0b1b70c522ffcabbd/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:48.537521 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6ee3b-8fc1-4649-b331-b4f5b00e7596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=676041b2a92c446b80cb74f81b41006c, user_id=c44e5cc269874ce0b1b70c522ffcabbd, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:48.540405 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a6ee3b-8fc1-4649-b331-b4f5b00e7596 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:48.565822 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1003/1997] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:48 2022] PUT /identity/v3/projects/676041b2a92c446b80cb74f81b41006c/users/c44e5cc269874ce0b1b70c522ffcabbd/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:48.571539 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca0e95-0c3f-4314-adba-53988a564327 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:48.590800 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fca0e95-0c3f-4314-adba-53988a564327 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:48.689383 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e51cb41-5134-4708-b599-69edebbc5dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:48.690089 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51cb41-5134-4708-b599-69edebbc5dce admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:48.690454 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51cb41-5134-4708-b599-69edebbc5dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:48.690795 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e51cb41-5134-4708-b599-69edebbc5dce admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:48.691822 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51cb41-5134-4708-b599-69edebbc5dce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:48.694183 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e51cb41-5134-4708-b599-69edebbc5dce admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:48.715899 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 995/1998] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:48 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:48.716135 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6ee3b-8fc1-4649-b331-b4f5b00e7596 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:48.725714 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a6ee3b-8fc1-4649-b331-b4f5b00e7596 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:48.731905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0292060-ff2a-4d88-8d08-1bf77b167d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:48.733511 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0292060-ff2a-4d88-8d08-1bf77b167d1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:48.733895 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0292060-ff2a-4d88-8d08-1bf77b167d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:48.734268 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0292060-ff2a-4d88-8d08-1bf77b167d1f admin admin] PATH_INFO: `/v3/projects/676041b2a92c446b80cb74f81b41006c/users/c44e5cc269874ce0b1b70c522ffcabbd/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:48.737742 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0292060-ff2a-4d88-8d08-1bf77b167d1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=676041b2a92c446b80cb74f81b41006c, user_id=c44e5cc269874ce0b1b70c522ffcabbd, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:48.741507 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0292060-ff2a-4d88-8d08-1bf77b167d1f admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:48.761997 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1004/1999] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:48 2022] PUT /identity/v3/projects/676041b2a92c446b80cb74f81b41006c/users/c44e5cc269874ce0b1b70c522ffcabbd/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:25:48.774867 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73df098-58db-4e13-853c-4a0109a6b934 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:48.775039 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73df098-58db-4e13-853c-4a0109a6b934 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:48.775422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73df098-58db-4e13-853c-4a0109a6b934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:48.812079 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b73df098-58db-4e13-853c-4a0109a6b934 None None] MFA Rules not processed for user `c44e5cc269874ce0b1b70c522ffcabbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:48.812079 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b73df098-58db-4e13-853c-4a0109a6b934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:48.825413 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0292060-ff2a-4d88-8d08-1bf77b167d1f admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:48.829938 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:48.852313 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:48.891520 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 996/2000] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:48.901743 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0292060-ff2a-4d88-8d08-1bf77b167d1f admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:48.904085 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73df098-58db-4e13-853c-4a0109a6b934 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:48.905502 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b73df098-58db-4e13-853c-4a0109a6b934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:48.907552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65546d-5d11-4972-ac79-3909304d420d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:48.908229 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65546d-5d11-4972-ac79-3909304d420d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:48.908514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65546d-5d11-4972-ac79-3909304d420d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:48.908805 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65546d-5d11-4972-ac79-3909304d420d admin admin] PATH_INFO: `/v3/users/2daf9e7a1f374c4b908e365c19bf61fa` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:48.910021 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65546d-5d11-4972-ac79-3909304d420d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2daf9e7a1f374c4b908e365c19bf61fa)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:48.912034 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65546d-5d11-4972-ac79-3909304d420d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:48.974549 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-da65546d-5d11-4972-ac79-3909304d420d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2daf9e7a1f374c4b908e365c19bf61fa'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:48.975247 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-da65546d-5d11-4972-ac79-3909304d420d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2daf9e7a1f374c4b908e365c19bf61fa'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:48.978244 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73df098-58db-4e13-853c-4a0109a6b934 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:48.982478 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235927a-e2ba-498c-8c19-23b24549063f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:48.983202 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235927a-e2ba-498c-8c19-23b24549063f service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:48.983608 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235927a-e2ba-498c-8c19-23b24549063f service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:48.983893 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235927a-e2ba-498c-8c19-23b24549063f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:48.986581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-da65546d-5d11-4972-ac79-3909304d420d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2daf9e7a1f374c4b908e365c19bf61fa'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:48.998178 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235927a-e2ba-498c-8c19-23b24549063f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:48.999337 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-da65546d-5d11-4972-ac79-3909304d420d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2daf9e7a1f374c4b908e365c19bf61fa'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:48.999952 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235927a-e2ba-498c-8c19-23b24549063f service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:49.011680 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 997/2001] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:48 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 15:25:49.024920 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-da65546d-5d11-4972-ac79-3909304d420d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2daf9e7a1f374c4b908e365c19bf61fa'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:49.041026 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1005/2002] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:25:48 2022] DELETE /identity/v3/users/2daf9e7a1f374c4b908e365c19bf61fa => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:49.045648 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98326c-cd3e-40da-95bb-d532cdfde27d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:49.047454 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98326c-cd3e-40da-95bb-d532cdfde27d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:49.048021 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af98326c-cd3e-40da-95bb-d532cdfde27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:49.077983 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-af98326c-cd3e-40da-95bb-d532cdfde27d None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:49.079621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-af98326c-cd3e-40da-95bb-d532cdfde27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:49.211309 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65546d-5d11-4972-ac79-3909304d420d admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:49.213246 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-da65546d-5d11-4972-ac79-3909304d420d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:49.218381 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 998/2003] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:49.273983 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98326c-cd3e-40da-95bb-d532cdfde27d None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:49.276828 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-af98326c-cd3e-40da-95bb-d532cdfde27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:49.324283 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65546d-5d11-4972-ac79-3909304d420d admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:49.328971 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5033be-dfaa-4c46-83c2-2e65e61e8012 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:49.329724 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5033be-dfaa-4c46-83c2-2e65e61e8012 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:49.330111 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5033be-dfaa-4c46-83c2-2e65e61e8012 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:49.330487 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5033be-dfaa-4c46-83c2-2e65e61e8012 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:49.333794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6c5033be-dfaa-4c46-83c2-2e65e61e8012 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:49.451286 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af98326c-cd3e-40da-95bb-d532cdfde27d None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:49.462810 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:49.464502 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf8f19-91ee-4d14-8f96-abe43702acda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:49.465313 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf8f19-91ee-4d14-8f96-abe43702acda service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:49.466299 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf8f19-91ee-4d14-8f96-abe43702acda service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:49.466780 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf8f19-91ee-4d14-8f96-abe43702acda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:49.474139 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5033be-dfaa-4c46-83c2-2e65e61e8012 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:49.478495 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5033be-dfaa-4c46-83c2-2e65e61e8012 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:49.490017 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcf8f19-91ee-4d14-8f96-abe43702acda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:49.492219 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcf8f19-91ee-4d14-8f96-abe43702acda service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:49.500567 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1006/2004] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:49.502820 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:49.510791 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 999/2005] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:50.027444 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5033be-dfaa-4c46-83c2-2e65e61e8012 service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:50.030368 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6c5033be-dfaa-4c46-83c2-2e65e61e8012 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:50.052360 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5033be-dfaa-4c46-83c2-2e65e61e8012 service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:50.061699 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a323ae-ef79-4d0d-8ee7-0b7d14d66edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:50.062753 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a323ae-ef79-4d0d-8ee7-0b7d14d66edf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:50.063343 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a323ae-ef79-4d0d-8ee7-0b7d14d66edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:50.063819 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a323ae-ef79-4d0d-8ee7-0b7d14d66edf admin admin] PATH_INFO: `/v3/users/b74c372047ee4a5f94668f6df2d7cf08` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:50.065998 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a323ae-ef79-4d0d-8ee7-0b7d14d66edf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b74c372047ee4a5f94668f6df2d7cf08)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:50.069864 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a323ae-ef79-4d0d-8ee7-0b7d14d66edf admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:50.123248 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf8f19-91ee-4d14-8f96-abe43702acda service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:50.124824 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7dcf8f19-91ee-4d14-8f96-abe43702acda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:50.141526 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf8f19-91ee-4d14-8f96-abe43702acda service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:50.142737 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-58a323ae-ef79-4d0d-8ee7-0b7d14d66edf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b74c372047ee4a5f94668f6df2d7cf08'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:50.144365 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-58a323ae-ef79-4d0d-8ee7-0b7d14d66edf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b74c372047ee4a5f94668f6df2d7cf08'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:50.147260 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854f8a6-96d6-4317-82e8-fe573c8af40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:50.147914 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854f8a6-96d6-4317-82e8-fe573c8af40a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:50.148520 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854f8a6-96d6-4317-82e8-fe573c8af40a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:50.148664 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854f8a6-96d6-4317-82e8-fe573c8af40a admin admin] PATH_INFO: `/v3/users/3022f6056d7b46f5ad259a3fdf991e09` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:50.150516 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854f8a6-96d6-4317-82e8-fe573c8af40a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3022f6056d7b46f5ad259a3fdf991e09)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:50.153334 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c854f8a6-96d6-4317-82e8-fe573c8af40a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:50.157069 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-58a323ae-ef79-4d0d-8ee7-0b7d14d66edf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b74c372047ee4a5f94668f6df2d7cf08'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:50.169579 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-58a323ae-ef79-4d0d-8ee7-0b7d14d66edf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b74c372047ee4a5f94668f6df2d7cf08'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:50.210833 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-58a323ae-ef79-4d0d-8ee7-0b7d14d66edf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b74c372047ee4a5f94668f6df2d7cf08'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:50.225191 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1007/2006] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:25:50 2022] DELETE /identity/v3/users/b74c372047ee4a5f94668f6df2d7cf08 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:50.231130 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01885e1d-4d19-4a99-8759-29dc573bb49a None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:50.231465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01885e1d-4d19-4a99-8759-29dc573bb49a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:50.231968 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01885e1d-4d19-4a99-8759-29dc573bb49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:50.272075 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c854f8a6-96d6-4317-82e8-fe573c8af40a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3022f6056d7b46f5ad259a3fdf991e09'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:50.275279 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c854f8a6-96d6-4317-82e8-fe573c8af40a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3022f6056d7b46f5ad259a3fdf991e09'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:50.286053 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-01885e1d-4d19-4a99-8759-29dc573bb49a None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:50.286053 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-01885e1d-4d19-4a99-8759-29dc573bb49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:50.305971 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c854f8a6-96d6-4317-82e8-fe573c8af40a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3022f6056d7b46f5ad259a3fdf991e09'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:50.309108 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c854f8a6-96d6-4317-82e8-fe573c8af40a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3022f6056d7b46f5ad259a3fdf991e09'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:50.345329 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c854f8a6-96d6-4317-82e8-fe573c8af40a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3022f6056d7b46f5ad259a3fdf991e09'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:50.365652 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1000/2007] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:25:50 2022] DELETE /identity/v3/users/3022f6056d7b46f5ad259a3fdf991e09 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:50.372910 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0eb6f3-30cc-4139-813d-587dd3fe4968 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:50.373389 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0eb6f3-30cc-4139-813d-587dd3fe4968 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:50.373941 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0eb6f3-30cc-4139-813d-587dd3fe4968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:50.398313 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9a0eb6f3-30cc-4139-813d-587dd3fe4968 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:50.399535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9a0eb6f3-30cc-4139-813d-587dd3fe4968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:50.402389 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1008/2008] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:50.418054 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01885e1d-4d19-4a99-8759-29dc573bb49a None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:50.421400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-01885e1d-4d19-4a99-8759-29dc573bb49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:50.474967 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1001/2009] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:25:50.475835 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0eb6f3-30cc-4139-813d-587dd3fe4968 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:50.477139 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9a0eb6f3-30cc-4139-813d-587dd3fe4968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:50.490099 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0eb6f3-30cc-4139-813d-587dd3fe4968 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:50.495913 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218a0dd-a697-4624-ad1a-d675a81235bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:50.496680 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218a0dd-a697-4624-ad1a-d675a81235bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:50.496933 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218a0dd-a697-4624-ad1a-d675a81235bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:50.497291 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d218a0dd-a697-4624-ad1a-d675a81235bf admin admin] PATH_INFO: `/v3/projects/8012a507c2b6481395a8eae49646d132` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:50.498427 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218a0dd-a697-4624-ad1a-d675a81235bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8012a507c2b6481395a8eae49646d132)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:50.500444 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d218a0dd-a697-4624-ad1a-d675a81235bf admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:50.502424 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01885e1d-4d19-4a99-8759-29dc573bb49a None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:50.523350 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:50.558948 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d218a0dd-a697-4624-ad1a-d675a81235bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8012a507c2b6481395a8eae49646d132', 'request_id': 'req-d218a0dd-a697-4624-ad1a-d675a81235bf'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:50.562757 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2478ff-2f17-4d46-86c4-a7bbbc9024b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:50.563383 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2478ff-2f17-4d46-86c4-a7bbbc9024b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:50.563663 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2478ff-2f17-4d46-86c4-a7bbbc9024b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:50.563935 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2478ff-2f17-4d46-86c4-a7bbbc9024b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:50.565415 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d218a0dd-a697-4624-ad1a-d675a81235bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8012a507c2b6481395a8eae49646d132', 'request_id': 'req-d218a0dd-a697-4624-ad1a-d675a81235bf'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:50.570942 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d218a0dd-a697-4624-ad1a-d675a81235bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8012a507c2b6481395a8eae49646d132', 'request_id': 'req-d218a0dd-a697-4624-ad1a-d675a81235bf'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:50.573486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2478ff-2f17-4d46-86c4-a7bbbc9024b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:50.574733 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:50.575041 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2478ff-2f17-4d46-86c4-a7bbbc9024b1 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:50.587377 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1009/2010] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 15:25:50.588197 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2478ff-2f17-4d46-86c4-a7bbbc9024b1 service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:50.591086 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d218a0dd-a697-4624-ad1a-d675a81235bf admin admin] The token cache is being invalidate because project 8012a507c2b6481395a8eae49646d132 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:25:50.591647 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d218a0dd-a697-4624-ad1a-d675a81235bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:50.592682 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d218a0dd-a697-4624-ad1a-d675a81235bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:50.595226 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1002/2011] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:25:50 2022] DELETE /identity/v3/projects/8012a507c2b6481395a8eae49646d132 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:50.597339 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2478ff-2f17-4d46-86c4-a7bbbc9024b1 service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:50.599036 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218a0dd-a697-4624-ad1a-d675a81235bf admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:50.600369 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d218a0dd-a697-4624-ad1a-d675a81235bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:50.664506 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026f48c-ad19-4adc-8660-66c999efba58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:50.665150 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026f48c-ad19-4adc-8660-66c999efba58 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:50.665444 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026f48c-ad19-4adc-8660-66c999efba58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:50.665736 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026f48c-ad19-4adc-8660-66c999efba58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:50.668884 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-2026f48c-ad19-4adc-8660-66c999efba58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:50.678795 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d218a0dd-a697-4624-ad1a-d675a81235bf admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:50.684672 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6687d5-8140-4e10-a920-e94759a7bab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:50.685330 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6687d5-8140-4e10-a920-e94759a7bab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:50.685620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6687d5-8140-4e10-a920-e94759a7bab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:50.685899 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6687d5-8140-4e10-a920-e94759a7bab6 admin admin] PATH_INFO: `/v3/users/3e2ef00309dc4511aeaf621ad68bfbb4` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:50.687291 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6687d5-8140-4e10-a920-e94759a7bab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e2ef00309dc4511aeaf621ad68bfbb4)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:50.688405 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026f48c-ad19-4adc-8660-66c999efba58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:50.689308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6687d5-8140-4e10-a920-e94759a7bab6 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:50.690356 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026f48c-ad19-4adc-8660-66c999efba58 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:50.701011 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1010/2012] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:50.737310 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3e6687d5-8140-4e10-a920-e94759a7bab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e2ef00309dc4511aeaf621ad68bfbb4'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:50.738060 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3e6687d5-8140-4e10-a920-e94759a7bab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e2ef00309dc4511aeaf621ad68bfbb4'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:50.746332 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3e6687d5-8140-4e10-a920-e94759a7bab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e2ef00309dc4511aeaf621ad68bfbb4'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:50.747093 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3e6687d5-8140-4e10-a920-e94759a7bab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e2ef00309dc4511aeaf621ad68bfbb4'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:50.766681 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3e6687d5-8140-4e10-a920-e94759a7bab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e2ef00309dc4511aeaf621ad68bfbb4'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:50.803159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1003/2013] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:25:50 2022] DELETE /identity/v3/users/3e2ef00309dc4511aeaf621ad68bfbb4 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:25:51.034485 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026f48c-ad19-4adc-8660-66c999efba58 service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:51.037068 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-2026f48c-ad19-4adc-8660-66c999efba58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:51.053744 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026f48c-ad19-4adc-8660-66c999efba58 service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:51.127403 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6687d5-8140-4e10-a920-e94759a7bab6 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:51.128868 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3e6687d5-8140-4e10-a920-e94759a7bab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:51.137000 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9521a-8c85-49d5-b23f-46a13fd5a7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:51.138396 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9521a-8c85-49d5-b23f-46a13fd5a7b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:51.138907 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9521a-8c85-49d5-b23f-46a13fd5a7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:51.139388 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9521a-8c85-49d5-b23f-46a13fd5a7b8 admin admin] PATH_INFO: `/v3/projects/07d2d6ab46874fc58b93b6f9bc5d32b8` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:51.140863 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9521a-8c85-49d5-b23f-46a13fd5a7b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07d2d6ab46874fc58b93b6f9bc5d32b8)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:51.143332 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e9521a-8c85-49d5-b23f-46a13fd5a7b8 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:51.201953 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-c7e9521a-8c85-49d5-b23f-46a13fd5a7b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07d2d6ab46874fc58b93b6f9bc5d32b8', 'request_id': 'req-c7e9521a-8c85-49d5-b23f-46a13fd5a7b8'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:51.210619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-c7e9521a-8c85-49d5-b23f-46a13fd5a7b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07d2d6ab46874fc58b93b6f9bc5d32b8', 'request_id': 'req-c7e9521a-8c85-49d5-b23f-46a13fd5a7b8'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:51.217971 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-c7e9521a-8c85-49d5-b23f-46a13fd5a7b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07d2d6ab46874fc58b93b6f9bc5d32b8', 'request_id': 'req-c7e9521a-8c85-49d5-b23f-46a13fd5a7b8'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:51.223510 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6687d5-8140-4e10-a920-e94759a7bab6 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:51.229022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:51.237213 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-c7e9521a-8c85-49d5-b23f-46a13fd5a7b8 admin admin] The token cache is being invalidate because project 07d2d6ab46874fc58b93b6f9bc5d32b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:25:51.238455 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-c7e9521a-8c85-49d5-b23f-46a13fd5a7b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:51.239831 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-c7e9521a-8c85-49d5-b23f-46a13fd5a7b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:51.241838 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1011/2014] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:25:51 2022] DELETE /identity/v3/projects/07d2d6ab46874fc58b93b6f9bc5d32b8 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:51.246610 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9521a-8c85-49d5-b23f-46a13fd5a7b8 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:51.248429 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-c7e9521a-8c85-49d5-b23f-46a13fd5a7b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:51.249049 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:51.338827 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e2c4f-a9b5-407e-bfa2-633592d4586f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:51.340583 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e2c4f-a9b5-407e-bfa2-633592d4586f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:51.341502 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e2c4f-a9b5-407e-bfa2-633592d4586f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:51.342342 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e2c4f-a9b5-407e-bfa2-633592d4586f admin admin] PATH_INFO: `/v3/projects/4ebc22a8bded4d56a7aa5fa9ae439d33` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:51.344368 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e2c4f-a9b5-407e-bfa2-633592d4586f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ebc22a8bded4d56a7aa5fa9ae439d33)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:51.346790 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e2c4f-a9b5-407e-bfa2-633592d4586f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:51.414679 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9521a-8c85-49d5-b23f-46a13fd5a7b8 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:51.429701 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b874f-e869-4005-b426-e1da27f52f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:51.430462 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b874f-e869-4005-b426-e1da27f52f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:51.430860 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b874f-e869-4005-b426-e1da27f52f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:51.431534 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98b874f-e869-4005-b426-e1da27f52f17 admin admin] PATH_INFO: `/v3/users/c44e5cc269874ce0b1b70c522ffcabbd` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:51.434380 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b874f-e869-4005-b426-e1da27f52f17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c44e5cc269874ce0b1b70c522ffcabbd)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:51.438003 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98b874f-e869-4005-b426-e1da27f52f17 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:51.468504 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8d8e2c4f-a9b5-407e-bfa2-633592d4586f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ebc22a8bded4d56a7aa5fa9ae439d33', 'request_id': 'req-8d8e2c4f-a9b5-407e-bfa2-633592d4586f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:51.481027 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8d8e2c4f-a9b5-407e-bfa2-633592d4586f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ebc22a8bded4d56a7aa5fa9ae439d33', 'request_id': 'req-8d8e2c4f-a9b5-407e-bfa2-633592d4586f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:51.504980 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8d8e2c4f-a9b5-407e-bfa2-633592d4586f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ebc22a8bded4d56a7aa5fa9ae439d33', 'request_id': 'req-8d8e2c4f-a9b5-407e-bfa2-633592d4586f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:51.531563 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8d8e2c4f-a9b5-407e-bfa2-633592d4586f admin admin] The token cache is being invalidate because project 4ebc22a8bded4d56a7aa5fa9ae439d33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:25:51.531974 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8d8e2c4f-a9b5-407e-bfa2-633592d4586f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:51.532786 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8d8e2c4f-a9b5-407e-bfa2-633592d4586f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:51.537305 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1004/2015] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:25:51 2022] DELETE /identity/v3/projects/4ebc22a8bded4d56a7aa5fa9ae439d33 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:51.538612 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e2c4f-a9b5-407e-bfa2-633592d4586f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:51.543314 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8d8e2c4f-a9b5-407e-bfa2-633592d4586f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:51.556566 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-d98b874f-e869-4005-b426-e1da27f52f17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c44e5cc269874ce0b1b70c522ffcabbd'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:51.558040 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-d98b874f-e869-4005-b426-e1da27f52f17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c44e5cc269874ce0b1b70c522ffcabbd'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:51.580747 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-d98b874f-e869-4005-b426-e1da27f52f17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c44e5cc269874ce0b1b70c522ffcabbd'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:51.596656 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-d98b874f-e869-4005-b426-e1da27f52f17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c44e5cc269874ce0b1b70c522ffcabbd'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:51.630856 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-d98b874f-e869-4005-b426-e1da27f52f17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c44e5cc269874ce0b1b70c522ffcabbd'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:51.652746 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1012/2016] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:25:51 2022] DELETE /identity/v3/users/c44e5cc269874ce0b1b70c522ffcabbd => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:25:51.654171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b874f-e869-4005-b426-e1da27f52f17 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:51.661652 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d98b874f-e869-4005-b426-e1da27f52f17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:51.717177 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e2c4f-a9b5-407e-bfa2-633592d4586f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:51.803313 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb367e1-af04-409a-bda7-0a564f271ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:51.804325 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb367e1-af04-409a-bda7-0a564f271ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:51.804712 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb367e1-af04-409a-bda7-0a564f271ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:51.805393 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb367e1-af04-409a-bda7-0a564f271ca4 admin admin] PATH_INFO: `/v3/users/d0a70f4fa0004eb8bc9a76b5a4e362c2` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:51.807133 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb367e1-af04-409a-bda7-0a564f271ca4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0a70f4fa0004eb8bc9a76b5a4e362c2)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:51.809451 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb367e1-af04-409a-bda7-0a564f271ca4 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:51.811250 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:51.826349 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98b874f-e869-4005-b426-e1da27f52f17 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:51.836438 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18004b1a-e605-43aa-95b1-766115ff6950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:51.837741 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18004b1a-e605-43aa-95b1-766115ff6950 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:51.838363 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18004b1a-e605-43aa-95b1-766115ff6950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:51.839380 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18004b1a-e605-43aa-95b1-766115ff6950 admin admin] PATH_INFO: `/v3/projects/d1d57f7c129943879623e93cefa6e4a3` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:51.841469 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18004b1a-e605-43aa-95b1-766115ff6950 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1d57f7c129943879623e93cefa6e4a3)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:51.843961 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18004b1a-e605-43aa-95b1-766115ff6950 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:51.928242 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:51.957708 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7eb367e1-af04-409a-bda7-0a564f271ca4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0a70f4fa0004eb8bc9a76b5a4e362c2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:51.960467 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7eb367e1-af04-409a-bda7-0a564f271ca4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0a70f4fa0004eb8bc9a76b5a4e362c2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:51.993589 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7eb367e1-af04-409a-bda7-0a564f271ca4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0a70f4fa0004eb8bc9a76b5a4e362c2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:51.994459 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7eb367e1-af04-409a-bda7-0a564f271ca4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0a70f4fa0004eb8bc9a76b5a4e362c2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:52.006767 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-18004b1a-e605-43aa-95b1-766115ff6950 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1d57f7c129943879623e93cefa6e4a3', 'request_id': 'req-18004b1a-e605-43aa-95b1-766115ff6950'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:52.018117 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-18004b1a-e605-43aa-95b1-766115ff6950 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1d57f7c129943879623e93cefa6e4a3', 'request_id': 'req-18004b1a-e605-43aa-95b1-766115ff6950'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:52.021971 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7eb367e1-af04-409a-bda7-0a564f271ca4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0a70f4fa0004eb8bc9a76b5a4e362c2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:52.028801 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-18004b1a-e605-43aa-95b1-766115ff6950 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1d57f7c129943879623e93cefa6e4a3', 'request_id': 'req-18004b1a-e605-43aa-95b1-766115ff6950'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:52.055384 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-18004b1a-e605-43aa-95b1-766115ff6950 admin admin] The token cache is being invalidate because project d1d57f7c129943879623e93cefa6e4a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:25:52.056055 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-18004b1a-e605-43aa-95b1-766115ff6950 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:52.056563 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-18004b1a-e605-43aa-95b1-766115ff6950 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:52.058926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1013/2017] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:25:51 2022] DELETE /identity/v3/projects/d1d57f7c129943879623e93cefa6e4a3 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:52.064109 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2b12a-0d97-4add-8089-040a5759cbe4 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:52.064537 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2b12a-0d97-4add-8089-040a5759cbe4 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:52.064938 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c2b12a-0d97-4add-8089-040a5759cbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:52.075539 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1005/2018] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:25:51 2022] DELETE /identity/v3/users/d0a70f4fa0004eb8bc9a76b5a4e362c2 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:25:52.093899 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-20c2b12a-0d97-4add-8089-040a5759cbe4 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:52.095936 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-20c2b12a-0d97-4add-8089-040a5759cbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:52.112731 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb367e1-af04-409a-bda7-0a564f271ca4 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:52.114208 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7eb367e1-af04-409a-bda7-0a564f271ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:52.189544 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1014/2019] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:25:52.198738 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fbcc5-bfdb-463d-a1cb-c78a3d9d5982 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:52.199280 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fbcc5-bfdb-463d-a1cb-c78a3d9d5982 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:52.199907 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04fbcc5-bfdb-463d-a1cb-c78a3d9d5982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:52.209912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb367e1-af04-409a-bda7-0a564f271ca4 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:52.215837 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46e9be-0c14-4349-8e5e-747b553e4406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:52.216771 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46e9be-0c14-4349-8e5e-747b553e4406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:52.217075 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46e9be-0c14-4349-8e5e-747b553e4406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:52.217393 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46e9be-0c14-4349-8e5e-747b553e4406 admin admin] PATH_INFO: `/v3/projects/676041b2a92c446b80cb74f81b41006c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:52.219184 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46e9be-0c14-4349-8e5e-747b553e4406 admin admin] RBAC: Authorizing `identity:delete_project(project_id=676041b2a92c446b80cb74f81b41006c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:52.221620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46e9be-0c14-4349-8e5e-747b553e4406 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:52.230645 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-d04fbcc5-bfdb-463d-a1cb-c78a3d9d5982 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:52.231839 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d04fbcc5-bfdb-463d-a1cb-c78a3d9d5982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:52.252698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1015/2020] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:52.254938 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fbcc5-bfdb-463d-a1cb-c78a3d9d5982 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:52.280499 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04fbcc5-bfdb-463d-a1cb-c78a3d9d5982 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:52.305584 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ad46e9be-0c14-4349-8e5e-747b553e4406 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '676041b2a92c446b80cb74f81b41006c', 'request_id': 'req-ad46e9be-0c14-4349-8e5e-747b553e4406'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:52.338458 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ad46e9be-0c14-4349-8e5e-747b553e4406 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '676041b2a92c446b80cb74f81b41006c', 'request_id': 'req-ad46e9be-0c14-4349-8e5e-747b553e4406'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:52.346167 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ad46e9be-0c14-4349-8e5e-747b553e4406 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '676041b2a92c446b80cb74f81b41006c', 'request_id': 'req-ad46e9be-0c14-4349-8e5e-747b553e4406'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:52.353204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2318b329-4913-4fd8-8b85-d68b0af2d077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:52.354431 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318b329-4913-4fd8-8b85-d68b0af2d077 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:52.354713 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318b329-4913-4fd8-8b85-d68b0af2d077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:52.354977 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318b329-4913-4fd8-8b85-d68b0af2d077 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:52.355697 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2318b329-4913-4fd8-8b85-d68b0af2d077 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:25:52.356170 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2318b329-4913-4fd8-8b85-d68b0af2d077 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:52.358308 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2318b329-4913-4fd8-8b85-d68b0af2d077 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:52.375354 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ad46e9be-0c14-4349-8e5e-747b553e4406 admin admin] The token cache is being invalidate because project 676041b2a92c446b80cb74f81b41006c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:25:52.375623 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ad46e9be-0c14-4349-8e5e-747b553e4406 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:52.375998 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1016/2021] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:25:52.379963 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ad46e9be-0c14-4349-8e5e-747b553e4406 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:52.381993 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1006/2022] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:25:52 2022] DELETE /identity/v3/projects/676041b2a92c446b80cb74f81b41006c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:25:52.383342 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2318b329-4913-4fd8-8b85-d68b0af2d077 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:52.385076 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-2318b329-4913-4fd8-8b85-d68b0af2d077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:52.386899 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c21b02-d1ab-4cdb-b1c6-ff387d2ddcec None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:52.387348 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c21b02-d1ab-4cdb-b1c6-ff387d2ddcec None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:52.388012 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c21b02-d1ab-4cdb-b1c6-ff387d2ddcec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:52.398116 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2318b329-4913-4fd8-8b85-d68b0af2d077 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:52.405138 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1250c09-0b5b-4a87-944c-ba2ca0294555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:52.405433 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1250c09-0b5b-4a87-944c-ba2ca0294555 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:52.405725 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1250c09-0b5b-4a87-944c-ba2ca0294555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:52.406003 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1250c09-0b5b-4a87-944c-ba2ca0294555 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:52.406666 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1250c09-0b5b-4a87-944c-ba2ca0294555 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:52.408247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-42c21b02-d1ab-4cdb-b1c6-ff387d2ddcec None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:52.408741 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1250c09-0b5b-4a87-944c-ba2ca0294555 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:52.409469 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-42c21b02-d1ab-4cdb-b1c6-ff387d2ddcec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:52.418786 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1007/2023] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:52.426513 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e11d8e-a6b5-4609-a46e-a01cc163ed22 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:52.426936 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e11d8e-a6b5-4609-a46e-a01cc163ed22 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:52.427108 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e11d8e-a6b5-4609-a46e-a01cc163ed22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:52.435933 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:52.440998 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1017/2024] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:25:52 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:52.445207 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1250c09-0b5b-4a87-944c-ba2ca0294555 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:52.451124 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f3e11d8e-a6b5-4609-a46e-a01cc163ed22 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:52.453322 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f3e11d8e-a6b5-4609-a46e-a01cc163ed22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:52.469762 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:52.542594 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1250c09-0b5b-4a87-944c-ba2ca0294555 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:52.556635 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9093f1a-142e-4bfe-8a35-372702f70c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:52.556820 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9093f1a-142e-4bfe-8a35-372702f70c67 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:52.559153 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9093f1a-142e-4bfe-8a35-372702f70c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:52.559923 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9093f1a-142e-4bfe-8a35-372702f70c67 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:52.560118 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9093f1a-142e-4bfe-8a35-372702f70c67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:52.572693 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9093f1a-142e-4bfe-8a35-372702f70c67 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:52.579120 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1008/2025] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:25:52.579971 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e11d8e-a6b5-4609-a46e-a01cc163ed22 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:52.583509 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f3e11d8e-a6b5-4609-a46e-a01cc163ed22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:52.606660 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e11d8e-a6b5-4609-a46e-a01cc163ed22 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:52.614541 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8d894-b000-4e3d-8194-d65ee45ca906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:52.615215 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8d894-b000-4e3d-8194-d65ee45ca906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:52.615978 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8d894-b000-4e3d-8194-d65ee45ca906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:52.615978 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb8d894-b000-4e3d-8194-d65ee45ca906 admin admin] PATH_INFO: `/v3/projects/e149463d45db413aa1cd78f097e83546` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:52.617046 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8d894-b000-4e3d-8194-d65ee45ca906 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e149463d45db413aa1cd78f097e83546)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:52.619139 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb8d894-b000-4e3d-8194-d65ee45ca906 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:52.622141 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1018/2026] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:25:52 2022] POST /identity/v3/users => generated 293 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:52.622935 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9093f1a-142e-4bfe-8a35-372702f70c67 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:52.646823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9093f1a-142e-4bfe-8a35-372702f70c67 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:52.658156 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df89d1-2d84-4816-9b46-d7aec137b0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:52.661906 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df89d1-2d84-4816-9b46-d7aec137b0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:52.662124 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df89d1-2d84-4816-9b46-d7aec137b0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:52.662406 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df89d1-2d84-4816-9b46-d7aec137b0a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:52.663587 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df89d1-2d84-4816-9b46-d7aec137b0a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:25:52.664165 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df89d1-2d84-4816-9b46-d7aec137b0a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:52.665795 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df89d1-2d84-4816-9b46-d7aec137b0a1 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:52.699842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1019/2027] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:25:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:25:52.699842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df89d1-2d84-4816-9b46-d7aec137b0a1 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:52.700233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2bb8d894-b000-4e3d-8194-d65ee45ca906 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e149463d45db413aa1cd78f097e83546', 'request_id': 'req-2bb8d894-b000-4e3d-8194-d65ee45ca906'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:52.703377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2bb8d894-b000-4e3d-8194-d65ee45ca906 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e149463d45db413aa1cd78f097e83546', 'request_id': 'req-2bb8d894-b000-4e3d-8194-d65ee45ca906'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:52.708047 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df89d1-2d84-4816-9b46-d7aec137b0a1 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:52.709376 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2bb8d894-b000-4e3d-8194-d65ee45ca906 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e149463d45db413aa1cd78f097e83546', 'request_id': 'req-2bb8d894-b000-4e3d-8194-d65ee45ca906'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:52.727331 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2bb8d894-b000-4e3d-8194-d65ee45ca906 admin admin] The token cache is being invalidate because project e149463d45db413aa1cd78f097e83546 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:25:52.727715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2bb8d894-b000-4e3d-8194-d65ee45ca906 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:52.728500 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2bb8d894-b000-4e3d-8194-d65ee45ca906 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:52.731495 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1009/2028] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:25:52 2022] DELETE /identity/v3/projects/e149463d45db413aa1cd78f097e83546 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:52.732224 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8d894-b000-4e3d-8194-d65ee45ca906 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:52.736512 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2bb8d894-b000-4e3d-8194-d65ee45ca906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:52.787830 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7c8468-7ebe-46b2-aad1-740124fb3187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:52.788760 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c8468-7ebe-46b2-aad1-740124fb3187 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:52.789183 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c8468-7ebe-46b2-aad1-740124fb3187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:52.789538 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7c8468-7ebe-46b2-aad1-740124fb3187 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:52.790248 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c8468-7ebe-46b2-aad1-740124fb3187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:52.793315 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7c8468-7ebe-46b2-aad1-740124fb3187 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:52.808041 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1020/2029] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:52.808041 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a0227-c17a-4260-8acf-93d8434e6a38 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:52.808041 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a0227-c17a-4260-8acf-93d8434e6a38 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:52.808303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882a0227-c17a-4260-8acf-93d8434e6a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:52.833446 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-882a0227-c17a-4260-8acf-93d8434e6a38 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:52.834990 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-882a0227-c17a-4260-8acf-93d8434e6a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:52.836199 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb8d894-b000-4e3d-8194-d65ee45ca906 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:52.845552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1021/2030] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:52.845966 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69fad86-2731-4994-a786-fc33e2311136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:52.846708 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fad86-2731-4994-a786-fc33e2311136 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:52.847074 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a0227-c17a-4260-8acf-93d8434e6a38 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:52.847190 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fad86-2731-4994-a786-fc33e2311136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:52.847667 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69fad86-2731-4994-a786-fc33e2311136 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:52.848706 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69fad86-2731-4994-a786-fc33e2311136 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:52.848973 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-882a0227-c17a-4260-8acf-93d8434e6a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:52.850957 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69fad86-2731-4994-a786-fc33e2311136 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:52.867615 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882a0227-c17a-4260-8acf-93d8434e6a38 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:52.874270 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfff745-5702-4db5-870b-edf459629bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:52.875737 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfff745-5702-4db5-870b-edf459629bca admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:52.876058 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfff745-5702-4db5-870b-edf459629bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:52.876337 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfff745-5702-4db5-870b-edf459629bca admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:52.877321 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfff745-5702-4db5-870b-edf459629bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:52.878947 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfff745-5702-4db5-870b-edf459629bca admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:52.890052 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1022/2031] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:52.892071 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89917217-f342-4ef2-83a8-a0ac5c8bc0be None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:52.892370 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89917217-f342-4ef2-83a8-a0ac5c8bc0be None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:52.892650 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89917217-f342-4ef2-83a8-a0ac5c8bc0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:52.896354 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1010/2032] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:25:52 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:52.897858 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69fad86-2731-4994-a786-fc33e2311136 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:52.917903 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-89917217-f342-4ef2-83a8-a0ac5c8bc0be None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:52.918714 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-89917217-f342-4ef2-83a8-a0ac5c8bc0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:52.922382 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:52.996300 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69fad86-2731-4994-a786-fc33e2311136 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:53.001038 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461e439-cd71-4a9a-9992-13db78de03c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:53.001810 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461e439-cd71-4a9a-9992-13db78de03c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:53.002107 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461e439-cd71-4a9a-9992-13db78de03c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:53.002394 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461e439-cd71-4a9a-9992-13db78de03c8 admin admin] PATH_INFO: `/v3/projects/0592235ee5384029a12ff02520db7ee5/users/ab883e7365d94bdaac14140f3ee63a93/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:53.007562 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1023/2033] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:53.007562 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89917217-f342-4ef2-83a8-a0ac5c8bc0be None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:53.017071 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89917217-f342-4ef2-83a8-a0ac5c8bc0be None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:53.019687 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461e439-cd71-4a9a-9992-13db78de03c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0592235ee5384029a12ff02520db7ee5, user_id=ab883e7365d94bdaac14140f3ee63a93, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:53.021960 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455bc62-29f8-4b42-a487-9d4b879d9610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:53.022385 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461e439-cd71-4a9a-9992-13db78de03c8 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:53.022589 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455bc62-29f8-4b42-a487-9d4b879d9610 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:53.022872 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455bc62-29f8-4b42-a487-9d4b879d9610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:53.023145 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455bc62-29f8-4b42-a487-9d4b879d9610 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:53.023815 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455bc62-29f8-4b42-a487-9d4b879d9610 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:53.025863 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455bc62-29f8-4b42-a487-9d4b879d9610 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:53.038239 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1011/2034] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:52 2022] PUT /identity/v3/projects/0592235ee5384029a12ff02520db7ee5/users/ab883e7365d94bdaac14140f3ee63a93/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:53.038535 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:53.039228 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461e439-cd71-4a9a-9992-13db78de03c8 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:53.062979 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1024/2035] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:25:53 2022] POST /identity/v3/users => generated 293 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:53.064718 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb065aff-e7d7-4b54-8660-a6e4f22227ce None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:53.065046 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb065aff-e7d7-4b54-8660-a6e4f22227ce None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:53.065279 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb065aff-e7d7-4b54-8660-a6e4f22227ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:53.100534 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-eb065aff-e7d7-4b54-8660-a6e4f22227ce None None] MFA Rules not processed for user `ab883e7365d94bdaac14140f3ee63a93`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:53.101761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-eb065aff-e7d7-4b54-8660-a6e4f22227ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:53.118302 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461e439-cd71-4a9a-9992-13db78de03c8 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:53.124277 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44814e-103a-4a52-a8e8-bcb162bb6009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:53.125074 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44814e-103a-4a52-a8e8-bcb162bb6009 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:53.125357 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44814e-103a-4a52-a8e8-bcb162bb6009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:53.125658 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae44814e-103a-4a52-a8e8-bcb162bb6009 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:53.126358 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae44814e-103a-4a52-a8e8-bcb162bb6009 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:25:53.126666 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae44814e-103a-4a52-a8e8-bcb162bb6009 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:53.128300 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae44814e-103a-4a52-a8e8-bcb162bb6009 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:53.140078 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1012/2036] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:25:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:25:53.140882 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44814e-103a-4a52-a8e8-bcb162bb6009 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:53.150373 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae44814e-103a-4a52-a8e8-bcb162bb6009 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:53.155019 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7056b9-2e95-4176-906d-6d1492beacfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:53.155660 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7056b9-2e95-4176-906d-6d1492beacfa admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:53.155889 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7056b9-2e95-4176-906d-6d1492beacfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:53.156201 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7056b9-2e95-4176-906d-6d1492beacfa admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:53.156882 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7056b9-2e95-4176-906d-6d1492beacfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:53.158448 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7056b9-2e95-4176-906d-6d1492beacfa admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:53.169756 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1013/2037] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:53.170589 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7056b9-2e95-4176-906d-6d1492beacfa admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:53.171006 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1025/2038] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:53.175593 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb065aff-e7d7-4b54-8660-a6e4f22227ce None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:53.183785 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7056b9-2e95-4176-906d-6d1492beacfa admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:53.187830 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb065aff-e7d7-4b54-8660-a6e4f22227ce None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:53.188584 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f2146-1807-4943-a6d4-34a670ffc0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:53.189192 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f2146-1807-4943-a6d4-34a670ffc0a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:53.189477 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f2146-1807-4943-a6d4-34a670ffc0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:53.189757 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f2146-1807-4943-a6d4-34a670ffc0a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:53.190418 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f2146-1807-4943-a6d4-34a670ffc0a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:53.192348 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f2146-1807-4943-a6d4-34a670ffc0a4 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:53.192783 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674ea89-973a-4418-a8e1-9eb9667d6a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:53.193411 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674ea89-973a-4418-a8e1-9eb9667d6a6c admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:53.193689 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674ea89-973a-4418-a8e1-9eb9667d6a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:53.193960 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9674ea89-973a-4418-a8e1-9eb9667d6a6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:53.194654 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674ea89-973a-4418-a8e1-9eb9667d6a6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:53.196392 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9674ea89-973a-4418-a8e1-9eb9667d6a6c admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:53.212291 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1026/2039] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:53.213032 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674ea89-973a-4418-a8e1-9eb9667d6a6c admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:53.214802 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9674ea89-973a-4418-a8e1-9eb9667d6a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:53.223164 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1014/2040] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:25:53 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:53.223898 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f2146-1807-4943-a6d4-34a670ffc0a4 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:53.280755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9674ea89-973a-4418-a8e1-9eb9667d6a6c admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:53.289554 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:53.296941 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f2146-1807-4943-a6d4-34a670ffc0a4 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:53.303015 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6aa8a-9425-4e8c-a00e-06df226560fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:53.303684 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6aa8a-9425-4e8c-a00e-06df226560fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:53.303969 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6aa8a-9425-4e8c-a00e-06df226560fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:53.304281 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6aa8a-9425-4e8c-a00e-06df226560fd admin admin] PATH_INFO: `/v3/projects/d0d84f5be7fd4b499171b6b34a1203f1/users/36a5d6a0bc374dc598096f30e3cd17ef/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:53.321818 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6aa8a-9425-4e8c-a00e-06df226560fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0d84f5be7fd4b499171b6b34a1203f1, user_id=36a5d6a0bc374dc598096f30e3cd17ef, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:53.325155 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6aa8a-9425-4e8c-a00e-06df226560fd admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:53.335287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65e38ea-0a95-490a-bd47-a7bafd88edf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:53.336137 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e38ea-0a95-490a-bd47-a7bafd88edf7 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:53.336288 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e38ea-0a95-490a-bd47-a7bafd88edf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:53.336514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65e38ea-0a95-490a-bd47-a7bafd88edf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:53.341524 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1015/2041] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:53 2022] PUT /identity/v3/projects/d0d84f5be7fd4b499171b6b34a1203f1/users/36a5d6a0bc374dc598096f30e3cd17ef/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:53.342380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6aa8a-9425-4e8c-a00e-06df226560fd admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:53.399636 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:53.421533 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e38ea-0a95-490a-bd47-a7bafd88edf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:53.423083 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65e38ea-0a95-490a-bd47-a7bafd88edf7 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:53.429529 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6aa8a-9425-4e8c-a00e-06df226560fd admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:53.432720 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1027/2042] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:53.434955 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5c370-778b-4678-8212-5a0b86ec762c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:53.435822 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fb2db-1367-4a84-9869-c853283dba5e None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:53.435920 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5c370-778b-4678-8212-5a0b86ec762c admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:53.436040 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fb2db-1367-4a84-9869-c853283dba5e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:53.436130 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5c370-778b-4678-8212-5a0b86ec762c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:53.436244 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fb2db-1367-4a84-9869-c853283dba5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:53.436341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5c370-778b-4678-8212-5a0b86ec762c admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:53.436927 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e5c370-778b-4678-8212-5a0b86ec762c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:53.438838 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e5c370-778b-4678-8212-5a0b86ec762c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:53.471380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1016/2043] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:25:53 2022] POST /identity/v3/users => generated 289 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:53.472399 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5c370-778b-4678-8212-5a0b86ec762c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:53.475959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-da0fb2db-1367-4a84-9869-c853283dba5e None None] MFA Rules not processed for user `36a5d6a0bc374dc598096f30e3cd17ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:53.477191 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-da0fb2db-1367-4a84-9869-c853283dba5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:53.484592 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5c370-778b-4678-8212-5a0b86ec762c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:53.490552 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334759a-d45b-43c3-bebe-5ab50aaca487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:53.491228 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334759a-d45b-43c3-bebe-5ab50aaca487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:53.491512 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334759a-d45b-43c3-bebe-5ab50aaca487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:53.491786 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2334759a-d45b-43c3-bebe-5ab50aaca487 admin admin] PATH_INFO: `/v3/users/ab883e7365d94bdaac14140f3ee63a93` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:53.493012 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334759a-d45b-43c3-bebe-5ab50aaca487 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab883e7365d94bdaac14140f3ee63a93)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:53.495444 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2334759a-d45b-43c3-bebe-5ab50aaca487 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:53.551149 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2334759a-d45b-43c3-bebe-5ab50aaca487 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab883e7365d94bdaac14140f3ee63a93'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:53.551687 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1028/2044] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:53.552696 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2334759a-d45b-43c3-bebe-5ab50aaca487 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab883e7365d94bdaac14140f3ee63a93'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:53.552943 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fb2db-1367-4a84-9869-c853283dba5e None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:53.561306 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2334759a-d45b-43c3-bebe-5ab50aaca487 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab883e7365d94bdaac14140f3ee63a93'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:53.562036 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2334759a-d45b-43c3-bebe-5ab50aaca487 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab883e7365d94bdaac14140f3ee63a93'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:53.564328 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fb2db-1367-4a84-9869-c853283dba5e None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:53.569004 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a9b38-dde5-4b2a-a885-0f80b716c272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:53.569610 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a9b38-dde5-4b2a-a885-0f80b716c272 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:53.569897 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a9b38-dde5-4b2a-a885-0f80b716c272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:53.570172 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a9b38-dde5-4b2a-a885-0f80b716c272 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:53.570893 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a9b38-dde5-4b2a-a885-0f80b716c272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:53.572716 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a9b38-dde5-4b2a-a885-0f80b716c272 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:53.576026 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2334759a-d45b-43c3-bebe-5ab50aaca487 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab883e7365d94bdaac14140f3ee63a93'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:53.591628 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1029/2045] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:53.591628 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a9b38-dde5-4b2a-a885-0f80b716c272 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:53.593944 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5e6a9b38-dde5-4b2a-a885-0f80b716c272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:53.595678 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1017/2046] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:25:53 2022] DELETE /identity/v3/users/ab883e7365d94bdaac14140f3ee63a93 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:53.596563 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334759a-d45b-43c3-bebe-5ab50aaca487 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:53.597890 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2334759a-d45b-43c3-bebe-5ab50aaca487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:53.606583 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a9b38-dde5-4b2a-a885-0f80b716c272 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:53.641131 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:53.666317 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2334759a-d45b-43c3-bebe-5ab50aaca487 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:53.668457 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79406c72-6214-4814-b653-867f80dcbb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:53.669085 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79406c72-6214-4814-b653-867f80dcbb3a admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:53.669367 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79406c72-6214-4814-b653-867f80dcbb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:53.669685 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79406c72-6214-4814-b653-867f80dcbb3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:53.670356 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79406c72-6214-4814-b653-867f80dcbb3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:53.671482 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d1355-22d4-481c-8eab-24c5677f5971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:53.672140 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d1355-22d4-481c-8eab-24c5677f5971 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:53.672309 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79406c72-6214-4814-b653-867f80dcbb3a admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:53.672428 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d1355-22d4-481c-8eab-24c5677f5971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:53.672708 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d1355-22d4-481c-8eab-24c5677f5971 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:53.673407 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d1355-22d4-481c-8eab-24c5677f5971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:53.674979 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d1355-22d4-481c-8eab-24c5677f5971 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:53.691047 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1018/2047] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:53.691047 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d393f1a-75bf-4e6c-a974-69af699b406f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:53.691047 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d393f1a-75bf-4e6c-a974-69af699b406f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:53.691047 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d393f1a-75bf-4e6c-a974-69af699b406f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:53.709255 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1030/2048] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:25:53 2022] POST /identity/v3/projects => generated 383 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:53.710127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79406c72-6214-4814-b653-867f80dcbb3a admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:53.712582 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4d393f1a-75bf-4e6c-a974-69af699b406f None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:53.714080 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4d393f1a-75bf-4e6c-a974-69af699b406f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:53.773251 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:53.796138 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1019/2049] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:53.797010 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d393f1a-75bf-4e6c-a974-69af699b406f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:53.806621 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79406c72-6214-4814-b653-867f80dcbb3a admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:53.810277 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d393f1a-75bf-4e6c-a974-69af699b406f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:53.813527 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec4f93-1d59-41d7-8176-9789e83f31d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:53.814657 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec4f93-1d59-41d7-8176-9789e83f31d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:53.815157 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec4f93-1d59-41d7-8176-9789e83f31d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:53.815307 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe57e74-aeb7-43ba-a6b6-2e2d69710f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:53.815749 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ec4f93-1d59-41d7-8176-9789e83f31d1 admin admin] PATH_INFO: `/v3/projects/05f3e162ed784bcf9086a7ec848e37f3/users/f5b17712d1fc47b7a87713808f0672bc/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:53.815905 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe57e74-aeb7-43ba-a6b6-2e2d69710f81 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:53.816223 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe57e74-aeb7-43ba-a6b6-2e2d69710f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:53.816999 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe57e74-aeb7-43ba-a6b6-2e2d69710f81 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:53.817158 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe57e74-aeb7-43ba-a6b6-2e2d69710f81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:53.819136 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe57e74-aeb7-43ba-a6b6-2e2d69710f81 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:53.836870 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec4f93-1d59-41d7-8176-9789e83f31d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05f3e162ed784bcf9086a7ec848e37f3, user_id=f5b17712d1fc47b7a87713808f0672bc, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:53.840829 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ec4f93-1d59-41d7-8176-9789e83f31d1 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:53.852747 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1020/2050] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:25:53 2022] POST /identity/v3/users => generated 292 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:53.853769 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe57e74-aeb7-43ba-a6b6-2e2d69710f81 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:53.861560 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-abe57e74-aeb7-43ba-a6b6-2e2d69710f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:53.863482 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1031/2051] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:53 2022] PUT /identity/v3/projects/05f3e162ed784bcf9086a7ec848e37f3/users/f5b17712d1fc47b7a87713808f0672bc/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:53.864363 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec4f93-1d59-41d7-8176-9789e83f31d1 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:53.949563 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ec4f93-1d59-41d7-8176-9789e83f31d1 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:53.967449 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df050fb-03e5-4828-afcb-727f7a74290d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:53.968560 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df050fb-03e5-4828-afcb-727f7a74290d admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:53.968844 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df050fb-03e5-4828-afcb-727f7a74290d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:53.969235 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df050fb-03e5-4828-afcb-727f7a74290d admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:53.969978 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df050fb-03e5-4828-afcb-727f7a74290d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:53.971571 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df050fb-03e5-4828-afcb-727f7a74290d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:53.973886 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe57e74-aeb7-43ba-a6b6-2e2d69710f81 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:53.984206 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1032/2052] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:53.985691 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edea61-e8ee-4a3c-a19c-4abf9b460a79 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:53.986072 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edea61-e8ee-4a3c-a19c-4abf9b460a79 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:53.986352 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38edea61-e8ee-4a3c-a19c-4abf9b460a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:54.042109 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-38edea61-e8ee-4a3c-a19c-4abf9b460a79 None None] MFA Rules not processed for user `f5b17712d1fc47b7a87713808f0672bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:54.044024 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-38edea61-e8ee-4a3c-a19c-4abf9b460a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:54.059205 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1028e3f-37a8-43d7-8112-7bd7fac6546b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:54.060258 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1028e3f-37a8-43d7-8112-7bd7fac6546b service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:54.060258 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1028e3f-37a8-43d7-8112-7bd7fac6546b service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:54.060550 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1028e3f-37a8-43d7-8112-7bd7fac6546b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:54.071586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1028e3f-37a8-43d7-8112-7bd7fac6546b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:54.073172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1028e3f-37a8-43d7-8112-7bd7fac6546b service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:54.087217 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1021/2053] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:54.088735 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1028e3f-37a8-43d7-8112-7bd7fac6546b service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:54.103810 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1028e3f-37a8-43d7-8112-7bd7fac6546b service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:54.111154 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e35b70-1862-4b0e-a24c-fdb0baa4f41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:54.111915 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e35b70-1862-4b0e-a24c-fdb0baa4f41d admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:54.112248 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e35b70-1862-4b0e-a24c-fdb0baa4f41d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:54.112524 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e35b70-1862-4b0e-a24c-fdb0baa4f41d admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:54.113271 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e35b70-1862-4b0e-a24c-fdb0baa4f41d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:54.115192 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e35b70-1862-4b0e-a24c-fdb0baa4f41d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:54.129659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1022/2054] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:54.130914 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e35b70-1862-4b0e-a24c-fdb0baa4f41d admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:54.137260 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1033/2055] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:54.149121 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38edea61-e8ee-4a3c-a19c-4abf9b460a79 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:54.150083 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e35b70-1862-4b0e-a24c-fdb0baa4f41d admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:54.151067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-38edea61-e8ee-4a3c-a19c-4abf9b460a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:54.156733 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cb02a-2f66-49b5-82a6-b24ffef73e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:54.157503 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cb02a-2f66-49b5-82a6-b24ffef73e2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:54.157792 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cb02a-2f66-49b5-82a6-b24ffef73e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:54.158181 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cb02a-2f66-49b5-82a6-b24ffef73e2f admin admin] PATH_INFO: `/v3/projects/a00c7b30fe9348009f4e3e8c29550758/users/10358afa427f434985374ced64a03ab7/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:54.161170 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:54.185125 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cb02a-2f66-49b5-82a6-b24ffef73e2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a00c7b30fe9348009f4e3e8c29550758, user_id=10358afa427f434985374ced64a03ab7, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:54.189404 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cb02a-2f66-49b5-82a6-b24ffef73e2f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:54.210111 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1023/2056] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:54 2022] PUT /identity/v3/projects/a00c7b30fe9348009f4e3e8c29550758/users/10358afa427f434985374ced64a03ab7/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:54.221951 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132150b6-a037-46ae-a3e3-ea88cb7e62db None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:54.222322 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132150b6-a037-46ae-a3e3-ea88cb7e62db None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:54.222509 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132150b6-a037-46ae-a3e3-ea88cb7e62db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:54.241852 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38edea61-e8ee-4a3c-a19c-4abf9b460a79 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:54.254941 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:54.273919 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-132150b6-a037-46ae-a3e3-ea88cb7e62db None None] MFA Rules not processed for user `10358afa427f434985374ced64a03ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:54.275151 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-132150b6-a037-46ae-a3e3-ea88cb7e62db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:54.340588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b11c94-53b6-4d3f-ade1-9bcc40bacb74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:54.341227 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b11c94-53b6-4d3f-ade1-9bcc40bacb74 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:54.341493 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b11c94-53b6-4d3f-ade1-9bcc40bacb74 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:54.341951 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b11c94-53b6-4d3f-ade1-9bcc40bacb74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:54.379812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1024/2057] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:25:54.384377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132150b6-a037-46ae-a3e3-ea88cb7e62db None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:54.420982 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b11c94-53b6-4d3f-ade1-9bcc40bacb74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:54.422794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b11c94-53b6-4d3f-ade1-9bcc40bacb74 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:54.434237 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1034/2058] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 15:25:54.471755 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132150b6-a037-46ae-a3e3-ea88cb7e62db None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:54.479647 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c8cce-e2be-423a-b104-3c9347220578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:54.482256 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c8cce-e2be-423a-b104-3c9347220578 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:54.482256 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c8cce-e2be-423a-b104-3c9347220578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:54.482256 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457c8cce-e2be-423a-b104-3c9347220578 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:54.482907 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c8cce-e2be-423a-b104-3c9347220578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:54.484855 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457c8cce-e2be-423a-b104-3c9347220578 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:54.548042 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1025/2059] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:25:54 2022] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:25:54.548690 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b11c94-53b6-4d3f-ade1-9bcc40bacb74 service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:54.549180 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c8cce-e2be-423a-b104-3c9347220578 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:54.549834 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-79b11c94-53b6-4d3f-ade1-9bcc40bacb74 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:54.584342 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b11c94-53b6-4d3f-ade1-9bcc40bacb74 service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:54.643811 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:54.651578 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457c8cce-e2be-423a-b104-3c9347220578 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:54.663800 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac897ff4-97d8-452f-ac41-9bd842a06fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:54.664148 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac897ff4-97d8-452f-ac41-9bd842a06fbb admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:54.664356 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac897ff4-97d8-452f-ac41-9bd842a06fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:54.664634 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac897ff4-97d8-452f-ac41-9bd842a06fbb admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:54.665383 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac897ff4-97d8-452f-ac41-9bd842a06fbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:54.667540 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac897ff4-97d8-452f-ac41-9bd842a06fbb admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:54.707437 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1026/2060] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:25:54 2022] POST /identity/v3/users => generated 299 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:25:54.711559 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac897ff4-97d8-452f-ac41-9bd842a06fbb admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:54.726091 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20599c9e-5243-412a-86b2-9b696dbd2cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:54.726806 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20599c9e-5243-412a-86b2-9b696dbd2cd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:54.727803 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac897ff4-97d8-452f-ac41-9bd842a06fbb admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:54.728346 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20599c9e-5243-412a-86b2-9b696dbd2cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:54.728681 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20599c9e-5243-412a-86b2-9b696dbd2cd4 admin admin] PATH_INFO: `/v3/projects/0592235ee5384029a12ff02520db7ee5` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:54.730838 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20599c9e-5243-412a-86b2-9b696dbd2cd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0592235ee5384029a12ff02520db7ee5)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:54.732896 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20b215-0bb7-4827-a112-f3e8499617ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:54.733522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20b215-0bb7-4827-a112-f3e8499617ed admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:54.733809 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20b215-0bb7-4827-a112-f3e8499617ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:54.734091 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20b215-0bb7-4827-a112-f3e8499617ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:54.734796 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20b215-0bb7-4827-a112-f3e8499617ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:54.736455 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b20b215-0bb7-4827-a112-f3e8499617ed admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:54.738021 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20599c9e-5243-412a-86b2-9b696dbd2cd4 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:54.749593 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1027/2061] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 15:25:54.755524 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20b215-0bb7-4827-a112-f3e8499617ed admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:54.777800 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20b215-0bb7-4827-a112-f3e8499617ed admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:54.790195 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90eec2-85f0-4092-8d53-593875a72eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:54.792108 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90eec2-85f0-4092-8d53-593875a72eb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:54.792365 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90eec2-85f0-4092-8d53-593875a72eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:54.792721 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f90eec2-85f0-4092-8d53-593875a72eb0 admin admin] PATH_INFO: `/v3/projects/23959e53f5404cdfb5c9e080a60c9d82/users/e640bc4c5d50476a9b50f78c6e837e45/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:54.815602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90eec2-85f0-4092-8d53-593875a72eb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23959e53f5404cdfb5c9e080a60c9d82, user_id=e640bc4c5d50476a9b50f78c6e837e45, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:54.824904 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f90eec2-85f0-4092-8d53-593875a72eb0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:54.846824 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-20599c9e-5243-412a-86b2-9b696dbd2cd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0592235ee5384029a12ff02520db7ee5', 'request_id': 'req-20599c9e-5243-412a-86b2-9b696dbd2cd4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:54.853127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1028/2062] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:54 2022] PUT /identity/v3/projects/23959e53f5404cdfb5c9e080a60c9d82/users/e640bc4c5d50476a9b50f78c6e837e45/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:54.854420 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-20599c9e-5243-412a-86b2-9b696dbd2cd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0592235ee5384029a12ff02520db7ee5', 'request_id': 'req-20599c9e-5243-412a-86b2-9b696dbd2cd4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:54.857258 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90eec2-85f0-4092-8d53-593875a72eb0 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:54.862459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-20599c9e-5243-412a-86b2-9b696dbd2cd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0592235ee5384029a12ff02520db7ee5', 'request_id': 'req-20599c9e-5243-412a-86b2-9b696dbd2cd4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:54.866398 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:54.884356 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-20599c9e-5243-412a-86b2-9b696dbd2cd4 admin admin] The token cache is being invalidate because project 0592235ee5384029a12ff02520db7ee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:25:54.884887 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-20599c9e-5243-412a-86b2-9b696dbd2cd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:54.889209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-20599c9e-5243-412a-86b2-9b696dbd2cd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:54.891618 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1035/2063] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:25:54 2022] DELETE /identity/v3/projects/0592235ee5384029a12ff02520db7ee5 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:25:54.896763 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5dd081-61c3-4c1b-ba2d-8b388215d535 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:54.897210 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5dd081-61c3-4c1b-ba2d-8b388215d535 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:54.897537 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5dd081-61c3-4c1b-ba2d-8b388215d535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:54.923356 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-9f5dd081-61c3-4c1b-ba2d-8b388215d535 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:54.924611 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9f5dd081-61c3-4c1b-ba2d-8b388215d535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:54.954129 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f90eec2-85f0-4092-8d53-593875a72eb0 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:54.970002 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207bf814-c891-46e1-a746-2e7aec280b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:54.970655 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207bf814-c891-46e1-a746-2e7aec280b60 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:54.971062 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207bf814-c891-46e1-a746-2e7aec280b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:54.971412 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207bf814-c891-46e1-a746-2e7aec280b60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:54.972299 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207bf814-c891-46e1-a746-2e7aec280b60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:54.973897 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207bf814-c891-46e1-a746-2e7aec280b60 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:54.992566 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1029/2064] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:54 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 15:25:54.996727 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207bf814-c891-46e1-a746-2e7aec280b60 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:54.999193 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-207bf814-c891-46e1-a746-2e7aec280b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:55.012998 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207bf814-c891-46e1-a746-2e7aec280b60 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:55.020154 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32af101d-a9c5-4d97-895b-d8a4625b14fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:55.020955 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af101d-a9c5-4d97-895b-d8a4625b14fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:55.021513 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af101d-a9c5-4d97-895b-d8a4625b14fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:55.021802 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32af101d-a9c5-4d97-895b-d8a4625b14fe admin admin] PATH_INFO: `/v3/projects/23959e53f5404cdfb5c9e080a60c9d82/users/e640bc4c5d50476a9b50f78c6e837e45/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:55.024132 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af101d-a9c5-4d97-895b-d8a4625b14fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=23959e53f5404cdfb5c9e080a60c9d82, user_id=e640bc4c5d50476a9b50f78c6e837e45, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:55.027317 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32af101d-a9c5-4d97-895b-d8a4625b14fe admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:55.040101 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1030/2065] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:54 2022] PUT /identity/v3/projects/23959e53f5404cdfb5c9e080a60c9d82/users/e640bc4c5d50476a9b50f78c6e837e45/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:25:55.050187 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1036/2066] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:55.050978 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ab468-d031-4975-8c7b-dd53474317cd None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:55.051403 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ab468-d031-4975-8c7b-dd53474317cd None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:55.051906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ab468-d031-4975-8c7b-dd53474317cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:55.052723 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12abf5-67de-4da9-a995-903a6fc8ff39 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:55.052723 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12abf5-67de-4da9-a995-903a6fc8ff39 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:55.053099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd12abf5-67de-4da9-a995-903a6fc8ff39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:55.083107 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-cd12abf5-67de-4da9-a995-903a6fc8ff39 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:55.084625 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-cd12abf5-67de-4da9-a995-903a6fc8ff39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:55.095320 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4e2ab468-d031-4975-8c7b-dd53474317cd None None] MFA Rules not processed for user `e640bc4c5d50476a9b50f78c6e837e45`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:55.097755 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4e2ab468-d031-4975-8c7b-dd53474317cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:55.181748 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1037/2067] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:55.187024 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12abf5-67de-4da9-a995-903a6fc8ff39 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:55.197363 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd12abf5-67de-4da9-a995-903a6fc8ff39 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:55.202517 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e03d1-29e6-4883-b9d1-ecf2fc09eb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:55.203398 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e03d1-29e6-4883-b9d1-ecf2fc09eb86 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:55.203398 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e03d1-29e6-4883-b9d1-ecf2fc09eb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:55.203654 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110e03d1-29e6-4883-b9d1-ecf2fc09eb86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:55.204207 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1031/2068] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:55 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:25:55.204456 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e03d1-29e6-4883-b9d1-ecf2fc09eb86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:25:55.204765 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e03d1-29e6-4883-b9d1-ecf2fc09eb86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:55.206657 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110e03d1-29e6-4883-b9d1-ecf2fc09eb86 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:55.217014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ab468-d031-4975-8c7b-dd53474317cd None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:55.218737 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4e2ab468-d031-4975-8c7b-dd53474317cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:55.220028 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1038/2069] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:25:55.224373 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e03d1-29e6-4883-b9d1-ecf2fc09eb86 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:55.235144 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110e03d1-29e6-4883-b9d1-ecf2fc09eb86 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:55.239776 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4003974-c3bb-463e-ba81-74413f39cdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:55.240417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4003974-c3bb-463e-ba81-74413f39cdf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:55.240701 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4003974-c3bb-463e-ba81-74413f39cdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:55.240977 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4003974-c3bb-463e-ba81-74413f39cdf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:55.241644 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4003974-c3bb-463e-ba81-74413f39cdf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:55.243551 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4003974-c3bb-463e-ba81-74413f39cdf7 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:55.245954 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:55.302882 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ab468-d031-4975-8c7b-dd53474317cd None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:55.308202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1039/2070] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:25:55 2022] POST /identity/v3/projects => generated 359 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:55.311756 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4003974-c3bb-463e-ba81-74413f39cdf7 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:55.378079 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f60e4-3a97-49e5-820d-e2c3f87dc3ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:55.378712 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f60e4-3a97-49e5-820d-e2c3f87dc3ed service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:55.378990 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f60e4-3a97-49e5-820d-e2c3f87dc3ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:55.379264 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082f60e4-3a97-49e5-820d-e2c3f87dc3ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:55.381368 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-082f60e4-3a97-49e5-820d-e2c3f87dc3ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:55.424614 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4003974-c3bb-463e-ba81-74413f39cdf7 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:55.432435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf877b7-9f11-44e2-829f-cd8229c45b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:55.433115 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf877b7-9f11-44e2-829f-cd8229c45b11 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:55.433440 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf877b7-9f11-44e2-829f-cd8229c45b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:55.433748 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf877b7-9f11-44e2-829f-cd8229c45b11 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:55.434443 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf877b7-9f11-44e2-829f-cd8229c45b11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:55.438105 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf877b7-9f11-44e2-829f-cd8229c45b11 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:55.448702 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:55.468161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1040/2071] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:25:55 2022] POST /identity/v3/users => generated 280 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:55.469424 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf877b7-9f11-44e2-829f-cd8229c45b11 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:55.473861 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f60e4-3a97-49e5-820d-e2c3f87dc3ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:55.475298 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082f60e4-3a97-49e5-820d-e2c3f87dc3ed service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:55.482953 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf877b7-9f11-44e2-829f-cd8229c45b11 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:55.485043 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1032/2072] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:55 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 15:25:55.490520 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f5a6d-33ee-465f-98e0-e37581a60fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:55.491410 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f5a6d-33ee-465f-98e0-e37581a60fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:55.491694 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f5a6d-33ee-465f-98e0-e37581a60fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:55.491966 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648f5a6d-33ee-465f-98e0-e37581a60fb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:55.492712 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f5a6d-33ee-465f-98e0-e37581a60fb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:55.494298 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648f5a6d-33ee-465f-98e0-e37581a60fb3 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:55.510909 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1041/2073] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 15:25:55.512198 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f60e4-3a97-49e5-820d-e2c3f87dc3ed service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:55.527127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082f60e4-3a97-49e5-820d-e2c3f87dc3ed service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:55.532080 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77cf58f-e461-45fb-bb17-712e2b5c47de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:55.532706 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cf58f-e461-45fb-bb17-712e2b5c47de admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:55.532998 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cf58f-e461-45fb-bb17-712e2b5c47de admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:55.533276 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77cf58f-e461-45fb-bb17-712e2b5c47de admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:55.534063 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77cf58f-e461-45fb-bb17-712e2b5c47de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:55.536541 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77cf58f-e461-45fb-bb17-712e2b5c47de admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:55.549869 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1033/2074] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:55.554786 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f5a6d-33ee-465f-98e0-e37581a60fb3 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:55.575865 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648f5a6d-33ee-465f-98e0-e37581a60fb3 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:55.593286 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9d960-5f53-4aac-900f-a221e46db25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:55.594173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9d960-5f53-4aac-900f-a221e46db25d admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:55.594525 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9d960-5f53-4aac-900f-a221e46db25d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:55.595484 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab9d960-5f53-4aac-900f-a221e46db25d admin admin] PATH_INFO: `/v3/projects/55e6efde93dc48afb2909f4af3d60035/users/fb8a1b19990a4034ac6ffcbd5672b36c/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:55.616813 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab9d960-5f53-4aac-900f-a221e46db25d admin admin] RBAC: Authorizing `identity:create_grant(project_id=55e6efde93dc48afb2909f4af3d60035, user_id=fb8a1b19990a4034ac6ffcbd5672b36c, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:55.620576 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab9d960-5f53-4aac-900f-a221e46db25d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:55.670800 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1042/2075] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:55 2022] PUT /identity/v3/projects/55e6efde93dc48afb2909f4af3d60035/users/fb8a1b19990a4034ac6ffcbd5672b36c/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:55.674199 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee81489-5fe5-4668-a1fe-18450b70702d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:55.674558 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee81489-5fe5-4668-a1fe-18450b70702d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:55.674956 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee81489-5fe5-4668-a1fe-18450b70702d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:55.725592 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-1ee81489-5fe5-4668-a1fe-18450b70702d None None] MFA Rules not processed for user `fb8a1b19990a4034ac6ffcbd5672b36c`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:55.727449 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1ee81489-5fe5-4668-a1fe-18450b70702d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:55.898749 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1034/2076] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:55 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:56.038128 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9d960-5f53-4aac-900f-a221e46db25d admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:56.041180 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-cab9d960-5f53-4aac-900f-a221e46db25d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:56.138867 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab9d960-5f53-4aac-900f-a221e46db25d admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:56.148510 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4acc449-f9fb-4095-a188-1215f3f44ecc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:56.149770 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acc449-f9fb-4095-a188-1215f3f44ecc service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:56.150289 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acc449-f9fb-4095-a188-1215f3f44ecc service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:56.150804 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4acc449-f9fb-4095-a188-1215f3f44ecc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:56.190301 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4acc449-f9fb-4095-a188-1215f3f44ecc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:56.192598 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4acc449-f9fb-4095-a188-1215f3f44ecc service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:56.215799 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1043/2077] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:56 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:56.236228 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee81489-5fe5-4668-a1fe-18450b70702d None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:56.251526 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:56.369104 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee81489-5fe5-4668-a1fe-18450b70702d None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:56.386171 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02daea2-1681-4668-b528-5b682739473f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:56.387485 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02daea2-1681-4668-b528-5b682739473f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:56.388078 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02daea2-1681-4668-b528-5b682739473f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:56.388774 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02daea2-1681-4668-b528-5b682739473f admin admin] PATH_INFO: `/v3/users/fb8a1b19990a4034ac6ffcbd5672b36c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:56.390151 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02daea2-1681-4668-b528-5b682739473f admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb8a1b19990a4034ac6ffcbd5672b36c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:56.392500 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02daea2-1681-4668-b528-5b682739473f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:56.491169 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a02daea2-1681-4668-b528-5b682739473f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb8a1b19990a4034ac6ffcbd5672b36c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:56.492161 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a02daea2-1681-4668-b528-5b682739473f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb8a1b19990a4034ac6ffcbd5672b36c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:56.515812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a02daea2-1681-4668-b528-5b682739473f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb8a1b19990a4034ac6ffcbd5672b36c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:56.516768 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a02daea2-1681-4668-b528-5b682739473f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb8a1b19990a4034ac6ffcbd5672b36c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:56.535373 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a02daea2-1681-4668-b528-5b682739473f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb8a1b19990a4034ac6ffcbd5672b36c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:56.555490 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1035/2078] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:25:56 2022] DELETE /identity/v3/users/fb8a1b19990a4034ac6ffcbd5672b36c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:56.560916 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451c0df-552e-4689-b30a-9ffede0144b7 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:56.561213 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451c0df-552e-4689-b30a-9ffede0144b7 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:56.561579 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451c0df-552e-4689-b30a-9ffede0144b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:56.589748 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-a451c0df-552e-4689-b30a-9ffede0144b7 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:56.592418 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a451c0df-552e-4689-b30a-9ffede0144b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:56.667332 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1044/2079] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:25:56.674069 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02daea2-1681-4668-b528-5b682739473f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:56.675698 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a02daea2-1681-4668-b528-5b682739473f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:56.738267 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02daea2-1681-4668-b528-5b682739473f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:56.741977 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9dfcf-56f0-4f6d-831e-9cb80df58610 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:56.742595 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9dfcf-56f0-4f6d-831e-9cb80df58610 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:56.742880 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9dfcf-56f0-4f6d-831e-9cb80df58610 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:56.743156 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9dfcf-56f0-4f6d-831e-9cb80df58610 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:56.752335 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9dfcf-56f0-4f6d-831e-9cb80df58610 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:56.753761 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9dfcf-56f0-4f6d-831e-9cb80df58610 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:56.763294 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1036/2080] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:57.262956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451c0df-552e-4689-b30a-9ffede0144b7 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:57.264770 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a451c0df-552e-4689-b30a-9ffede0144b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:57.278818 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451c0df-552e-4689-b30a-9ffede0144b7 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:57.282110 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9dfcf-56f0-4f6d-831e-9cb80df58610 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:57.283488 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-23a9dfcf-56f0-4f6d-831e-9cb80df58610 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:57.284276 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ef2c2-dbf4-4030-ab88-694d77799c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:57.285042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ef2c2-dbf4-4030-ab88-694d77799c83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:57.285466 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ef2c2-dbf4-4030-ab88-694d77799c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:57.285754 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ef2c2-dbf4-4030-ab88-694d77799c83 admin admin] PATH_INFO: `/v3/projects/55e6efde93dc48afb2909f4af3d60035` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:57.287082 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ef2c2-dbf4-4030-ab88-694d77799c83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55e6efde93dc48afb2909f4af3d60035)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:57.289366 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ef2c2-dbf4-4030-ab88-694d77799c83 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:57.326317 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:57.348456 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-8b8ef2c2-dbf4-4030-ab88-694d77799c83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55e6efde93dc48afb2909f4af3d60035', 'request_id': 'req-8b8ef2c2-dbf4-4030-ab88-694d77799c83'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:57.350863 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:INSERT=4,keystone:SELECT=92,keystone:DELETE=4 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:57.352397 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9dfcf-56f0-4f6d-831e-9cb80df58610 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:57.356198 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-8b8ef2c2-dbf4-4030-ab88-694d77799c83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55e6efde93dc48afb2909f4af3d60035', 'request_id': 'req-8b8ef2c2-dbf4-4030-ab88-694d77799c83'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:57.363794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-8b8ef2c2-dbf4-4030-ab88-694d77799c83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55e6efde93dc48afb2909f4af3d60035', 'request_id': 'req-8b8ef2c2-dbf4-4030-ab88-694d77799c83'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:57.378591 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-8b8ef2c2-dbf4-4030-ab88-694d77799c83 admin admin] The token cache is being invalidate because project 55e6efde93dc48afb2909f4af3d60035 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:25:57.378903 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-8b8ef2c2-dbf4-4030-ab88-694d77799c83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:57.379731 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-8b8ef2c2-dbf4-4030-ab88-694d77799c83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:57.381288 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1045/2081] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:25:57 2022] DELETE /identity/v3/projects/55e6efde93dc48afb2909f4af3d60035 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:57.387440 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a196398-3797-445e-9a1c-17248938ca1e None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:57.387796 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a196398-3797-445e-9a1c-17248938ca1e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:57.388104 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a196398-3797-445e-9a1c-17248938ca1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:57.407207 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-1a196398-3797-445e-9a1c-17248938ca1e None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:57.408441 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-1a196398-3797-445e-9a1c-17248938ca1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:57.409461 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f668ea7-046b-4458-9c9e-5bbf7405ab0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:57.410083 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f668ea7-046b-4458-9c9e-5bbf7405ab0e service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:57.410366 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f668ea7-046b-4458-9c9e-5bbf7405ab0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:57.410636 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f668ea7-046b-4458-9c9e-5bbf7405ab0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:57.412354 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8f668ea7-046b-4458-9c9e-5bbf7405ab0e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:57.476949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1046/2082] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:25:57.481489 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f668ea7-046b-4458-9c9e-5bbf7405ab0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:57.483004 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f668ea7-046b-4458-9c9e-5bbf7405ab0e service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:57.485629 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63c8aa-9ee2-4463-bd5c-896cacb9b978 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:57.486057 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63c8aa-9ee2-4463-bd5c-896cacb9b978 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:57.486436 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec63c8aa-9ee2-4463-bd5c-896cacb9b978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:57.496908 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1037/2083] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:57.512285 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-ec63c8aa-9ee2-4463-bd5c-896cacb9b978 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:57.513807 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ec63c8aa-9ee2-4463-bd5c-896cacb9b978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:57.525396 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1047/2084] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:25:57.529455 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f668ea7-046b-4458-9c9e-5bbf7405ab0e service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:57.546732 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f668ea7-046b-4458-9c9e-5bbf7405ab0e service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:57.554087 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236c928-e028-4af0-9628-aa9b7cc8e696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:57.555067 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236c928-e028-4af0-9628-aa9b7cc8e696 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:57.555420 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236c928-e028-4af0-9628-aa9b7cc8e696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:57.555971 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236c928-e028-4af0-9628-aa9b7cc8e696 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:57.556474 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236c928-e028-4af0-9628-aa9b7cc8e696 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:25:57.556781 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236c928-e028-4af0-9628-aa9b7cc8e696 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:57.559173 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236c928-e028-4af0-9628-aa9b7cc8e696 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:57.573736 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1038/2085] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:25:57.584038 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63c8aa-9ee2-4463-bd5c-896cacb9b978 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:57.600333 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec63c8aa-9ee2-4463-bd5c-896cacb9b978 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:57.607077 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5ed11-ff74-44f5-be95-efcdf1de49af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:57.607640 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5ed11-ff74-44f5-be95-efcdf1de49af admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:57.607923 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5ed11-ff74-44f5-be95-efcdf1de49af admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:57.608237 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5ed11-ff74-44f5-be95-efcdf1de49af admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:57.608919 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5ed11-ff74-44f5-be95-efcdf1de49af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:57.612068 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5ed11-ff74-44f5-be95-efcdf1de49af admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:57.646722 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1048/2086] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:25:57 2022] POST /identity/v3/projects => generated 369 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:57.651444 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236c928-e028-4af0-9628-aa9b7cc8e696 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:57.667238 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236c928-e028-4af0-9628-aa9b7cc8e696 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:57.768861 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d857e5-7acc-4c00-9316-7a53992458e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:57.769607 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d857e5-7acc-4c00-9316-7a53992458e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:57.769991 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d857e5-7acc-4c00-9316-7a53992458e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:57.771016 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d857e5-7acc-4c00-9316-7a53992458e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:57.772055 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d857e5-7acc-4c00-9316-7a53992458e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:57.774546 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d857e5-7acc-4c00-9316-7a53992458e2 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:57.808018 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1039/2087] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:25:57 2022] POST /identity/v3/users => generated 285 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:25:57.811813 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5ed11-ff74-44f5-be95-efcdf1de49af admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:57.827612 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5ed11-ff74-44f5-be95-efcdf1de49af admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:57.834442 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac037e-3e4c-431f-9599-94b7ab9286e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:57.835238 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac037e-3e4c-431f-9599-94b7ab9286e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:57.835482 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac037e-3e4c-431f-9599-94b7ab9286e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:57.835767 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ac037e-3e4c-431f-9599-94b7ab9286e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:57.836674 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac037e-3e4c-431f-9599-94b7ab9286e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:57.838844 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ac037e-3e4c-431f-9599-94b7ab9286e1 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:57.860121 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1049/2088] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:57.861911 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d857e5-7acc-4c00-9316-7a53992458e2 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:57.887970 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d857e5-7acc-4c00-9316-7a53992458e2 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:57.897972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e124d1-6a40-43ff-bafb-f215b8847314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:57.898516 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e124d1-6a40-43ff-bafb-f215b8847314 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:57.899658 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e124d1-6a40-43ff-bafb-f215b8847314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:57.899964 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e124d1-6a40-43ff-bafb-f215b8847314 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:57.901454 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e124d1-6a40-43ff-bafb-f215b8847314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:57.905340 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e124d1-6a40-43ff-bafb-f215b8847314 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:57.923416 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1040/2089] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:25:57.928099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac037e-3e4c-431f-9599-94b7ab9286e1 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:57.941384 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ac037e-3e4c-431f-9599-94b7ab9286e1 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:57.952435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2eaa6-39fe-475f-b828-fe26f6da6e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:57.953291 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2eaa6-39fe-475f-b828-fe26f6da6e3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:57.953645 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2eaa6-39fe-475f-b828-fe26f6da6e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:57.954179 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2eaa6-39fe-475f-b828-fe26f6da6e3e admin admin] PATH_INFO: `/v3/projects/7451ad1cfa534cdbb55268b2b03eb981/users/d21c3dd9f4044b4fab06a9af3b2af3a1/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:57.973113 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d2eaa6-39fe-475f-b828-fe26f6da6e3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7451ad1cfa534cdbb55268b2b03eb981, user_id=d21c3dd9f4044b4fab06a9af3b2af3a1, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:57.976133 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d2eaa6-39fe-475f-b828-fe26f6da6e3e admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:57.996521 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1050/2090] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:25:57 2022] PUT /identity/v3/projects/7451ad1cfa534cdbb55268b2b03eb981/users/d21c3dd9f4044b4fab06a9af3b2af3a1/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:25:58.008708 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e38dc4-a561-4af7-a6d4-eb651b8dc181 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:58.008708 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e38dc4-a561-4af7-a6d4-eb651b8dc181 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:58.009070 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e38dc4-a561-4af7-a6d4-eb651b8dc181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:58.035064 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:58.055847 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-21e38dc4-a561-4af7-a6d4-eb651b8dc181 None None] MFA Rules not processed for user `d21c3dd9f4044b4fab06a9af3b2af3a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:58.059049 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-21e38dc4-a561-4af7-a6d4-eb651b8dc181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:58.179626 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1041/2091] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:58.194769 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2eaa6-39fe-475f-b828-fe26f6da6e3e admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:58.196902 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d6d2eaa6-39fe-475f-b828-fe26f6da6e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:58.303718 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2eaa6-39fe-475f-b828-fe26f6da6e3e admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:58.307488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771da88-df56-4460-8eca-5c8bed0df712 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f71721ca75a461d92044091564de424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:58.308135 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771da88-df56-4460-8eca-5c8bed0df712 service glance] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:58.308602 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771da88-df56-4460-8eca-5c8bed0df712 service glance] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:58.308996 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771da88-df56-4460-8eca-5c8bed0df712 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:58.326216 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771da88-df56-4460-8eca-5c8bed0df712 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:58.328301 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771da88-df56-4460-8eca-5c8bed0df712 service glance] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:58.335406 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:58.344564 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e38dc4-a561-4af7-a6d4-eb651b8dc181 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:58.345703 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1051/2092] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:58 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:58.346104 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-21e38dc4-a561-4af7-a6d4-eb651b8dc181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:58.431594 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e38dc4-a561-4af7-a6d4-eb651b8dc181 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:58.436128 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a4fc07-a8ac-4b0e-b136-d73d44a39598 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:58.436964 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4fc07-a8ac-4b0e-b136-d73d44a39598 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:58.437102 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4fc07-a8ac-4b0e-b136-d73d44a39598 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:58.437374 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a4fc07-a8ac-4b0e-b136-d73d44a39598 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:58.439305 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e8a4fc07-a8ac-4b0e-b136-d73d44a39598 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:58.506089 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4fc07-a8ac-4b0e-b136-d73d44a39598 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:58.507637 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a4fc07-a8ac-4b0e-b136-d73d44a39598 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:58.517616 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1042/2093] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 15:25:58.982921 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771da88-df56-4460-8eca-5c8bed0df712 service glance] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:58.984527 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b771da88-df56-4460-8eca-5c8bed0df712 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:59.056265 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771da88-df56-4460-8eca-5c8bed0df712 service glance] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:59.062099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1de0f7-5383-4e24-b804-f4a621e3fdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:59.062814 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1de0f7-5383-4e24-b804-f4a621e3fdd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:59.063183 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1de0f7-5383-4e24-b804-f4a621e3fdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:59.063580 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1de0f7-5383-4e24-b804-f4a621e3fdd0 admin admin] PATH_INFO: `/v3/users/6f6a34eacf784b85bad2ecb39e6fc8cb` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:59.064819 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1de0f7-5383-4e24-b804-f4a621e3fdd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f6a34eacf784b85bad2ecb39e6fc8cb)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:59.066863 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1de0f7-5383-4e24-b804-f4a621e3fdd0 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:59.112694 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-cd1de0f7-5383-4e24-b804-f4a621e3fdd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f6a34eacf784b85bad2ecb39e6fc8cb'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:59.113333 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-cd1de0f7-5383-4e24-b804-f4a621e3fdd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f6a34eacf784b85bad2ecb39e6fc8cb'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:59.122305 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-cd1de0f7-5383-4e24-b804-f4a621e3fdd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f6a34eacf784b85bad2ecb39e6fc8cb'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:59.135028 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-cd1de0f7-5383-4e24-b804-f4a621e3fdd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f6a34eacf784b85bad2ecb39e6fc8cb'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:59.164698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-cd1de0f7-5383-4e24-b804-f4a621e3fdd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f6a34eacf784b85bad2ecb39e6fc8cb'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:59.172638 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1052/2094] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:25:58 2022] DELETE /identity/v3/users/6f6a34eacf784b85bad2ecb39e6fc8cb => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:59.181639 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f21d1-3a6c-472f-849f-2d263d594e7c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:59.181639 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f21d1-3a6c-472f-849f-2d263d594e7c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:59.181639 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382f21d1-3a6c-472f-849f-2d263d594e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:59.202953 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-382f21d1-3a6c-472f-849f-2d263d594e7c None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:25:59.204504 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-382f21d1-3a6c-472f-849f-2d263d594e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:59.256808 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:25:59.278863 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1043/2095] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:25:59.290031 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1de0f7-5383-4e24-b804-f4a621e3fdd0 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:59.293068 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-cd1de0f7-5383-4e24-b804-f4a621e3fdd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:59.368940 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1de0f7-5383-4e24-b804-f4a621e3fdd0 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:59.374131 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04294b-04a3-4961-9f3a-e2bb44b658e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:59.374836 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04294b-04a3-4961-9f3a-e2bb44b658e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:59.375114 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04294b-04a3-4961-9f3a-e2bb44b658e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:59.375385 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04294b-04a3-4961-9f3a-e2bb44b658e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:59.384894 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04294b-04a3-4961-9f3a-e2bb44b658e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:59.386579 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04294b-04a3-4961-9f3a-e2bb44b658e7 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:59.396147 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1053/2096] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:25:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:25:59.712723 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f21d1-3a6c-472f-849f-2d263d594e7c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:59.718250 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-382f21d1-3a6c-472f-849f-2d263d594e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:25:59.755646 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382f21d1-3a6c-472f-849f-2d263d594e7c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:59.772653 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18cf1e-9acc-410c-a916-65bca0d15042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:25:59.774071 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18cf1e-9acc-410c-a916-65bca0d15042 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:25:59.774538 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18cf1e-9acc-410c-a916-65bca0d15042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:25:59.775024 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf18cf1e-9acc-410c-a916-65bca0d15042 admin admin] PATH_INFO: `/v3/projects/e777d8f842a74d87a05be7f492339a55` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:25:59.777202 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18cf1e-9acc-410c-a916-65bca0d15042 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e777d8f842a74d87a05be7f492339a55)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:25:59.779643 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf18cf1e-9acc-410c-a916-65bca0d15042 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:25:59.847045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-bf18cf1e-9acc-410c-a916-65bca0d15042 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e777d8f842a74d87a05be7f492339a55', 'request_id': 'req-bf18cf1e-9acc-410c-a916-65bca0d15042'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:59.855371 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-bf18cf1e-9acc-410c-a916-65bca0d15042 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e777d8f842a74d87a05be7f492339a55', 'request_id': 'req-bf18cf1e-9acc-410c-a916-65bca0d15042'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:59.862477 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-bf18cf1e-9acc-410c-a916-65bca0d15042 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e777d8f842a74d87a05be7f492339a55', 'request_id': 'req-bf18cf1e-9acc-410c-a916-65bca0d15042'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:59.888425 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-bf18cf1e-9acc-410c-a916-65bca0d15042 admin admin] The token cache is being invalidate because project e777d8f842a74d87a05be7f492339a55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:25:59.888718 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-bf18cf1e-9acc-410c-a916-65bca0d15042 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:59.889427 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-bf18cf1e-9acc-410c-a916-65bca0d15042 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:25:59.905445 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1044/2097] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:25:59 2022] DELETE /identity/v3/projects/e777d8f842a74d87a05be7f492339a55 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:25:59.909684 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04294b-04a3-4961-9f3a-e2bb44b658e7 service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:25:59.936936 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04294b-04a3-4961-9f3a-e2bb44b658e7 service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:25:59.976833 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:00.087004 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1af0c0-950d-4b3f-8b02-11422d6b6679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:00.087963 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1af0c0-950d-4b3f-8b02-11422d6b6679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:00.088488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1af0c0-950d-4b3f-8b02-11422d6b6679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:00.088989 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1af0c0-950d-4b3f-8b02-11422d6b6679 admin admin] PATH_INFO: `/v3/users/9fc8dc1b803540719d4e3f910b05e7ba` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:00.091016 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1af0c0-950d-4b3f-8b02-11422d6b6679 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fc8dc1b803540719d4e3f910b05e7ba)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:00.093198 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1af0c0-950d-4b3f-8b02-11422d6b6679 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:00.222643 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-0c1af0c0-950d-4b3f-8b02-11422d6b6679 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fc8dc1b803540719d4e3f910b05e7ba'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:00.223519 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-0c1af0c0-950d-4b3f-8b02-11422d6b6679 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fc8dc1b803540719d4e3f910b05e7ba'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:00.232031 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-0c1af0c0-950d-4b3f-8b02-11422d6b6679 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fc8dc1b803540719d4e3f910b05e7ba'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:00.240213 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-0c1af0c0-950d-4b3f-8b02-11422d6b6679 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fc8dc1b803540719d4e3f910b05e7ba'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:00.253179 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-0c1af0c0-950d-4b3f-8b02-11422d6b6679 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fc8dc1b803540719d4e3f910b05e7ba'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:00.261448 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1054/2098] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:25:59 2022] DELETE /identity/v3/users/9fc8dc1b803540719d4e3f910b05e7ba => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:00.566739 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18cf1e-9acc-410c-a916-65bca0d15042 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:00.568222 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bf18cf1e-9acc-410c-a916-65bca0d15042 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:00.597436 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf18cf1e-9acc-410c-a916-65bca0d15042 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:00.659235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060c3982-4c56-4545-b9cb-c0e4b379d3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:00.659867 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c3982-4c56-4545-b9cb-c0e4b379d3fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:00.660183 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c3982-4c56-4545-b9cb-c0e4b379d3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:00.660459 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060c3982-4c56-4545-b9cb-c0e4b379d3fb admin admin] PATH_INFO: `/v3/projects/9108ef15d65947cca73e6f7f9ee3be71` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:00.661668 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c3982-4c56-4545-b9cb-c0e4b379d3fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9108ef15d65947cca73e6f7f9ee3be71)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:00.663583 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060c3982-4c56-4545-b9cb-c0e4b379d3fb admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:00.716292 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-060c3982-4c56-4545-b9cb-c0e4b379d3fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9108ef15d65947cca73e6f7f9ee3be71', 'request_id': 'req-060c3982-4c56-4545-b9cb-c0e4b379d3fb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:00.724040 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-060c3982-4c56-4545-b9cb-c0e4b379d3fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9108ef15d65947cca73e6f7f9ee3be71', 'request_id': 'req-060c3982-4c56-4545-b9cb-c0e4b379d3fb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:00.731601 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-060c3982-4c56-4545-b9cb-c0e4b379d3fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9108ef15d65947cca73e6f7f9ee3be71', 'request_id': 'req-060c3982-4c56-4545-b9cb-c0e4b379d3fb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:00.740733 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:00.745488 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-060c3982-4c56-4545-b9cb-c0e4b379d3fb admin admin] The token cache is being invalidate because project 9108ef15d65947cca73e6f7f9ee3be71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:26:00.746485 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-060c3982-4c56-4545-b9cb-c0e4b379d3fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:00.747697 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-060c3982-4c56-4545-b9cb-c0e4b379d3fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:00.749741 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1045/2099] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:26:00 2022] DELETE /identity/v3/projects/9108ef15d65947cca73e6f7f9ee3be71 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:00.754603 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d86bc-10fe-4ffc-b04f-f240980fcd67 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:00.755120 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d86bc-10fe-4ffc-b04f-f240980fcd67 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:00.755199 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472d86bc-10fe-4ffc-b04f-f240980fcd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:00.776760 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-472d86bc-10fe-4ffc-b04f-f240980fcd67 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:00.777973 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-472d86bc-10fe-4ffc-b04f-f240980fcd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:00.876035 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1055/2100] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:00.883564 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acfd2a-3903-4ccf-9759-5fb35799a647 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:00.883855 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acfd2a-3903-4ccf-9759-5fb35799a647 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:00.884179 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acfd2a-3903-4ccf-9759-5fb35799a647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:00.905772 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-87acfd2a-3903-4ccf-9759-5fb35799a647 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:00.906996 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-87acfd2a-3903-4ccf-9759-5fb35799a647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:00.923006 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1046/2101] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:00.927831 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d86bc-10fe-4ffc-b04f-f240980fcd67 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:00.945996 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472d86bc-10fe-4ffc-b04f-f240980fcd67 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:00.966755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f61fc-54c4-4e1d-9a7c-0b02847ac584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:00.967413 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f61fc-54c4-4e1d-9a7c-0b02847ac584 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:00.967703 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f61fc-54c4-4e1d-9a7c-0b02847ac584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:00.970672 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f61fc-54c4-4e1d-9a7c-0b02847ac584 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:00.975873 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f61fc-54c4-4e1d-9a7c-0b02847ac584 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:26:00.976223 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f61fc-54c4-4e1d-9a7c-0b02847ac584 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:00.977881 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f61fc-54c4-4e1d-9a7c-0b02847ac584 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:01.025388 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1056/2102] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:26:01.026826 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87acfd2a-3903-4ccf-9759-5fb35799a647 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:01.037823 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87acfd2a-3903-4ccf-9759-5fb35799a647 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:01.047714 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855dd7b-8b63-48f7-bca0-486e7efc7792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:01.048889 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855dd7b-8b63-48f7-bca0-486e7efc7792 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:01.050363 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855dd7b-8b63-48f7-bca0-486e7efc7792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:01.050797 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1855dd7b-8b63-48f7-bca0-486e7efc7792 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:01.052605 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1855dd7b-8b63-48f7-bca0-486e7efc7792 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:01.055624 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1855dd7b-8b63-48f7-bca0-486e7efc7792 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:01.103070 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1047/2103] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:26:01 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:26:01.107561 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f61fc-54c4-4e1d-9a7c-0b02847ac584 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:01.118327 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f61fc-54c4-4e1d-9a7c-0b02847ac584 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:01.156915 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:01.214390 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348db0a2-313a-4409-8196-0109b40296d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:01.215373 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348db0a2-313a-4409-8196-0109b40296d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:01.215969 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348db0a2-313a-4409-8196-0109b40296d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:01.216383 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348db0a2-313a-4409-8196-0109b40296d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:01.217209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348db0a2-313a-4409-8196-0109b40296d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:01.220395 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348db0a2-313a-4409-8196-0109b40296d9 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:01.263489 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1057/2104] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:26:01 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:26:01.267430 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855dd7b-8b63-48f7-bca0-486e7efc7792 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:01.282465 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1855dd7b-8b63-48f7-bca0-486e7efc7792 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:01.314808 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08289f-3bf2-4967-bc44-e2996eeee98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:01.315453 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08289f-3bf2-4967-bc44-e2996eeee98b admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:01.315740 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08289f-3bf2-4967-bc44-e2996eeee98b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:01.316058 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc08289f-3bf2-4967-bc44-e2996eeee98b admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:01.317724 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08289f-3bf2-4967-bc44-e2996eeee98b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:01.319569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc08289f-3bf2-4967-bc44-e2996eeee98b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:01.339150 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1048/2105] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:26:01.340426 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348db0a2-313a-4409-8196-0109b40296d9 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:01.359451 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348db0a2-313a-4409-8196-0109b40296d9 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:01.370448 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ef653b-b738-4f0f-925a-dc980f8e2a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:01.372405 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef653b-b738-4f0f-925a-dc980f8e2a75 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:01.372942 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef653b-b738-4f0f-925a-dc980f8e2a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:01.373411 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef653b-b738-4f0f-925a-dc980f8e2a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:01.374561 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef653b-b738-4f0f-925a-dc980f8e2a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:01.377568 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ef653b-b738-4f0f-925a-dc980f8e2a75 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:01.398407 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1058/2106] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:26:01.402921 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08289f-3bf2-4967-bc44-e2996eeee98b admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:01.420220 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc08289f-3bf2-4967-bc44-e2996eeee98b admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:01.443240 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a19042-3cf4-48dd-ab97-b197aa2fb4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:01.444476 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a19042-3cf4-48dd-ab97-b197aa2fb4dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:01.445606 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a19042-3cf4-48dd-ab97-b197aa2fb4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:01.445902 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a19042-3cf4-48dd-ab97-b197aa2fb4dc admin admin] PATH_INFO: `/v3/projects/9f8cd0b5f91a4f92bf9727fa95144243/users/ae589700dc83490ba35db884a3041e92/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:01.486408 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a19042-3cf4-48dd-ab97-b197aa2fb4dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f8cd0b5f91a4f92bf9727fa95144243, user_id=ae589700dc83490ba35db884a3041e92, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:01.489600 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a19042-3cf4-48dd-ab97-b197aa2fb4dc admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:01.527085 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1049/2107] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:26:01 2022] PUT /identity/v3/projects/9f8cd0b5f91a4f92bf9727fa95144243/users/ae589700dc83490ba35db884a3041e92/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:01.529041 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787be8d-fa32-4af0-b3e9-944918864468 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:01.529341 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787be8d-fa32-4af0-b3e9-944918864468 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:01.529625 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787be8d-fa32-4af0-b3e9-944918864468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:01.599309 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-4787be8d-fa32-4af0-b3e9-944918864468 None None] MFA Rules not processed for user `ae589700dc83490ba35db884a3041e92`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:01.600757 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-4787be8d-fa32-4af0-b3e9-944918864468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:01.683304 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1059/2108] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:01.687709 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a19042-3cf4-48dd-ab97-b197aa2fb4dc admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:01.764863 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a19042-3cf4-48dd-ab97-b197aa2fb4dc admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:01.770455 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06113c-57f4-44d1-8203-08fa045bbb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:01.771225 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06113c-57f4-44d1-8203-08fa045bbb57 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:01.771515 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06113c-57f4-44d1-8203-08fa045bbb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:01.771791 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de06113c-57f4-44d1-8203-08fa045bbb57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:01.772554 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06113c-57f4-44d1-8203-08fa045bbb57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:01.774583 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de06113c-57f4-44d1-8203-08fa045bbb57 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:01.809757 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1050/2109] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:26:01 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:26:01.813826 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787be8d-fa32-4af0-b3e9-944918864468 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:01.827577 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787be8d-fa32-4af0-b3e9-944918864468 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:01.886219 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d46baa-bcf6-4ecc-bc60-5de21d86faab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:01.886833 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d46baa-bcf6-4ecc-bc60-5de21d86faab admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:01.887111 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d46baa-bcf6-4ecc-bc60-5de21d86faab admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:01.887386 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d46baa-bcf6-4ecc-bc60-5de21d86faab admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:01.888115 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d46baa-bcf6-4ecc-bc60-5de21d86faab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:01.890021 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d46baa-bcf6-4ecc-bc60-5de21d86faab admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:01.912156 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1060/2110] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:26:01 2022] POST /identity/v3/users => generated 300 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:26:01.917473 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06113c-57f4-44d1-8203-08fa045bbb57 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:01.928526 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de06113c-57f4-44d1-8203-08fa045bbb57 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:01.933226 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb32b09-35eb-4411-a608-e539f1f057ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:01.933844 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb32b09-35eb-4411-a608-e539f1f057ce admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:01.934130 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb32b09-35eb-4411-a608-e539f1f057ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:01.934406 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb32b09-35eb-4411-a608-e539f1f057ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:01.935098 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb32b09-35eb-4411-a608-e539f1f057ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:01.936726 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb32b09-35eb-4411-a608-e539f1f057ce admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:01.948031 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1051/2111] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:26:01.951822 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d46baa-bcf6-4ecc-bc60-5de21d86faab admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:01.961864 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d46baa-bcf6-4ecc-bc60-5de21d86faab admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:01.968249 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89742cc-de2f-4d20-88d1-22a42e499e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:01.968953 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89742cc-de2f-4d20-88d1-22a42e499e36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:01.969239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89742cc-de2f-4d20-88d1-22a42e499e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:01.969526 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89742cc-de2f-4d20-88d1-22a42e499e36 admin admin] PATH_INFO: `/v3/projects/38abb86b4ab747539e6c735eaca002b0/users/61b46d21245f4ff49194247dd820bb00/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:01.985353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89742cc-de2f-4d20-88d1-22a42e499e36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38abb86b4ab747539e6c735eaca002b0, user_id=61b46d21245f4ff49194247dd820bb00, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:01.988096 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89742cc-de2f-4d20-88d1-22a42e499e36 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:02.001259 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1061/2112] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:26:01 2022] PUT /identity/v3/projects/38abb86b4ab747539e6c735eaca002b0/users/61b46d21245f4ff49194247dd820bb00/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:02.006869 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb32b09-35eb-4411-a608-e539f1f057ce admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:02.020041 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb32b09-35eb-4411-a608-e539f1f057ce admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:02.089390 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7988c656-a614-4a07-bab9-521a0c666e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:02.090179 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988c656-a614-4a07-bab9-521a0c666e3b admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:02.090472 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988c656-a614-4a07-bab9-521a0c666e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:02.090750 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7988c656-a614-4a07-bab9-521a0c666e3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:02.091457 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7988c656-a614-4a07-bab9-521a0c666e3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:02.093113 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7988c656-a614-4a07-bab9-521a0c666e3b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:02.105787 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1052/2113] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:26:02.110234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89742cc-de2f-4d20-88d1-22a42e499e36 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:02.116689 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:02.123062 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89742cc-de2f-4d20-88d1-22a42e499e36 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:02.130578 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abee333-6f8c-40db-a6a2-b54b9d5ec91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:02.131394 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abee333-6f8c-40db-a6a2-b54b9d5ec91a admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:02.131778 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abee333-6f8c-40db-a6a2-b54b9d5ec91a admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:02.132158 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abee333-6f8c-40db-a6a2-b54b9d5ec91a admin admin] PATH_INFO: `/v3/projects/38abb86b4ab747539e6c735eaca002b0/users/61b46d21245f4ff49194247dd820bb00/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:02.134287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abee333-6f8c-40db-a6a2-b54b9d5ec91a admin admin] RBAC: Authorizing `identity:create_grant(project_id=38abb86b4ab747539e6c735eaca002b0, user_id=61b46d21245f4ff49194247dd820bb00, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:02.138397 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abee333-6f8c-40db-a6a2-b54b9d5ec91a admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:02.151982 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1062/2114] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:26:02 2022] PUT /identity/v3/projects/38abb86b4ab747539e6c735eaca002b0/users/61b46d21245f4ff49194247dd820bb00/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:02.163585 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90f183-f6e5-43cf-9357-d5a17a3a3dbf None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:02.163902 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90f183-f6e5-43cf-9357-d5a17a3a3dbf None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:02.164278 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df90f183-f6e5-43cf-9357-d5a17a3a3dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:02.178976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:02.195673 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-df90f183-f6e5-43cf-9357-d5a17a3a3dbf None None] MFA Rules not processed for user `61b46d21245f4ff49194247dd820bb00`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:02.197079 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-df90f183-f6e5-43cf-9357-d5a17a3a3dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:02.277865 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1053/2115] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:02.289298 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abee333-6f8c-40db-a6a2-b54b9d5ec91a admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:02.291041 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-1abee333-6f8c-40db-a6a2-b54b9d5ec91a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:02.382085 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abee333-6f8c-40db-a6a2-b54b9d5ec91a admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:02.388029 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fbd1bf-b2e4-418d-8d20-b61e8fbb01eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:02.388658 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbd1bf-b2e4-418d-8d20-b61e8fbb01eb service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:02.388939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbd1bf-b2e4-418d-8d20-b61e8fbb01eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:02.389212 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fbd1bf-b2e4-418d-8d20-b61e8fbb01eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:02.401222 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fbd1bf-b2e4-418d-8d20-b61e8fbb01eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:02.403213 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fbd1bf-b2e4-418d-8d20-b61e8fbb01eb service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:02.428661 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1063/2116] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:26:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:26:02.508440 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90f183-f6e5-43cf-9357-d5a17a3a3dbf None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:02.616865 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df90f183-f6e5-43cf-9357-d5a17a3a3dbf None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:02.629745 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94399645-f329-41eb-afd3-7d698ad8d822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:02.630504 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94399645-f329-41eb-afd3-7d698ad8d822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:02.630715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94399645-f329-41eb-afd3-7d698ad8d822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:02.631156 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94399645-f329-41eb-afd3-7d698ad8d822 admin admin] PATH_INFO: `/v3/users/ae589700dc83490ba35db884a3041e92` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:02.632714 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94399645-f329-41eb-afd3-7d698ad8d822 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae589700dc83490ba35db884a3041e92)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:02.635361 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94399645-f329-41eb-afd3-7d698ad8d822 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:02.718047 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-94399645-f329-41eb-afd3-7d698ad8d822 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae589700dc83490ba35db884a3041e92'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:02.718749 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-94399645-f329-41eb-afd3-7d698ad8d822 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae589700dc83490ba35db884a3041e92'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:02.726047 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-94399645-f329-41eb-afd3-7d698ad8d822 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae589700dc83490ba35db884a3041e92'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:02.726720 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-94399645-f329-41eb-afd3-7d698ad8d822 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae589700dc83490ba35db884a3041e92'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:02.740476 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-94399645-f329-41eb-afd3-7d698ad8d822 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae589700dc83490ba35db884a3041e92'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:02.760371 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1054/2117] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:26:02 2022] DELETE /identity/v3/users/ae589700dc83490ba35db884a3041e92 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:02.765299 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f6fd0-0586-4068-a40d-a651a76f1bb9 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:02.765609 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f6fd0-0586-4068-a40d-a651a76f1bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:02.765886 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f6fd0-0586-4068-a40d-a651a76f1bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:02.786053 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-5a2f6fd0-0586-4068-a40d-a651a76f1bb9 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:02.787310 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5a2f6fd0-0586-4068-a40d-a651a76f1bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:02.895982 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1064/2118] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:26:02.897898 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94399645-f329-41eb-afd3-7d698ad8d822 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:02.899892 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-94399645-f329-41eb-afd3-7d698ad8d822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:02.906426 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f6fd0-0586-4068-a40d-a651a76f1bb9 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:02.907838 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5a2f6fd0-0586-4068-a40d-a651a76f1bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:02.921005 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94399645-f329-41eb-afd3-7d698ad8d822 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:02.926320 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc97a3-c32e-4eb6-b680-cf38bda5bf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:02.926990 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc97a3-c32e-4eb6-b680-cf38bda5bf66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:02.927271 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc97a3-c32e-4eb6-b680-cf38bda5bf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:02.927547 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc97a3-c32e-4eb6-b680-cf38bda5bf66 admin admin] PATH_INFO: `/v3/users/36a5d6a0bc374dc598096f30e3cd17ef` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:02.928740 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc97a3-c32e-4eb6-b680-cf38bda5bf66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36a5d6a0bc374dc598096f30e3cd17ef)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:02.930701 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc97a3-c32e-4eb6-b680-cf38bda5bf66 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:02.936825 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:02.969474 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f6fd0-0586-4068-a40d-a651a76f1bb9 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:02.973260 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6ce4b3-f3d1-4350-bfe1-2586c1ba8383 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:02.973884 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ce4b3-f3d1-4350-bfe1-2586c1ba8383 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:02.974169 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ce4b3-f3d1-4350-bfe1-2586c1ba8383 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:02.974447 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6ce4b3-f3d1-4350-bfe1-2586c1ba8383 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:02.980486 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-23fc97a3-c32e-4eb6-b680-cf38bda5bf66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36a5d6a0bc374dc598096f30e3cd17ef'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:02.981323 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-23fc97a3-c32e-4eb6-b680-cf38bda5bf66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36a5d6a0bc374dc598096f30e3cd17ef'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:02.984676 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ce4b3-f3d1-4350-bfe1-2586c1ba8383 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:02.986118 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6ce4b3-f3d1-4350-bfe1-2586c1ba8383 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:02.989202 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-23fc97a3-c32e-4eb6-b680-cf38bda5bf66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36a5d6a0bc374dc598096f30e3cd17ef'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:02.989883 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-23fc97a3-c32e-4eb6-b680-cf38bda5bf66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36a5d6a0bc374dc598096f30e3cd17ef'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:02.997807 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1065/2119] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:26:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:26:03.009655 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-23fc97a3-c32e-4eb6-b680-cf38bda5bf66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36a5d6a0bc374dc598096f30e3cd17ef'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:03.026111 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1055/2120] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:26:02 2022] DELETE /identity/v3/users/36a5d6a0bc374dc598096f30e3cd17ef => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:26:03.030622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9002454-ba88-4fd2-a8d5-841d7feeee78 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:03.031012 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9002454-ba88-4fd2-a8d5-841d7feeee78 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:03.031451 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9002454-ba88-4fd2-a8d5-841d7feeee78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:03.053057 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-e9002454-ba88-4fd2-a8d5-841d7feeee78 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:03.054255 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e9002454-ba88-4fd2-a8d5-841d7feeee78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:03.091009 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:03.122986 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1066/2121] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:03.132423 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc97a3-c32e-4eb6-b680-cf38bda5bf66 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:03.133870 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-23fc97a3-c32e-4eb6-b680-cf38bda5bf66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:03.201265 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc97a3-c32e-4eb6-b680-cf38bda5bf66 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:03.204946 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25cafe-bdbe-4d03-944c-f31509659d5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:03.205565 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25cafe-bdbe-4d03-944c-f31509659d5b service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:03.205851 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25cafe-bdbe-4d03-944c-f31509659d5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:03.206255 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25cafe-bdbe-4d03-944c-f31509659d5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:03.224070 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25cafe-bdbe-4d03-944c-f31509659d5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:03.225503 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25cafe-bdbe-4d03-944c-f31509659d5b service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:03.235951 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1056/2122] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:26:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:26:03.335216 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9002454-ba88-4fd2-a8d5-841d7feeee78 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:03.336735 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e9002454-ba88-4fd2-a8d5-841d7feeee78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:03.354765 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9002454-ba88-4fd2-a8d5-841d7feeee78 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:03.362362 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc1568-1031-4b8b-9ad6-b87f09071e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:03.363039 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc1568-1031-4b8b-9ad6-b87f09071e8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:03.363319 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc1568-1031-4b8b-9ad6-b87f09071e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:03.363592 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bc1568-1031-4b8b-9ad6-b87f09071e8a admin admin] PATH_INFO: `/v3/projects/9f8cd0b5f91a4f92bf9727fa95144243` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:03.370504 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bc1568-1031-4b8b-9ad6-b87f09071e8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f8cd0b5f91a4f92bf9727fa95144243)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:03.373629 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bc1568-1031-4b8b-9ad6-b87f09071e8a admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:03.431355 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b6bc1568-1031-4b8b-9ad6-b87f09071e8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f8cd0b5f91a4f92bf9727fa95144243', 'request_id': 'req-b6bc1568-1031-4b8b-9ad6-b87f09071e8a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:03.441756 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b6bc1568-1031-4b8b-9ad6-b87f09071e8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f8cd0b5f91a4f92bf9727fa95144243', 'request_id': 'req-b6bc1568-1031-4b8b-9ad6-b87f09071e8a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:03.447912 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b6bc1568-1031-4b8b-9ad6-b87f09071e8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f8cd0b5f91a4f92bf9727fa95144243', 'request_id': 'req-b6bc1568-1031-4b8b-9ad6-b87f09071e8a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:03.464242 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b6bc1568-1031-4b8b-9ad6-b87f09071e8a admin admin] The token cache is being invalidate because project 9f8cd0b5f91a4f92bf9727fa95144243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:26:03.464532 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b6bc1568-1031-4b8b-9ad6-b87f09071e8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:03.465181 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b6bc1568-1031-4b8b-9ad6-b87f09071e8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:03.466892 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1067/2123] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:26:03 2022] DELETE /identity/v3/projects/9f8cd0b5f91a4f92bf9727fa95144243 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:03.470868 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25cafe-bdbe-4d03-944c-f31509659d5b service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:03.482003 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25cafe-bdbe-4d03-944c-f31509659d5b service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:03.540952 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07467300-6368-4df9-bd84-f7d035bdede6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:03.542568 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07467300-6368-4df9-bd84-f7d035bdede6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:03.542854 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07467300-6368-4df9-bd84-f7d035bdede6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:03.543153 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07467300-6368-4df9-bd84-f7d035bdede6 admin admin] PATH_INFO: `/v3/users/61b46d21245f4ff49194247dd820bb00` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:03.544364 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07467300-6368-4df9-bd84-f7d035bdede6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61b46d21245f4ff49194247dd820bb00)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:03.546519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07467300-6368-4df9-bd84-f7d035bdede6 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:03.575439 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc1568-1031-4b8b-9ad6-b87f09071e8a admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:03.582321 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b6bc1568-1031-4b8b-9ad6-b87f09071e8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:03.595486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bc1568-1031-4b8b-9ad6-b87f09071e8a admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:03.600768 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b4523-f245-41ac-b958-63046c44f0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:03.601932 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b4523-f245-41ac-b958-63046c44f0c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:03.601932 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b4523-f245-41ac-b958-63046c44f0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:03.602135 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:03.602216 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b4523-f245-41ac-b958-63046c44f0c4 admin admin] PATH_INFO: `/v3/projects/d0d84f5be7fd4b499171b6b34a1203f1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:03.604310 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b4523-f245-41ac-b958-63046c44f0c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0d84f5be7fd4b499171b6b34a1203f1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:03.606512 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b4523-f245-41ac-b958-63046c44f0c4 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:03.626245 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-07467300-6368-4df9-bd84-f7d035bdede6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61b46d21245f4ff49194247dd820bb00'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:03.626915 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-07467300-6368-4df9-bd84-f7d035bdede6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61b46d21245f4ff49194247dd820bb00'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:03.634056 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-07467300-6368-4df9-bd84-f7d035bdede6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61b46d21245f4ff49194247dd820bb00'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:03.635207 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-07467300-6368-4df9-bd84-f7d035bdede6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61b46d21245f4ff49194247dd820bb00'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:03.647902 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-07467300-6368-4df9-bd84-f7d035bdede6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61b46d21245f4ff49194247dd820bb00'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:03.665545 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1057/2124] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:26:03 2022] DELETE /identity/v3/users/61b46d21245f4ff49194247dd820bb00 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:03.665685 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4f5b4523-f245-41ac-b958-63046c44f0c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0d84f5be7fd4b499171b6b34a1203f1', 'request_id': 'req-4f5b4523-f245-41ac-b958-63046c44f0c4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:03.681813 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4f5b4523-f245-41ac-b958-63046c44f0c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0d84f5be7fd4b499171b6b34a1203f1', 'request_id': 'req-4f5b4523-f245-41ac-b958-63046c44f0c4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:03.690316 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4f5b4523-f245-41ac-b958-63046c44f0c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0d84f5be7fd4b499171b6b34a1203f1', 'request_id': 'req-4f5b4523-f245-41ac-b958-63046c44f0c4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:03.706561 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4f5b4523-f245-41ac-b958-63046c44f0c4 admin admin] The token cache is being invalidate because project d0d84f5be7fd4b499171b6b34a1203f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:26:03.706807 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4f5b4523-f245-41ac-b958-63046c44f0c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:03.707796 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4f5b4523-f245-41ac-b958-63046c44f0c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:03.711397 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1068/2125] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:26:03 2022] DELETE /identity/v3/projects/d0d84f5be7fd4b499171b6b34a1203f1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:26:03.716140 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07467300-6368-4df9-bd84-f7d035bdede6 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:03.717547 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-07467300-6368-4df9-bd84-f7d035bdede6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:03.804024 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07467300-6368-4df9-bd84-f7d035bdede6 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:03.809468 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6dce06-9d24-4f9a-8df7-9170b74f236d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:03.810129 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6dce06-9d24-4f9a-8df7-9170b74f236d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:03.810410 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6dce06-9d24-4f9a-8df7-9170b74f236d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:03.810687 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6dce06-9d24-4f9a-8df7-9170b74f236d admin admin] PATH_INFO: `/v3/users/10358afa427f434985374ced64a03ab7` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:03.812298 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6dce06-9d24-4f9a-8df7-9170b74f236d admin admin] RBAC: Authorizing `identity:delete_user(user_id=10358afa427f434985374ced64a03ab7)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:03.814240 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6dce06-9d24-4f9a-8df7-9170b74f236d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:03.902174 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ed6dce06-9d24-4f9a-8df7-9170b74f236d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10358afa427f434985374ced64a03ab7'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:03.903665 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ed6dce06-9d24-4f9a-8df7-9170b74f236d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10358afa427f434985374ced64a03ab7'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:03.911400 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ed6dce06-9d24-4f9a-8df7-9170b74f236d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10358afa427f434985374ced64a03ab7'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:03.912093 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ed6dce06-9d24-4f9a-8df7-9170b74f236d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10358afa427f434985374ced64a03ab7'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:03.927821 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-ed6dce06-9d24-4f9a-8df7-9170b74f236d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10358afa427f434985374ced64a03ab7'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:03.952261 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1058/2126] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:26:03 2022] DELETE /identity/v3/users/10358afa427f434985374ced64a03ab7 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:04.221271 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b4523-f245-41ac-b958-63046c44f0c4 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:04.225436 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-4f5b4523-f245-41ac-b958-63046c44f0c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:04.299926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:04.320098 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b4523-f245-41ac-b958-63046c44f0c4 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:04.384281 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8453a7-01bd-433c-979b-1dda17ac3d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:04.385486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8453a7-01bd-433c-979b-1dda17ac3d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:04.385766 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8453a7-01bd-433c-979b-1dda17ac3d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:04.386036 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8453a7-01bd-433c-979b-1dda17ac3d42 admin admin] PATH_INFO: `/v3/projects/38abb86b4ab747539e6c735eaca002b0` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:04.387264 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8453a7-01bd-433c-979b-1dda17ac3d42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38abb86b4ab747539e6c735eaca002b0)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:04.389315 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8453a7-01bd-433c-979b-1dda17ac3d42 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:04.402020 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6dce06-9d24-4f9a-8df7-9170b74f236d admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:04.403591 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ed6dce06-9d24-4f9a-8df7-9170b74f236d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:04.418380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6dce06-9d24-4f9a-8df7-9170b74f236d admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:04.429527 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb880c6f-cdf2-45aa-a251-49e5e759fa29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:04.430212 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb880c6f-cdf2-45aa-a251-49e5e759fa29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:04.430515 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb880c6f-cdf2-45aa-a251-49e5e759fa29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:04.430746 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb880c6f-cdf2-45aa-a251-49e5e759fa29 admin admin] PATH_INFO: `/v3/projects/a00c7b30fe9348009f4e3e8c29550758` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:04.432947 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb880c6f-cdf2-45aa-a251-49e5e759fa29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a00c7b30fe9348009f4e3e8c29550758)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:04.439510 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb880c6f-cdf2-45aa-a251-49e5e759fa29 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:04.484906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:04.490458 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6a8453a7-01bd-433c-979b-1dda17ac3d42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38abb86b4ab747539e6c735eaca002b0', 'request_id': 'req-6a8453a7-01bd-433c-979b-1dda17ac3d42'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:04.508083 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6a8453a7-01bd-433c-979b-1dda17ac3d42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38abb86b4ab747539e6c735eaca002b0', 'request_id': 'req-6a8453a7-01bd-433c-979b-1dda17ac3d42'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:04.521046 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6a8453a7-01bd-433c-979b-1dda17ac3d42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38abb86b4ab747539e6c735eaca002b0', 'request_id': 'req-6a8453a7-01bd-433c-979b-1dda17ac3d42'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:04.531943 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fb880c6f-cdf2-45aa-a251-49e5e759fa29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a00c7b30fe9348009f4e3e8c29550758', 'request_id': 'req-fb880c6f-cdf2-45aa-a251-49e5e759fa29'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:04.536672 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6a8453a7-01bd-433c-979b-1dda17ac3d42 admin admin] The token cache is being invalidate because project 38abb86b4ab747539e6c735eaca002b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:26:04.536971 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6a8453a7-01bd-433c-979b-1dda17ac3d42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:04.537620 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6a8453a7-01bd-433c-979b-1dda17ac3d42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:04.539400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1069/2127] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:26:04 2022] DELETE /identity/v3/projects/38abb86b4ab747539e6c735eaca002b0 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:04.540935 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fb880c6f-cdf2-45aa-a251-49e5e759fa29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a00c7b30fe9348009f4e3e8c29550758', 'request_id': 'req-fb880c6f-cdf2-45aa-a251-49e5e759fa29'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:04.545150 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5735bc-8a30-4b2e-8a02-82aac9115b6c None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:04.545965 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5735bc-8a30-4b2e-8a02-82aac9115b6c None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:04.546961 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5735bc-8a30-4b2e-8a02-82aac9115b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:04.547671 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fb880c6f-cdf2-45aa-a251-49e5e759fa29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a00c7b30fe9348009f4e3e8c29550758', 'request_id': 'req-fb880c6f-cdf2-45aa-a251-49e5e759fa29'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:04.567310 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fb880c6f-cdf2-45aa-a251-49e5e759fa29 admin admin] The token cache is being invalidate because project a00c7b30fe9348009f4e3e8c29550758 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:26:04.567651 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fb880c6f-cdf2-45aa-a251-49e5e759fa29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:04.568690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fb880c6f-cdf2-45aa-a251-49e5e759fa29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:04.570333 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1059/2128] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:26:04 2022] DELETE /identity/v3/projects/a00c7b30fe9348009f4e3e8c29550758 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:26:04.575519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb880c6f-cdf2-45aa-a251-49e5e759fa29 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:04.577534 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-fb880c6f-cdf2-45aa-a251-49e5e759fa29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:04.577727 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-ee5735bc-8a30-4b2e-8a02-82aac9115b6c None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:04.579041 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ee5735bc-8a30-4b2e-8a02-82aac9115b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:04.654514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1070/2129] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:26:04.663084 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301842e9-5217-40aa-b382-f9883c73a8e6 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:04.663373 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301842e9-5217-40aa-b382-f9883c73a8e6 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:04.663655 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301842e9-5217-40aa-b382-f9883c73a8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:04.667808 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb880c6f-cdf2-45aa-a251-49e5e759fa29 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:04.674661 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fbbf9-2459-4d18-a43f-5331c13378e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:04.675823 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fbbf9-2459-4d18-a43f-5331c13378e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:04.675823 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fbbf9-2459-4d18-a43f-5331c13378e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:04.676077 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fbbf9-2459-4d18-a43f-5331c13378e5 admin admin] PATH_INFO: `/v3/users/e640bc4c5d50476a9b50f78c6e837e45` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:04.677701 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5fbbf9-2459-4d18-a43f-5331c13378e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e640bc4c5d50476a9b50f78c6e837e45)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:04.679893 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5fbbf9-2459-4d18-a43f-5331c13378e5 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:04.687178 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-301842e9-5217-40aa-b382-f9883c73a8e6 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:04.689080 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-301842e9-5217-40aa-b382-f9883c73a8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:04.699548 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1071/2130] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:26:04.703611 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301842e9-5217-40aa-b382-f9883c73a8e6 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:04.718654 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301842e9-5217-40aa-b382-f9883c73a8e6 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:04.723626 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e773f1-a3d7-4432-a1a0-d0bdc0e99b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:04.724315 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e773f1-a3d7-4432-a1a0-d0bdc0e99b24 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:04.724595 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e773f1-a3d7-4432-a1a0-d0bdc0e99b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:04.724873 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e773f1-a3d7-4432-a1a0-d0bdc0e99b24 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:04.725572 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e773f1-a3d7-4432-a1a0-d0bdc0e99b24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:26:04.725884 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e773f1-a3d7-4432-a1a0-d0bdc0e99b24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:04.728134 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e773f1-a3d7-4432-a1a0-d0bdc0e99b24 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:04.739800 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:04.740780 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6b5fbbf9-2459-4d18-a43f-5331c13378e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e640bc4c5d50476a9b50f78c6e837e45'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:04.742117 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6b5fbbf9-2459-4d18-a43f-5331c13378e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e640bc4c5d50476a9b50f78c6e837e45'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:04.748033 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1072/2131] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:26:04.748978 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e773f1-a3d7-4432-a1a0-d0bdc0e99b24 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:04.757341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6b5fbbf9-2459-4d18-a43f-5331c13378e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e640bc4c5d50476a9b50f78c6e837e45'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:04.758254 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6b5fbbf9-2459-4d18-a43f-5331c13378e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e640bc4c5d50476a9b50f78c6e837e45'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:04.761195 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e773f1-a3d7-4432-a1a0-d0bdc0e99b24 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:04.766969 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c6ed6-04c3-4cf1-8f5a-8267984ef0bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:04.767651 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c6ed6-04c3-4cf1-8f5a-8267984ef0bc admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:04.768100 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c6ed6-04c3-4cf1-8f5a-8267984ef0bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:04.768439 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94c6ed6-04c3-4cf1-8f5a-8267984ef0bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:04.769170 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94c6ed6-04c3-4cf1-8f5a-8267984ef0bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:04.771115 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94c6ed6-04c3-4cf1-8f5a-8267984ef0bc admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:04.780695 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6b5fbbf9-2459-4d18-a43f-5331c13378e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e640bc4c5d50476a9b50f78c6e837e45'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:04.803369 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1073/2132] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:26:04 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:26:04.816438 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c6ed6-04c3-4cf1-8f5a-8267984ef0bc admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:04.816438 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e94c6ed6-04c3-4cf1-8f5a-8267984ef0bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:04.820578 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1060/2133] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:26:04 2022] DELETE /identity/v3/users/e640bc4c5d50476a9b50f78c6e837e45 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:04.899573 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94c6ed6-04c3-4cf1-8f5a-8267984ef0bc admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:04.985481 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89136f79-63e3-4e5e-b9e0-8a6e8b3dbebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:04.986508 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89136f79-63e3-4e5e-b9e0-8a6e8b3dbebd admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:04.986753 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89136f79-63e3-4e5e-b9e0-8a6e8b3dbebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:04.987147 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89136f79-63e3-4e5e-b9e0-8a6e8b3dbebd admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:04.988246 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89136f79-63e3-4e5e-b9e0-8a6e8b3dbebd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:04.990128 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89136f79-63e3-4e5e-b9e0-8a6e8b3dbebd admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:05.018109 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1074/2134] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:26:04 2022] POST /identity/v3/users => generated 294 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:26:05.022072 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fbbf9-2459-4d18-a43f-5331c13378e5 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:05.038709 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fbbf9-2459-4d18-a43f-5331c13378e5 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:05.049861 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f18871-dbb2-4a2c-a6d7-eed005f328e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:05.051547 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f18871-dbb2-4a2c-a6d7-eed005f328e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:05.052167 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f18871-dbb2-4a2c-a6d7-eed005f328e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:05.052645 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f18871-dbb2-4a2c-a6d7-eed005f328e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:05.053546 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f18871-dbb2-4a2c-a6d7-eed005f328e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:05.055374 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f18871-dbb2-4a2c-a6d7-eed005f328e1 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:05.068683 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1061/2135] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:26:05.075247 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89136f79-63e3-4e5e-b9e0-8a6e8b3dbebd admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:05.090339 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89136f79-63e3-4e5e-b9e0-8a6e8b3dbebd admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:05.097672 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de0ff4b-1ed7-401f-b66c-c603c13e6726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:05.098376 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0ff4b-1ed7-401f-b66c-c603c13e6726 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:05.098593 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0ff4b-1ed7-401f-b66c-c603c13e6726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:05.098950 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de0ff4b-1ed7-401f-b66c-c603c13e6726 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:05.099887 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0ff4b-1ed7-401f-b66c-c603c13e6726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:05.101589 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de0ff4b-1ed7-401f-b66c-c603c13e6726 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:05.115727 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1075/2136] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:26:05.119917 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f18871-dbb2-4a2c-a6d7-eed005f328e1 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:05.155324 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f18871-dbb2-4a2c-a6d7-eed005f328e1 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:05.170445 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51842497-70d7-438b-9619-c2665d220898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:05.170445 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51842497-70d7-438b-9619-c2665d220898 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:05.170445 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51842497-70d7-438b-9619-c2665d220898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:05.170445 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51842497-70d7-438b-9619-c2665d220898 admin admin] PATH_INFO: `/v3/projects/7ba3a8f553684bad8c2335a102c615e6/users/9828d5382f0d4ce69ed1ab8f393a2cc3/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:05.196675 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:05.203676 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51842497-70d7-438b-9619-c2665d220898 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ba3a8f553684bad8c2335a102c615e6, user_id=9828d5382f0d4ce69ed1ab8f393a2cc3, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:05.206434 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51842497-70d7-438b-9619-c2665d220898 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:05.225996 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1062/2137] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:26:05 2022] PUT /identity/v3/projects/7ba3a8f553684bad8c2335a102c615e6/users/9828d5382f0d4ce69ed1ab8f393a2cc3/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:26:05.237732 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75991a8a-3bd2-444f-ac25-7a894c3f1900 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:05.238231 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75991a8a-3bd2-444f-ac25-7a894c3f1900 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:05.238308 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75991a8a-3bd2-444f-ac25-7a894c3f1900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:05.291113 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-75991a8a-3bd2-444f-ac25-7a894c3f1900 None None] MFA Rules not processed for user `9828d5382f0d4ce69ed1ab8f393a2cc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:05.298977 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-75991a8a-3bd2-444f-ac25-7a894c3f1900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:05.406279 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51842497-70d7-438b-9619-c2665d220898 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:05.408734 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-51842497-70d7-438b-9619-c2665d220898 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:05.439745 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:05.457526 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1076/2138] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:05.462030 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75991a8a-3bd2-444f-ac25-7a894c3f1900 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:05.592056 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51842497-70d7-438b-9619-c2665d220898 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:05.597944 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2014c530-cc3c-47ec-a073-57482d186089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:05.599263 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014c530-cc3c-47ec-a073-57482d186089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:05.599263 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014c530-cc3c-47ec-a073-57482d186089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:05.599496 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2014c530-cc3c-47ec-a073-57482d186089 admin admin] PATH_INFO: `/v3/projects/23959e53f5404cdfb5c9e080a60c9d82` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:05.601708 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014c530-cc3c-47ec-a073-57482d186089 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23959e53f5404cdfb5c9e080a60c9d82)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:05.603862 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2014c530-cc3c-47ec-a073-57482d186089 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:05.604732 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75991a8a-3bd2-444f-ac25-7a894c3f1900 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:05.615980 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be52ee-9e4d-4f39-a035-44db85437b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:05.616659 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be52ee-9e4d-4f39-a035-44db85437b4d admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:05.616943 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be52ee-9e4d-4f39-a035-44db85437b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:05.617218 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be52ee-9e4d-4f39-a035-44db85437b4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:05.619538 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be52ee-9e4d-4f39-a035-44db85437b4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:05.620920 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be52ee-9e4d-4f39-a035-44db85437b4d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:05.681274 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1077/2139] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:26:05 2022] POST /identity/v3/projects => generated 387 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:26:05.682996 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be52ee-9e4d-4f39-a035-44db85437b4d admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:05.698365 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2014c530-cc3c-47ec-a073-57482d186089 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23959e53f5404cdfb5c9e080a60c9d82', 'request_id': 'req-2014c530-cc3c-47ec-a073-57482d186089'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:05.705955 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2014c530-cc3c-47ec-a073-57482d186089 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23959e53f5404cdfb5c9e080a60c9d82', 'request_id': 'req-2014c530-cc3c-47ec-a073-57482d186089'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:05.715335 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2014c530-cc3c-47ec-a073-57482d186089 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23959e53f5404cdfb5c9e080a60c9d82', 'request_id': 'req-2014c530-cc3c-47ec-a073-57482d186089'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:05.733869 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2014c530-cc3c-47ec-a073-57482d186089 admin admin] The token cache is being invalidate because project 23959e53f5404cdfb5c9e080a60c9d82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:26:05.734385 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2014c530-cc3c-47ec-a073-57482d186089 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:05.736968 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2014c530-cc3c-47ec-a073-57482d186089 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:05.738824 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1063/2140] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:26:05 2022] DELETE /identity/v3/projects/23959e53f5404cdfb5c9e080a60c9d82 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:05.745578 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694bc69-45c8-4a10-98ee-5a9ed220c065 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:05.745878 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694bc69-45c8-4a10-98ee-5a9ed220c065 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:05.746162 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694bc69-45c8-4a10-98ee-5a9ed220c065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:05.778864 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-7694bc69-45c8-4a10-98ee-5a9ed220c065 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:05.780278 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7694bc69-45c8-4a10-98ee-5a9ed220c065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:05.800539 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be52ee-9e4d-4f39-a035-44db85437b4d admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:05.802394 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1064/2141] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:26:05.812346 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdca73-408d-4d4f-b378-174a160889cc None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:05.812567 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdca73-408d-4d4f-b378-174a160889cc None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:05.812853 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cdca73-408d-4d4f-b378-174a160889cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:05.820919 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af304d-e672-462f-bc7e-8710a59c5f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:05.821661 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af304d-e672-462f-bc7e-8710a59c5f6d admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:05.821947 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af304d-e672-462f-bc7e-8710a59c5f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:05.822868 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1af304d-e672-462f-bc7e-8710a59c5f6d admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:05.824219 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af304d-e672-462f-bc7e-8710a59c5f6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:05.826443 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1af304d-e672-462f-bc7e-8710a59c5f6d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:05.862854 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1078/2142] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:26:05 2022] POST /identity/v3/users => generated 294 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:26:05.871695 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af304d-e672-462f-bc7e-8710a59c5f6d admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:05.872417 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-e5cdca73-408d-4d4f-b378-174a160889cc None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:05.873727 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e5cdca73-408d-4d4f-b378-174a160889cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:05.876202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-c1af304d-e672-462f-bc7e-8710a59c5f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:05.897029 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1065/2143] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:05.901679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cdca73-408d-4d4f-b378-174a160889cc None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:05.902068 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1af304d-e672-462f-bc7e-8710a59c5f6d admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:05.907759 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb3486-95b2-46d1-91ff-6aa7fb133810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:05.908472 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb3486-95b2-46d1-91ff-6aa7fb133810 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:05.908745 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb3486-95b2-46d1-91ff-6aa7fb133810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:05.909153 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb3486-95b2-46d1-91ff-6aa7fb133810 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:05.909925 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb3486-95b2-46d1-91ff-6aa7fb133810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:05.912254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb3486-95b2-46d1-91ff-6aa7fb133810 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:05.913286 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cdca73-408d-4d4f-b378-174a160889cc None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:05.921061 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e629f-9177-460f-b554-0ef80cee04f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:05.922353 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e629f-9177-460f-b554-0ef80cee04f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:05.923034 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e629f-9177-460f-b554-0ef80cee04f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:05.923618 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43e629f-9177-460f-b554-0ef80cee04f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:05.925065 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e629f-9177-460f-b554-0ef80cee04f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:26:05.925234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1079/2144] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 15:26:05.925440 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e629f-9177-460f-b554-0ef80cee04f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:05.927101 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43e629f-9177-460f-b554-0ef80cee04f5 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:05.928975 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb3486-95b2-46d1-91ff-6aa7fb133810 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:05.940741 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb3486-95b2-46d1-91ff-6aa7fb133810 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:05.947639 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a94afc-a22e-4591-a144-dd246e2b8cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:05.948605 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1066/2145] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:26:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:26:05.948782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a94afc-a22e-4591-a144-dd246e2b8cef admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:05.949149 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a94afc-a22e-4591-a144-dd246e2b8cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:05.949467 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a94afc-a22e-4591-a144-dd246e2b8cef admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:05.950046 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e629f-9177-460f-b554-0ef80cee04f5 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:05.950172 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a94afc-a22e-4591-a144-dd246e2b8cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:05.952033 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a94afc-a22e-4591-a144-dd246e2b8cef admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:05.961804 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43e629f-9177-460f-b554-0ef80cee04f5 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:05.967393 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf87b87-aaec-4afe-811b-1d50ba9dd67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:05.971501 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf87b87-aaec-4afe-811b-1d50ba9dd67d admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:05.971654 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1080/2146] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 15:26:05.971739 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf87b87-aaec-4afe-811b-1d50ba9dd67d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:05.971739 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf87b87-aaec-4afe-811b-1d50ba9dd67d admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:05.971739 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf87b87-aaec-4afe-811b-1d50ba9dd67d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:05.971739 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf87b87-aaec-4afe-811b-1d50ba9dd67d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:05.972917 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a94afc-a22e-4591-a144-dd246e2b8cef admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:05.985675 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a94afc-a22e-4591-a144-dd246e2b8cef admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:05.993833 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1538a6c-dc08-4d3c-9d86-588f15755894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:05.995161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1538a6c-dc08-4d3c-9d86-588f15755894 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:05.996921 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1538a6c-dc08-4d3c-9d86-588f15755894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:05.996921 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1538a6c-dc08-4d3c-9d86-588f15755894 admin admin] PATH_INFO: `/v3/projects/59cfdbb4c16443f380824b16c9b8794f/users/c7fb6ca7a00e49c2a00ebd055a03d265/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:06.016754 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1067/2147] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:26:05 2022] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:26:06.018608 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1538a6c-dc08-4d3c-9d86-588f15755894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59cfdbb4c16443f380824b16c9b8794f, user_id=c7fb6ca7a00e49c2a00ebd055a03d265, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:06.021004 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf87b87-aaec-4afe-811b-1d50ba9dd67d admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:06.022273 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1538a6c-dc08-4d3c-9d86-588f15755894 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:06.039956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1081/2148] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:26:05 2022] PUT /identity/v3/projects/59cfdbb4c16443f380824b16c9b8794f/users/c7fb6ca7a00e49c2a00ebd055a03d265/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:06.051918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566f535-cc1d-4563-9868-ca502b80ad63 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:06.052428 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566f535-cc1d-4563-9868-ca502b80ad63 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:06.053066 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566f535-cc1d-4563-9868-ca502b80ad63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:06.058810 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:06.088873 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-7566f535-cc1d-4563-9868-ca502b80ad63 None None] MFA Rules not processed for user `c7fb6ca7a00e49c2a00ebd055a03d265`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:06.090228 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-7566f535-cc1d-4563-9868-ca502b80ad63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:06.093572 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf87b87-aaec-4afe-811b-1d50ba9dd67d admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:06.100941 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:06.156620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800d519-0570-4031-9dcd-4b5c432d12a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:06.157150 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800d519-0570-4031-9dcd-4b5c432d12a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:06.157432 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800d519-0570-4031-9dcd-4b5c432d12a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:06.157706 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800d519-0570-4031-9dcd-4b5c432d12a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:06.158371 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800d519-0570-4031-9dcd-4b5c432d12a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:06.160321 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1800d519-0570-4031-9dcd-4b5c432d12a3 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:06.169983 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1082/2149] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:06.174890 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566f535-cc1d-4563-9868-ca502b80ad63 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:06.187721 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566f535-cc1d-4563-9868-ca502b80ad63 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:06.192194 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1068/2150] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:26:06 2022] POST /identity/v3/users => generated 286 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:26:06.193418 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237183d-1849-40e9-9709-baca016966f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:06.193874 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800d519-0570-4031-9dcd-4b5c432d12a3 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:06.194074 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237183d-1849-40e9-9709-baca016966f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:06.194318 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237183d-1849-40e9-9709-baca016966f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:06.194596 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237183d-1849-40e9-9709-baca016966f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:06.195265 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237183d-1849-40e9-9709-baca016966f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:06.197387 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237183d-1849-40e9-9709-baca016966f0 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:06.205723 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1800d519-0570-4031-9dcd-4b5c432d12a3 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:06.211371 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98187ec5-3d11-46ec-a17f-3e88fc893196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:06.212021 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98187ec5-3d11-46ec-a17f-3e88fc893196 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:06.212311 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98187ec5-3d11-46ec-a17f-3e88fc893196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:06.212587 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98187ec5-3d11-46ec-a17f-3e88fc893196 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:06.213780 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98187ec5-3d11-46ec-a17f-3e88fc893196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:06.215587 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98187ec5-3d11-46ec-a17f-3e88fc893196 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:06.227062 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1069/2151] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 15:26:06.232696 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1083/2152] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:26:06 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:26:06.232832 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98187ec5-3d11-46ec-a17f-3e88fc893196 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:06.233963 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237183d-1849-40e9-9709-baca016966f0 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:06.247980 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98187ec5-3d11-46ec-a17f-3e88fc893196 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:06.309058 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237183d-1849-40e9-9709-baca016966f0 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:06.320768 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1740e-3621-49d0-b24e-40f8956c9307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:06.321918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1740e-3621-49d0-b24e-40f8956c9307 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:06.322680 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1740e-3621-49d0-b24e-40f8956c9307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:06.323366 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1740e-3621-49d0-b24e-40f8956c9307 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:06.324455 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1740e-3621-49d0-b24e-40f8956c9307 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:06.327790 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1740e-3621-49d0-b24e-40f8956c9307 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:06.328470 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431156d9-cb7e-4be6-bee7-29726b54872a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:06.329152 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431156d9-cb7e-4be6-bee7-29726b54872a admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:06.329501 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431156d9-cb7e-4be6-bee7-29726b54872a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:06.329842 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431156d9-cb7e-4be6-bee7-29726b54872a admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:06.330621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431156d9-cb7e-4be6-bee7-29726b54872a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:06.332547 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431156d9-cb7e-4be6-bee7-29726b54872a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:06.343817 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1070/2153] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:26:06.347766 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431156d9-cb7e-4be6-bee7-29726b54872a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:06.357966 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431156d9-cb7e-4be6-bee7-29726b54872a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:06.362742 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1084/2154] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:26:06 2022] POST /identity/v3/users => generated 298 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:26:06.363063 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0fe76-b532-4c45-a192-6cc271da2777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:06.363720 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0fe76-b532-4c45-a192-6cc271da2777 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:06.363822 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1740e-3621-49d0-b24e-40f8956c9307 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:06.364021 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0fe76-b532-4c45-a192-6cc271da2777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:06.364296 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0fe76-b532-4c45-a192-6cc271da2777 admin admin] PATH_INFO: `/v3/projects/62dd80f0e7794f9ca582fb9206ddc289/users/4c5b5285ca70478ca580f7661663f522/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:06.376937 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1740e-3621-49d0-b24e-40f8956c9307 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:06.382644 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd933cd-8328-4393-abe8-4459b7e77831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:06.383273 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd933cd-8328-4393-abe8-4459b7e77831 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:06.383559 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd933cd-8328-4393-abe8-4459b7e77831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:06.383837 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd933cd-8328-4393-abe8-4459b7e77831 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:06.384607 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd933cd-8328-4393-abe8-4459b7e77831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:06.384854 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0fe76-b532-4c45-a192-6cc271da2777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62dd80f0e7794f9ca582fb9206ddc289, user_id=4c5b5285ca70478ca580f7661663f522, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:06.386524 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd933cd-8328-4393-abe8-4459b7e77831 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:06.389094 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0fe76-b532-4c45-a192-6cc271da2777 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:06.401956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1085/2155] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 15:26:06.406409 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd933cd-8328-4393-abe8-4459b7e77831 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:06.420519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1071/2156] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:26:06 2022] PUT /identity/v3/projects/62dd80f0e7794f9ca582fb9206ddc289/users/4c5b5285ca70478ca580f7661663f522/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:26:06.422386 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230c7cc-80c7-45e6-9865-778e6784ac32 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:06.422735 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230c7cc-80c7-45e6-9865-778e6784ac32 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:06.423066 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230c7cc-80c7-45e6-9865-778e6784ac32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:06.428830 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd933cd-8328-4393-abe8-4459b7e77831 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:06.460687 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f230c7cc-80c7-45e6-9865-778e6784ac32 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:06.462121 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f230c7cc-80c7-45e6-9865-778e6784ac32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:06.495299 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:06.532691 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852d700-219e-4042-9f1c-5a3eea50f9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:06.533362 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852d700-219e-4042-9f1c-5a3eea50f9d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:06.533723 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852d700-219e-4042-9f1c-5a3eea50f9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:06.533901 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852d700-219e-4042-9f1c-5a3eea50f9d7 admin admin] PATH_INFO: `/v3/projects/be903323fed24a8493bf3babebf4dea3/users/f1caaf54ec424324ae5bd0fd4789012e/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:06.554256 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1072/2157] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:26:06.560880 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230c7cc-80c7-45e6-9865-778e6784ac32 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:06.562336 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f230c7cc-80c7-45e6-9865-778e6784ac32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:06.563375 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:06.567567 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852d700-219e-4042-9f1c-5a3eea50f9d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be903323fed24a8493bf3babebf4dea3, user_id=f1caaf54ec424324ae5bd0fd4789012e, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:06.571234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852d700-219e-4042-9f1c-5a3eea50f9d7 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:06.593674 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1086/2158] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:26:06 2022] PUT /identity/v3/projects/be903323fed24a8493bf3babebf4dea3/users/f1caaf54ec424324ae5bd0fd4789012e/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:06.594904 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852d700-219e-4042-9f1c-5a3eea50f9d7 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:06.645998 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230c7cc-80c7-45e6-9865-778e6784ac32 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:06.679873 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852d700-219e-4042-9f1c-5a3eea50f9d7 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:06.686778 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56f106-1eb8-4df7-9c4d-a4b7793ded4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:06.688386 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56f106-1eb8-4df7-9c4d-a4b7793ded4e admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:06.688871 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56f106-1eb8-4df7-9c4d-a4b7793ded4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:06.689233 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56f106-1eb8-4df7-9c4d-a4b7793ded4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:06.692080 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56f106-1eb8-4df7-9c4d-a4b7793ded4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:06.694033 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb56f106-1eb8-4df7-9c4d-a4b7793ded4e admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:06.710173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1087/2159] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:26:06.721037 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56f106-1eb8-4df7-9c4d-a4b7793ded4e admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:06.723197 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7ce497-5230-4cad-badc-b3a00f0ab070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:06.725886 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ce497-5230-4cad-badc-b3a00f0ab070 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:06.725886 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ce497-5230-4cad-badc-b3a00f0ab070 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:06.725886 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7ce497-5230-4cad-badc-b3a00f0ab070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:06.732733 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56f106-1eb8-4df7-9c4d-a4b7793ded4e admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:06.738100 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef113dcb-11aa-442d-a4e1-621efc982701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:06.738777 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef113dcb-11aa-442d-a4e1-621efc982701 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:06.739058 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef113dcb-11aa-442d-a4e1-621efc982701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:06.739175 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ce497-5230-4cad-badc-b3a00f0ab070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:06.739356 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef113dcb-11aa-442d-a4e1-621efc982701 admin admin] PATH_INFO: `/v3/projects/be903323fed24a8493bf3babebf4dea3/users/f1caaf54ec424324ae5bd0fd4789012e/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:06.741067 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7ce497-5230-4cad-badc-b3a00f0ab070 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:06.741554 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef113dcb-11aa-442d-a4e1-621efc982701 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be903323fed24a8493bf3babebf4dea3, user_id=f1caaf54ec424324ae5bd0fd4789012e, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:06.744275 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef113dcb-11aa-442d-a4e1-621efc982701 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:06.754640 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1073/2160] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:26:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:26:06.756197 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1088/2161] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:26:06 2022] PUT /identity/v3/projects/be903323fed24a8493bf3babebf4dea3/users/f1caaf54ec424324ae5bd0fd4789012e/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:06.767068 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0600ac-f753-49cc-adcd-a2859840efda None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:06.767431 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0600ac-f753-49cc-adcd-a2859840efda None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:06.767778 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0600ac-f753-49cc-adcd-a2859840efda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:06.798250 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9c0600ac-f753-49cc-adcd-a2859840efda None None] MFA Rules not processed for user `f1caaf54ec424324ae5bd0fd4789012e`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:06.799759 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9c0600ac-f753-49cc-adcd-a2859840efda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:06.890238 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1074/2162] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:06.904869 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef113dcb-11aa-442d-a4e1-621efc982701 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:06.906598 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ef113dcb-11aa-442d-a4e1-621efc982701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:07.000721 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef113dcb-11aa-442d-a4e1-621efc982701 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:07.005975 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86f72f-8712-4f9b-a136-cbd354f690c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:07.007592 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86f72f-8712-4f9b-a136-cbd354f690c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:07.008455 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86f72f-8712-4f9b-a136-cbd354f690c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:07.008813 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed86f72f-8712-4f9b-a136-cbd354f690c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:07.023225 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86f72f-8712-4f9b-a136-cbd354f690c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:07.028252 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed86f72f-8712-4f9b-a136-cbd354f690c8 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:07.040139 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1089/2163] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:26:06 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:26:07.583776 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0dfaf-088d-48ea-a33a-7f9157e86f6c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:07.584331 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0dfaf-088d-48ea-a33a-7f9157e86f6c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:07.584422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0dfaf-088d-48ea-a33a-7f9157e86f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:07.674845 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-eae0dfaf-088d-48ea-a33a-7f9157e86f6c None None] MFA Rules not processed for user `4c5b5285ca70478ca580f7661663f522`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:07.677743 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-eae0dfaf-088d-48ea-a33a-7f9157e86f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:07.685906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:07.838804 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1075/2164] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:07 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:07.853238 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86f72f-8712-4f9b-a136-cbd354f690c8 service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:07.854894 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ed86f72f-8712-4f9b-a136-cbd354f690c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:07.872444 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed86f72f-8712-4f9b-a136-cbd354f690c8 service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:07.879009 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1984532-d3fe-4003-a45d-cc80db205b9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:07.880194 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1984532-d3fe-4003-a45d-cc80db205b9c service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:07.880731 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1984532-d3fe-4003-a45d-cc80db205b9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:07.881220 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1984532-d3fe-4003-a45d-cc80db205b9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:07.885906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0dfaf-088d-48ea-a33a-7f9157e86f6c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:07.900939 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0dfaf-088d-48ea-a33a-7f9157e86f6c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:07.907578 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1984532-d3fe-4003-a45d-cc80db205b9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:07.909524 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1984532-d3fe-4003-a45d-cc80db205b9c service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:07.921370 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1090/2165] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:26:07 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:26:07.923210 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccde2ae-853f-4018-a77d-82c265436c44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:07.924128 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccde2ae-853f-4018-a77d-82c265436c44 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:07.927886 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccde2ae-853f-4018-a77d-82c265436c44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:07.928708 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccde2ae-853f-4018-a77d-82c265436c44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:07.932886 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7ccde2ae-853f-4018-a77d-82c265436c44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:08.052486 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccde2ae-853f-4018-a77d-82c265436c44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:08.054028 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccde2ae-853f-4018-a77d-82c265436c44 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:08.066464 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1076/2166] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:26:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 15:26:10.753855 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabd385-3d5d-46e6-b6b2-882d1923f32f None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:10.754346 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabd385-3d5d-46e6-b6b2-882d1923f32f None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:10.754346 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fabd385-3d5d-46e6-b6b2-882d1923f32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:10.776494 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-5fabd385-3d5d-46e6-b6b2-882d1923f32f None None] MFA Rules not processed for user `4c5b5285ca70478ca580f7661663f522`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:10.777699 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5fabd385-3d5d-46e6-b6b2-882d1923f32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:10.784821 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1091/2167] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:12.456669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccde2ae-853f-4018-a77d-82c265436c44 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:12.458216 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7ccde2ae-853f-4018-a77d-82c265436c44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:12.524037 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccde2ae-853f-4018-a77d-82c265436c44 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:12.528893 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a187d-18e7-47f6-9fac-7f71d78de097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:12.529537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a187d-18e7-47f6-9fac-7f71d78de097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:12.529818 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a187d-18e7-47f6-9fac-7f71d78de097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:12.530091 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a187d-18e7-47f6-9fac-7f71d78de097 admin admin] PATH_INFO: `/v3/users/f5b17712d1fc47b7a87713808f0672bc` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:12.531287 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a187d-18e7-47f6-9fac-7f71d78de097 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5b17712d1fc47b7a87713808f0672bc)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:12.533233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689a187d-18e7-47f6-9fac-7f71d78de097 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:12.582066 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:12.584032 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-689a187d-18e7-47f6-9fac-7f71d78de097 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5b17712d1fc47b7a87713808f0672bc'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:12.585011 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-689a187d-18e7-47f6-9fac-7f71d78de097 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5b17712d1fc47b7a87713808f0672bc'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:12.602434 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-689a187d-18e7-47f6-9fac-7f71d78de097 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5b17712d1fc47b7a87713808f0672bc'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:12.603682 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-689a187d-18e7-47f6-9fac-7f71d78de097 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5b17712d1fc47b7a87713808f0672bc'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:12.616443 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-689a187d-18e7-47f6-9fac-7f71d78de097 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5b17712d1fc47b7a87713808f0672bc'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:12.629674 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1077/2168] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:26:12 2022] DELETE /identity/v3/users/f5b17712d1fc47b7a87713808f0672bc => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:12.634258 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db14d06-2a0e-4cc7-80db-b050e6e6a6ea None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:12.634740 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db14d06-2a0e-4cc7-80db-b050e6e6a6ea None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:12.634962 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db14d06-2a0e-4cc7-80db-b050e6e6a6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:12.654494 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-0db14d06-2a0e-4cc7-80db-b050e6e6a6ea None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:12.656875 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-0db14d06-2a0e-4cc7-80db-b050e6e6a6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:12.716420 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:12.736304 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1092/2169] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:12.751177 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a187d-18e7-47f6-9fac-7f71d78de097 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:12.753236 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-689a187d-18e7-47f6-9fac-7f71d78de097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:12.832432 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a187d-18e7-47f6-9fac-7f71d78de097 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:12.840044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64982067-7121-4ebe-b560-f489af975d75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:12.840684 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64982067-7121-4ebe-b560-f489af975d75 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:12.840965 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64982067-7121-4ebe-b560-f489af975d75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:12.841380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64982067-7121-4ebe-b560-f489af975d75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:12.851570 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64982067-7121-4ebe-b560-f489af975d75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:12.853984 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64982067-7121-4ebe-b560-f489af975d75 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:12.866169 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1078/2170] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:26:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:26:13.492339 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db14d06-2a0e-4cc7-80db-b050e6e6a6ea None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:13.494876 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-0db14d06-2a0e-4cc7-80db-b050e6e6a6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:13.526059 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db14d06-2a0e-4cc7-80db-b050e6e6a6ea None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:13.542048 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25691ae4-de9d-468b-8c65-aa3699f7d250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:13.543007 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25691ae4-de9d-468b-8c65-aa3699f7d250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:13.543295 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25691ae4-de9d-468b-8c65-aa3699f7d250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:13.543570 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25691ae4-de9d-468b-8c65-aa3699f7d250 admin admin] PATH_INFO: `/v3/projects/05f3e162ed784bcf9086a7ec848e37f3` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:13.553366 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25691ae4-de9d-468b-8c65-aa3699f7d250 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05f3e162ed784bcf9086a7ec848e37f3)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:13.555580 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25691ae4-de9d-468b-8c65-aa3699f7d250 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:13.646839 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-25691ae4-de9d-468b-8c65-aa3699f7d250 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05f3e162ed784bcf9086a7ec848e37f3', 'request_id': 'req-25691ae4-de9d-468b-8c65-aa3699f7d250'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:13.658829 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-25691ae4-de9d-468b-8c65-aa3699f7d250 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05f3e162ed784bcf9086a7ec848e37f3', 'request_id': 'req-25691ae4-de9d-468b-8c65-aa3699f7d250'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:13.685642 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-25691ae4-de9d-468b-8c65-aa3699f7d250 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05f3e162ed784bcf9086a7ec848e37f3', 'request_id': 'req-25691ae4-de9d-468b-8c65-aa3699f7d250'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:13.708345 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-25691ae4-de9d-468b-8c65-aa3699f7d250 admin admin] The token cache is being invalidate because project 05f3e162ed784bcf9086a7ec848e37f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:26:13.708938 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-25691ae4-de9d-468b-8c65-aa3699f7d250 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:13.710469 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-25691ae4-de9d-468b-8c65-aa3699f7d250 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:13.713761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1093/2171] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:26:13 2022] DELETE /identity/v3/projects/05f3e162ed784bcf9086a7ec848e37f3 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:13.718550 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d712c3b-1219-4b28-ae12-96d9dc97df50 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:13.719057 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d712c3b-1219-4b28-ae12-96d9dc97df50 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:13.719155 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d712c3b-1219-4b28-ae12-96d9dc97df50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:13.731314 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25691ae4-de9d-468b-8c65-aa3699f7d250 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:13.733278 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-25691ae4-de9d-468b-8c65-aa3699f7d250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:13.745548 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-6d712c3b-1219-4b28-ae12-96d9dc97df50 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:13.747062 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6d712c3b-1219-4b28-ae12-96d9dc97df50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:13.843280 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1079/2172] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:26:13.851373 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20fc19-8fa4-4057-91a6-5271f355f7f9 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:13.852710 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20fc19-8fa4-4057-91a6-5271f355f7f9 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:13.853212 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e20fc19-8fa4-4057-91a6-5271f355f7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:13.862678 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25691ae4-de9d-468b-8c65-aa3699f7d250 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:13.871696 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee7e50-e4d0-48fc-9ee7-f0cd3acfb390 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:13.875572 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee7e50-e4d0-48fc-9ee7-f0cd3acfb390 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:13.876319 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee7e50-e4d0-48fc-9ee7-f0cd3acfb390 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:13.876795 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ee7e50-e4d0-48fc-9ee7-f0cd3acfb390 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:13.885007 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-95ee7e50-e4d0-48fc-9ee7-f0cd3acfb390 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:13.899172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9e20fc19-8fa4-4057-91a6-5271f355f7f9 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:13.902662 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9e20fc19-8fa4-4057-91a6-5271f355f7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:13.928153 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1080/2173] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:26:13.932092 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20fc19-8fa4-4057-91a6-5271f355f7f9 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:13.957267 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e20fc19-8fa4-4057-91a6-5271f355f7f9 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:13.970868 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20bee9-779a-4008-9d0c-64e58a1b32b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:13.972891 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20bee9-779a-4008-9d0c-64e58a1b32b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:13.974585 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20bee9-779a-4008-9d0c-64e58a1b32b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:13.975857 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20bee9-779a-4008-9d0c-64e58a1b32b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:13.977124 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb20bee9-779a-4008-9d0c-64e58a1b32b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:26:13.978902 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb20bee9-779a-4008-9d0c-64e58a1b32b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:13.980863 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb20bee9-779a-4008-9d0c-64e58a1b32b4 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:14.024323 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1081/2174] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:26:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:26:14.025807 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20bee9-779a-4008-9d0c-64e58a1b32b4 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:14.049061 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20bee9-779a-4008-9d0c-64e58a1b32b4 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:14.054268 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee7e50-e4d0-48fc-9ee7-f0cd3acfb390 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:14.057058 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f2f9e-24a3-4000-a47f-cd86f662cbc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:14.058013 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f2f9e-24a3-4000-a47f-cd86f662cbc4 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:14.058441 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f2f9e-24a3-4000-a47f-cd86f662cbc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:14.058897 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ee7e50-e4d0-48fc-9ee7-f0cd3acfb390 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:14.059321 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f2f9e-24a3-4000-a47f-cd86f662cbc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:14.060315 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f2f9e-24a3-4000-a47f-cd86f662cbc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:14.066120 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4f2f9e-24a3-4000-a47f-cd86f662cbc4 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:14.122134 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1094/2176] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:26:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 15:26:14.129133 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee7e50-e4d0-48fc-9ee7-f0cd3acfb390 service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:14.135452 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1082/2176] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:26:14 2022] POST /identity/v3/projects => generated 365 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:26:14.198842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ee7e50-e4d0-48fc-9ee7-f0cd3acfb390 service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:14.276564 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:14.327137 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979708e2-516d-4017-b952-1db8a5df5f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:14.327816 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979708e2-516d-4017-b952-1db8a5df5f99 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:14.328138 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979708e2-516d-4017-b952-1db8a5df5f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:14.328516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979708e2-516d-4017-b952-1db8a5df5f99 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:14.329217 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979708e2-516d-4017-b952-1db8a5df5f99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:14.331337 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979708e2-516d-4017-b952-1db8a5df5f99 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:14.372096 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1095/2177] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:26:14 2022] POST /identity/v3/users => generated 283 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:26:14.373875 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f2f9e-24a3-4000-a47f-cd86f662cbc4 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:14.392642 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4f2f9e-24a3-4000-a47f-cd86f662cbc4 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:14.400791 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8cfd7c-1ab3-4852-ad98-91fb1a18e540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:14.403037 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8cfd7c-1ab3-4852-ad98-91fb1a18e540 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:14.404202 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8cfd7c-1ab3-4852-ad98-91fb1a18e540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:14.404779 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8cfd7c-1ab3-4852-ad98-91fb1a18e540 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:14.405775 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8cfd7c-1ab3-4852-ad98-91fb1a18e540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:14.409413 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8cfd7c-1ab3-4852-ad98-91fb1a18e540 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:14.441262 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1083/2178] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:26:14.445193 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979708e2-516d-4017-b952-1db8a5df5f99 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:14.471442 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979708e2-516d-4017-b952-1db8a5df5f99 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:14.492979 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24730400-9732-442d-a103-a3153049a965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:14.494560 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24730400-9732-442d-a103-a3153049a965 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:14.497045 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24730400-9732-442d-a103-a3153049a965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:14.497363 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24730400-9732-442d-a103-a3153049a965 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:14.498088 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24730400-9732-442d-a103-a3153049a965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:14.501333 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24730400-9732-442d-a103-a3153049a965 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:14.527149 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1096/2179] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:26:14.532173 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8cfd7c-1ab3-4852-ad98-91fb1a18e540 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:14.546413 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8cfd7c-1ab3-4852-ad98-91fb1a18e540 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:14.560399 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9819f8-b15b-4aea-bdc2-af66cbf57665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:14.561359 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9819f8-b15b-4aea-bdc2-af66cbf57665 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:14.561803 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9819f8-b15b-4aea-bdc2-af66cbf57665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:14.562155 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9819f8-b15b-4aea-bdc2-af66cbf57665 admin admin] PATH_INFO: `/v3/projects/bc246b90006e41a1aec45ee204a95086/users/20cdeed33451489aa91570d45c49cf56/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:14.601920 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:14.611912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9819f8-b15b-4aea-bdc2-af66cbf57665 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc246b90006e41a1aec45ee204a95086, user_id=20cdeed33451489aa91570d45c49cf56, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:14.617078 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9819f8-b15b-4aea-bdc2-af66cbf57665 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:14.644385 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1084/2180] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:26:14 2022] PUT /identity/v3/projects/bc246b90006e41a1aec45ee204a95086/users/20cdeed33451489aa91570d45c49cf56/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:26:14.656330 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e171ea6-cd18-461e-b854-9d679cc9c68f None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:14.656890 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e171ea6-cd18-461e-b854-9d679cc9c68f None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:14.657102 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e171ea6-cd18-461e-b854-9d679cc9c68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:14.709347 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-8e171ea6-cd18-461e-b854-9d679cc9c68f None None] MFA Rules not processed for user `20cdeed33451489aa91570d45c49cf56`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:14.711448 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8e171ea6-cd18-461e-b854-9d679cc9c68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:14.854304 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1097/2181] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:14 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:14.870340 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9819f8-b15b-4aea-bdc2-af66cbf57665 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:14.872257 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-df9819f8-b15b-4aea-bdc2-af66cbf57665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:14.981549 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9819f8-b15b-4aea-bdc2-af66cbf57665 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:14.987259 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d357479-3cee-4dc7-92d8-a15c9cfb7609 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:14.987882 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d357479-3cee-4dc7-92d8-a15c9cfb7609 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:14.988904 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d357479-3cee-4dc7-92d8-a15c9cfb7609 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:14.989212 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d357479-3cee-4dc7-92d8-a15c9cfb7609 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:15.001381 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d357479-3cee-4dc7-92d8-a15c9cfb7609 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:15.003635 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d357479-3cee-4dc7-92d8-a15c9cfb7609 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:15.018669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1085/2182] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:26:14 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:26:17.059661 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd9622-3d8d-4e80-80d2-7e0ada854a8d None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:17.060851 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd9622-3d8d-4e80-80d2-7e0ada854a8d None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:17.061301 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbd9622-3d8d-4e80-80d2-7e0ada854a8d None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:17.062812 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1098/2183] 10.222.0.40 () {54 vars in 921 bytes} [Wed Jul 27 15:26:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:26:17.106985 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b4266-47e6-419f-9866-678d9fa8feb5 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:17.107524 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b4266-47e6-419f-9866-678d9fa8feb5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:17.108140 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111b4266-47e6-419f-9866-678d9fa8feb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:17.148076 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd9622-3d8d-4e80-80d2-7e0ada854a8d None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:17.149895 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6dbd9622-3d8d-4e80-80d2-7e0ada854a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:17.158237 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-111b4266-47e6-419f-9866-678d9fa8feb5 None None] MFA Rules not processed for user `a386d326dc634cbd943ac30f6e8d08bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:17.159787 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-111b4266-47e6-419f-9866-678d9fa8feb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:17.295080 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbd9622-3d8d-4e80-80d2-7e0ada854a8d None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:17.302361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0d0f4-d2ca-4bda-a507-4350249c793f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:17.303011 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0d0f4-d2ca-4bda-a507-4350249c793f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:17.303292 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0d0f4-d2ca-4bda-a507-4350249c793f admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:17.303558 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0d0f4-d2ca-4bda-a507-4350249c793f admin admin] PATH_INFO: `/v3/users/b875adcba700459b99ce0d0d5ec9a9d9` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:17.305044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0d0f4-d2ca-4bda-a507-4350249c793f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b875adcba700459b99ce0d0d5ec9a9d9)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:17.307783 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0d0f4-d2ca-4bda-a507-4350249c793f admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:17.356516 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1086/2184] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Jul 27 15:26:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:17.362123 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b4266-47e6-419f-9866-678d9fa8feb5 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:17.370657 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-111b4266-47e6-419f-9866-678d9fa8feb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:17.382062 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:17.388435 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-36a0d0f4-d2ca-4bda-a507-4350249c793f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b875adcba700459b99ce0d0d5ec9a9d9'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:17.389655 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-36a0d0f4-d2ca-4bda-a507-4350249c793f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b875adcba700459b99ce0d0d5ec9a9d9'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:17.401891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-36a0d0f4-d2ca-4bda-a507-4350249c793f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b875adcba700459b99ce0d0d5ec9a9d9'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:17.402879 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111b4266-47e6-419f-9866-678d9fa8feb5 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:17.422474 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-36a0d0f4-d2ca-4bda-a507-4350249c793f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b875adcba700459b99ce0d0d5ec9a9d9'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:17.422964 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f540f1-07a7-4fb0-8515-81aa2e6dedfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:17.422964 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f540f1-07a7-4fb0-8515-81aa2e6dedfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:17.422964 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f540f1-07a7-4fb0-8515-81aa2e6dedfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:17.422964 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f540f1-07a7-4fb0-8515-81aa2e6dedfc admin admin] PATH_INFO: `/v3/users/9828d5382f0d4ce69ed1ab8f393a2cc3` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:17.423343 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f540f1-07a7-4fb0-8515-81aa2e6dedfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9828d5382f0d4ce69ed1ab8f393a2cc3)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:17.423343 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f540f1-07a7-4fb0-8515-81aa2e6dedfc admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:17.433480 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-36a0d0f4-d2ca-4bda-a507-4350249c793f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b875adcba700459b99ce0d0d5ec9a9d9'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:17.444161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1099/2185] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:26:17 2022] DELETE /identity/v3/users/b875adcba700459b99ce0d0d5ec9a9d9 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:26:17.444161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0d0f4-d2ca-4bda-a507-4350249c793f admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:17.444161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-36a0d0f4-d2ca-4bda-a507-4350249c793f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:17.505929 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-41f540f1-07a7-4fb0-8515-81aa2e6dedfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9828d5382f0d4ce69ed1ab8f393a2cc3'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:17.507196 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-41f540f1-07a7-4fb0-8515-81aa2e6dedfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9828d5382f0d4ce69ed1ab8f393a2cc3'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:17.524394 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-41f540f1-07a7-4fb0-8515-81aa2e6dedfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9828d5382f0d4ce69ed1ab8f393a2cc3'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:17.525595 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-41f540f1-07a7-4fb0-8515-81aa2e6dedfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9828d5382f0d4ce69ed1ab8f393a2cc3'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:17.543910 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-41f540f1-07a7-4fb0-8515-81aa2e6dedfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9828d5382f0d4ce69ed1ab8f393a2cc3'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:17.557801 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:17.560546 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0d0f4-d2ca-4bda-a507-4350249c793f admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:17.565085 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1087/2186] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:26:17 2022] DELETE /identity/v3/users/9828d5382f0d4ce69ed1ab8f393a2cc3 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:17.569231 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7873b-5c0c-4a56-a520-feff1edf49ad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a386d326dc634cbd943ac30f6e8d08bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:17.569877 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7873b-5c0c-4a56-a520-feff1edf49ad service placement] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:17.570140 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7873b-5c0c-4a56-a520-feff1edf49ad service placement] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:17.570415 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7873b-5c0c-4a56-a520-feff1edf49ad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:17.570526 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5134f8-a1ed-4649-b9fe-be1126e9f4ac None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:17.571701 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5134f8-a1ed-4649-b9fe-be1126e9f4ac None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:17.572231 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5134f8-a1ed-4649-b9fe-be1126e9f4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:17.572534 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-cfe7873b-5c0c-4a56-a520-feff1edf49ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:17.586191 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7873b-5c0c-4a56-a520-feff1edf49ad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:17.588469 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7873b-5c0c-4a56-a520-feff1edf49ad service placement] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:17.600698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1100/2187] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:26:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:26:17.601885 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-dd5134f8-a1ed-4649-b9fe-be1126e9f4ac None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:17.604306 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-dd5134f8-a1ed-4649-b9fe-be1126e9f4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:17.654419 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7873b-5c0c-4a56-a520-feff1edf49ad service placement] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:17.655726 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-cfe7873b-5c0c-4a56-a520-feff1edf49ad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:17.674318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1088/2188] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:17.688552 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5134f8-a1ed-4649-b9fe-be1126e9f4ac None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:17.689975 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-dd5134f8-a1ed-4649-b9fe-be1126e9f4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:17.730588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7873b-5c0c-4a56-a520-feff1edf49ad service placement] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:17.735211 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3286f45-ecd4-40bf-b785-b805d9229358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:17.735847 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3286f45-ecd4-40bf-b785-b805d9229358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:17.736157 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3286f45-ecd4-40bf-b785-b805d9229358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:17.736436 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3286f45-ecd4-40bf-b785-b805d9229358 admin admin] PATH_INFO: `/v3/projects/ab0194db873a441696f7e985a3b6c47c` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:17.737580 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3286f45-ecd4-40bf-b785-b805d9229358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab0194db873a441696f7e985a3b6c47c)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:17.739479 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3286f45-ecd4-40bf-b785-b805d9229358 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:17.746807 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5134f8-a1ed-4649-b9fe-be1126e9f4ac None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:17.750561 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500562c0-2266-44df-a3b1-856b4f981d23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:17.751180 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500562c0-2266-44df-a3b1-856b4f981d23 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:17.751458 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500562c0-2266-44df-a3b1-856b4f981d23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:17.751749 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500562c0-2266-44df-a3b1-856b4f981d23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:17.765331 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500562c0-2266-44df-a3b1-856b4f981d23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:17.766826 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500562c0-2266-44df-a3b1-856b4f981d23 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:17.777949 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1089/2189] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:26:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:26:17.790008 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f3286f45-ecd4-40bf-b785-b805d9229358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab0194db873a441696f7e985a3b6c47c', 'request_id': 'req-f3286f45-ecd4-40bf-b785-b805d9229358'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:17.797208 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f3286f45-ecd4-40bf-b785-b805d9229358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab0194db873a441696f7e985a3b6c47c', 'request_id': 'req-f3286f45-ecd4-40bf-b785-b805d9229358'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:17.798582 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:17.805057 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f3286f45-ecd4-40bf-b785-b805d9229358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab0194db873a441696f7e985a3b6c47c', 'request_id': 'req-f3286f45-ecd4-40bf-b785-b805d9229358'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:17.819347 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f3286f45-ecd4-40bf-b785-b805d9229358 admin admin] The token cache is being invalidate because project ab0194db873a441696f7e985a3b6c47c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:26:17.819640 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f3286f45-ecd4-40bf-b785-b805d9229358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:17.820461 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f3286f45-ecd4-40bf-b785-b805d9229358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:17.822069 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1101/2190] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:26:17 2022] DELETE /identity/v3/projects/ab0194db873a441696f7e985a3b6c47c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:17.827621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d314d5-17ce-44ce-bc17-efa3d4a1ec24 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:17.827915 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d314d5-17ce-44ce-bc17-efa3d4a1ec24 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:17.828217 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d314d5-17ce-44ce-bc17-efa3d4a1ec24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:17.850433 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f5d314d5-17ce-44ce-bc17-efa3d4a1ec24 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:17.851721 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f5d314d5-17ce-44ce-bc17-efa3d4a1ec24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:17.920190 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1090/2191] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:17.927731 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249d6f2-ba03-47e4-9f37-a8bf405e51f4 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:17.928065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249d6f2-ba03-47e4-9f37-a8bf405e51f4 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:17.928347 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7249d6f2-ba03-47e4-9f37-a8bf405e51f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:17.948954 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-7249d6f2-ba03-47e4-9f37-a8bf405e51f4 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:17.950161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-7249d6f2-ba03-47e4-9f37-a8bf405e51f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:17.958216 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1102/2192] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:17.963098 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d314d5-17ce-44ce-bc17-efa3d4a1ec24 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:17.978481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d314d5-17ce-44ce-bc17-efa3d4a1ec24 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:17.985273 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b50083-6926-4401-9e2c-c7bfc67db54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:17.985998 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b50083-6926-4401-9e2c-c7bfc67db54a admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:17.986355 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b50083-6926-4401-9e2c-c7bfc67db54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:17.986703 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b50083-6926-4401-9e2c-c7bfc67db54a admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:17.987487 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b50083-6926-4401-9e2c-c7bfc67db54a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:26:17.987867 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b50083-6926-4401-9e2c-c7bfc67db54a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:17.989775 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b50083-6926-4401-9e2c-c7bfc67db54a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:18.002601 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1091/2193] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:26:18.007024 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249d6f2-ba03-47e4-9f37-a8bf405e51f4 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:18.017188 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7249d6f2-ba03-47e4-9f37-a8bf405e51f4 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:18.023300 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b712813-3c59-454e-94ba-e187d12cf913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:18.023931 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b712813-3c59-454e-94ba-e187d12cf913 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:18.024414 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b712813-3c59-454e-94ba-e187d12cf913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:18.024718 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b712813-3c59-454e-94ba-e187d12cf913 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:18.025971 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b712813-3c59-454e-94ba-e187d12cf913 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:18.027888 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b712813-3c59-454e-94ba-e187d12cf913 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:18.058643 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1103/2194] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:26:18 2022] POST /identity/v3/projects => generated 357 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:26:18.063271 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b50083-6926-4401-9e2c-c7bfc67db54a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:18.071198 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b712813-3c59-454e-94ba-e187d12cf913 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:18.073710 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-0b712813-3c59-454e-94ba-e187d12cf913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:18.077928 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b50083-6926-4401-9e2c-c7bfc67db54a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:18.137327 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:18.151932 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b712813-3c59-454e-94ba-e187d12cf913 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:18.163798 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f270af-8c82-462e-97ef-d11fff16bd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:18.164621 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f270af-8c82-462e-97ef-d11fff16bd9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:18.164995 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f270af-8c82-462e-97ef-d11fff16bd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:18.165333 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f270af-8c82-462e-97ef-d11fff16bd9d admin admin] PATH_INFO: `/v3/projects/7ba3a8f553684bad8c2335a102c615e6` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:18.166842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f270af-8c82-462e-97ef-d11fff16bd9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ba3a8f553684bad8c2335a102c615e6)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:18.169037 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f270af-8c82-462e-97ef-d11fff16bd9d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:18.170390 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74339149-b673-4f85-aaad-920752e80033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:18.170946 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74339149-b673-4f85-aaad-920752e80033 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:18.171227 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74339149-b673-4f85-aaad-920752e80033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:18.171500 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74339149-b673-4f85-aaad-920752e80033 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:18.172212 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74339149-b673-4f85-aaad-920752e80033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:18.174258 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74339149-b673-4f85-aaad-920752e80033 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:18.218632 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1092/2195] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:26:18 2022] POST /identity/v3/users => generated 279 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:26:18.222458 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74339149-b673-4f85-aaad-920752e80033 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:18.231029 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e2f270af-8c82-462e-97ef-d11fff16bd9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ba3a8f553684bad8c2335a102c615e6', 'request_id': 'req-e2f270af-8c82-462e-97ef-d11fff16bd9d'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:18.237659 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e2f270af-8c82-462e-97ef-d11fff16bd9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ba3a8f553684bad8c2335a102c615e6', 'request_id': 'req-e2f270af-8c82-462e-97ef-d11fff16bd9d'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:18.243513 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e2f270af-8c82-462e-97ef-d11fff16bd9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ba3a8f553684bad8c2335a102c615e6', 'request_id': 'req-e2f270af-8c82-462e-97ef-d11fff16bd9d'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:18.247170 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74339149-b673-4f85-aaad-920752e80033 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:18.261890 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e2f270af-8c82-462e-97ef-d11fff16bd9d admin admin] The token cache is being invalidate because project 7ba3a8f553684bad8c2335a102c615e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:26:18.262823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e2f270af-8c82-462e-97ef-d11fff16bd9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:18.263730 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e2f270af-8c82-462e-97ef-d11fff16bd9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:18.268074 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1104/2196] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:26:18 2022] DELETE /identity/v3/projects/7ba3a8f553684bad8c2335a102c615e6 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:26:18.270608 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f270af-8c82-462e-97ef-d11fff16bd9d admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:18.273313 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e2f270af-8c82-462e-97ef-d11fff16bd9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:18.315453 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47c714-9796-4930-a2d7-24b5a399bebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:18.316226 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47c714-9796-4930-a2d7-24b5a399bebf admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:18.316509 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47c714-9796-4930-a2d7-24b5a399bebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:18.316787 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc47c714-9796-4930-a2d7-24b5a399bebf admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:18.317486 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47c714-9796-4930-a2d7-24b5a399bebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:18.319081 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc47c714-9796-4930-a2d7-24b5a399bebf admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:18.331540 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1093/2197] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 15:26:18.334207 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:18.335580 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47c714-9796-4930-a2d7-24b5a399bebf admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:18.337570 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bc47c714-9796-4930-a2d7-24b5a399bebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:18.351113 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc47c714-9796-4930-a2d7-24b5a399bebf admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:18.357483 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb194e6-9908-455c-96c2-df7b257fc48f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:18.357984 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f270af-8c82-462e-97ef-d11fff16bd9d admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:18.358115 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb194e6-9908-455c-96c2-df7b257fc48f admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:18.358375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb194e6-9908-455c-96c2-df7b257fc48f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:18.358840 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb194e6-9908-455c-96c2-df7b257fc48f admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:18.359546 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb194e6-9908-455c-96c2-df7b257fc48f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:18.361166 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb194e6-9908-455c-96c2-df7b257fc48f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:18.363799 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c79c97-53a8-4fe5-a666-12402b56faf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:18.364596 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c79c97-53a8-4fe5-a666-12402b56faf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:18.364880 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c79c97-53a8-4fe5-a666-12402b56faf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:18.365156 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c79c97-53a8-4fe5-a666-12402b56faf9 admin admin] PATH_INFO: `/v3/users/c7fb6ca7a00e49c2a00ebd055a03d265` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:18.366345 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c79c97-53a8-4fe5-a666-12402b56faf9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7fb6ca7a00e49c2a00ebd055a03d265)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:18.369035 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c79c97-53a8-4fe5-a666-12402b56faf9 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:18.378871 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1094/2198] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:26:18.383266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb194e6-9908-455c-96c2-df7b257fc48f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:18.394707 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb194e6-9908-455c-96c2-df7b257fc48f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:18.402267 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93c3123-77ff-4e63-9c59-693916d375c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:18.403665 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c3123-77ff-4e63-9c59-693916d375c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:18.403863 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c3123-77ff-4e63-9c59-693916d375c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:18.404229 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93c3123-77ff-4e63-9c59-693916d375c0 admin admin] PATH_INFO: `/v3/projects/b12306355f9f40a98f86555f6927974d/users/ab09e5669d4f4cfca875654e41325d58/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:18.422960 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c3123-77ff-4e63-9c59-693916d375c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b12306355f9f40a98f86555f6927974d, user_id=ab09e5669d4f4cfca875654e41325d58, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:18.426580 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93c3123-77ff-4e63-9c59-693916d375c0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:18.459013 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1095/2199] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:26:18 2022] PUT /identity/v3/projects/b12306355f9f40a98f86555f6927974d/users/ab09e5669d4f4cfca875654e41325d58/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:18.462179 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62008a-035e-4b7c-8e18-6dd810ba4c0f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:18.462521 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62008a-035e-4b7c-8e18-6dd810ba4c0f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:18.462794 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b62008a-035e-4b7c-8e18-6dd810ba4c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:18.466636 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b4c79c97-53a8-4fe5-a666-12402b56faf9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7fb6ca7a00e49c2a00ebd055a03d265'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:18.468938 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b4c79c97-53a8-4fe5-a666-12402b56faf9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7fb6ca7a00e49c2a00ebd055a03d265'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:18.487159 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b4c79c97-53a8-4fe5-a666-12402b56faf9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7fb6ca7a00e49c2a00ebd055a03d265'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:18.500043 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b4c79c97-53a8-4fe5-a666-12402b56faf9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7fb6ca7a00e49c2a00ebd055a03d265'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:18.527368 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b4c79c97-53a8-4fe5-a666-12402b56faf9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7fb6ca7a00e49c2a00ebd055a03d265'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:18.533287 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-2b62008a-035e-4b7c-8e18-6dd810ba4c0f None None] MFA Rules not processed for user `ab09e5669d4f4cfca875654e41325d58`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:18.534558 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2b62008a-035e-4b7c-8e18-6dd810ba4c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:18.538710 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1105/2200] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:26:18 2022] DELETE /identity/v3/users/c7fb6ca7a00e49c2a00ebd055a03d265 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:26:18.646746 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c79c97-53a8-4fe5-a666-12402b56faf9 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:18.647530 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1096/2201] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:18 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:26:18.648659 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b4c79c97-53a8-4fe5-a666-12402b56faf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:18.724298 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c79c97-53a8-4fe5-a666-12402b56faf9 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:18.730642 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478adb9c-7e7a-4a84-b1ce-387a2b372e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:18.730642 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478adb9c-7e7a-4a84-b1ce-387a2b372e61 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:18.731073 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478adb9c-7e7a-4a84-b1ce-387a2b372e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:18.731539 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478adb9c-7e7a-4a84-b1ce-387a2b372e61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:18.732310 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478adb9c-7e7a-4a84-b1ce-387a2b372e61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:18.734497 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478adb9c-7e7a-4a84-b1ce-387a2b372e61 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:18.770624 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1106/2202] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:26:18 2022] POST /identity/v3/projects => generated 357 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:26:18.774710 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62008a-035e-4b7c-8e18-6dd810ba4c0f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:18.788863 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:18.849597 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b62008a-035e-4b7c-8e18-6dd810ba4c0f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:18.878735 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478adb9c-7e7a-4a84-b1ce-387a2b372e61 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:18.880745 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-478adb9c-7e7a-4a84-b1ce-387a2b372e61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:18.914751 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de2de8-3778-43b7-8b04-4bdd4e5c8736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:18.915009 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de2de8-3778-43b7-8b04-4bdd4e5c8736 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:18.915321 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de2de8-3778-43b7-8b04-4bdd4e5c8736 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:18.916145 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de2de8-3778-43b7-8b04-4bdd4e5c8736 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:18.917112 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de2de8-3778-43b7-8b04-4bdd4e5c8736 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:18.919229 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7de2de8-3778-43b7-8b04-4bdd4e5c8736 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:18.943892 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1097/2203] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:26:18 2022] POST /identity/v3/users => generated 285 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:26:18.944443 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:18.946939 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de2de8-3778-43b7-8b04-4bdd4e5c8736 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:18.958405 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de2de8-3778-43b7-8b04-4bdd4e5c8736 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:18.961849 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478adb9c-7e7a-4a84-b1ce-387a2b372e61 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:18.963498 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53906c56-7bab-4204-845a-78542f0ef920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:18.964223 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53906c56-7bab-4204-845a-78542f0ef920 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:18.964608 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53906c56-7bab-4204-845a-78542f0ef920 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:18.964783 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53906c56-7bab-4204-845a-78542f0ef920 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:18.965736 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53906c56-7bab-4204-845a-78542f0ef920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:18.967460 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53906c56-7bab-4204-845a-78542f0ef920 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:18.968265 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bd6a2-c89f-42ea-8a4b-836178f67447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:18.968923 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bd6a2-c89f-42ea-8a4b-836178f67447 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:18.969201 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bd6a2-c89f-42ea-8a4b-836178f67447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:18.969516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3bd6a2-c89f-42ea-8a4b-836178f67447 admin admin] PATH_INFO: `/v3/projects/59cfdbb4c16443f380824b16c9b8794f` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:18.970708 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3bd6a2-c89f-42ea-8a4b-836178f67447 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59cfdbb4c16443f380824b16c9b8794f)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:18.972658 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3bd6a2-c89f-42ea-8a4b-836178f67447 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:18.982104 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1098/2204] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:26:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:26:18.982975 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53906c56-7bab-4204-845a-78542f0ef920 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:18.992991 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53906c56-7bab-4204-845a-78542f0ef920 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:18.999468 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888c020-aab7-4148-8428-b828d95f6bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:19.000566 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888c020-aab7-4148-8428-b828d95f6bb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:19.000881 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888c020-aab7-4148-8428-b828d95f6bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:19.001162 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3888c020-aab7-4148-8428-b828d95f6bb1 admin admin] PATH_INFO: `/v3/projects/9faaf2f5d5fd49c78d17eb55235e6fad/users/ada120e049354ce2a76e2feb48fad8eb/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:19.019889 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3888c020-aab7-4148-8428-b828d95f6bb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9faaf2f5d5fd49c78d17eb55235e6fad, user_id=ada120e049354ce2a76e2feb48fad8eb, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:19.023163 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3888c020-aab7-4148-8428-b828d95f6bb1 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:19.031529 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2c3bd6a2-c89f-42ea-8a4b-836178f67447 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59cfdbb4c16443f380824b16c9b8794f', 'request_id': 'req-2c3bd6a2-c89f-42ea-8a4b-836178f67447'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:19.038763 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2c3bd6a2-c89f-42ea-8a4b-836178f67447 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59cfdbb4c16443f380824b16c9b8794f', 'request_id': 'req-2c3bd6a2-c89f-42ea-8a4b-836178f67447'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:19.044341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1099/2205] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:26:18 2022] PUT /identity/v3/projects/9faaf2f5d5fd49c78d17eb55235e6fad/users/ada120e049354ce2a76e2feb48fad8eb/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:19.045206 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888c020-aab7-4148-8428-b828d95f6bb1 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:19.047493 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2c3bd6a2-c89f-42ea-8a4b-836178f67447 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59cfdbb4c16443f380824b16c9b8794f', 'request_id': 'req-2c3bd6a2-c89f-42ea-8a4b-836178f67447'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:19.064003 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2c3bd6a2-c89f-42ea-8a4b-836178f67447 admin admin] The token cache is being invalidate because project 59cfdbb4c16443f380824b16c9b8794f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:26:19.064421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2c3bd6a2-c89f-42ea-8a4b-836178f67447 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:19.065151 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2c3bd6a2-c89f-42ea-8a4b-836178f67447 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:19.067656 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1107/2206] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:26:18 2022] DELETE /identity/v3/projects/59cfdbb4c16443f380824b16c9b8794f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:26:19.071415 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bd6a2-c89f-42ea-8a4b-836178f67447 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:19.073033 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-2c3bd6a2-c89f-42ea-8a4b-836178f67447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:19.114790 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3888c020-aab7-4148-8428-b828d95f6bb1 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:19.119916 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb4fa5-d80f-4279-8323-b17f717214d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:19.120716 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb4fa5-d80f-4279-8323-b17f717214d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:19.120980 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb4fa5-d80f-4279-8323-b17f717214d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:19.121644 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fb4fa5-d80f-4279-8323-b17f717214d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:19.122471 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb4fa5-d80f-4279-8323-b17f717214d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:19.124130 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fb4fa5-d80f-4279-8323-b17f717214d8 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:19.135494 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1100/2207] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:26:19 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:26:19.139919 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb4fa5-d80f-4279-8323-b17f717214d8 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:19.140834 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3bd6a2-c89f-42ea-8a4b-836178f67447 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:19.143537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-36fb4fa5-d80f-4279-8323-b17f717214d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:19.147282 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12b7b2-7882-42fe-90df-94b4ac918457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:19.148049 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12b7b2-7882-42fe-90df-94b4ac918457 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:19.148536 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12b7b2-7882-42fe-90df-94b4ac918457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:19.148888 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac12b7b2-7882-42fe-90df-94b4ac918457 admin admin] PATH_INFO: `/v3/users/f1caaf54ec424324ae5bd0fd4789012e` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:19.151046 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac12b7b2-7882-42fe-90df-94b4ac918457 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1caaf54ec424324ae5bd0fd4789012e)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:19.153148 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac12b7b2-7882-42fe-90df-94b4ac918457 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:19.160776 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fb4fa5-d80f-4279-8323-b17f717214d8 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:19.167567 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73d4f0-5b5f-40be-95cd-82bf6c280972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:19.168710 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73d4f0-5b5f-40be-95cd-82bf6c280972 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:19.169182 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73d4f0-5b5f-40be-95cd-82bf6c280972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:19.169733 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73d4f0-5b5f-40be-95cd-82bf6c280972 admin admin] PATH_INFO: `/v3/projects/9faaf2f5d5fd49c78d17eb55235e6fad/users/ada120e049354ce2a76e2feb48fad8eb/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:19.172688 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73d4f0-5b5f-40be-95cd-82bf6c280972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9faaf2f5d5fd49c78d17eb55235e6fad, user_id=ada120e049354ce2a76e2feb48fad8eb, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:19.176446 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73d4f0-5b5f-40be-95cd-82bf6c280972 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:19.180207 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:19.204168 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1101/2208] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:26:19 2022] PUT /identity/v3/projects/9faaf2f5d5fd49c78d17eb55235e6fad/users/ada120e049354ce2a76e2feb48fad8eb/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:19.210029 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab5e68-91e3-4931-afa4-c35a0a8dd3d7 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:19.210433 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab5e68-91e3-4931-afa4-c35a0a8dd3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:19.210881 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab5e68-91e3-4931-afa4-c35a0a8dd3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:19.231524 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ac12b7b2-7882-42fe-90df-94b4ac918457 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1caaf54ec424324ae5bd0fd4789012e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:19.232861 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ac12b7b2-7882-42fe-90df-94b4ac918457 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1caaf54ec424324ae5bd0fd4789012e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:19.242880 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ac12b7b2-7882-42fe-90df-94b4ac918457 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1caaf54ec424324ae5bd0fd4789012e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:19.251512 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-7aab5e68-91e3-4931-afa4-c35a0a8dd3d7 None None] MFA Rules not processed for user `ada120e049354ce2a76e2feb48fad8eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:19.252568 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7aab5e68-91e3-4931-afa4-c35a0a8dd3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:19.254897 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ac12b7b2-7882-42fe-90df-94b4ac918457 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1caaf54ec424324ae5bd0fd4789012e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:19.294112 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ac12b7b2-7882-42fe-90df-94b4ac918457 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1caaf54ec424324ae5bd0fd4789012e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:19.296456 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:19.307641 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1108/2209] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:26:19 2022] DELETE /identity/v3/users/f1caaf54ec424324ae5bd0fd4789012e => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:26:19.359903 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1102/2210] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:19 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:19.371870 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12b7b2-7882-42fe-90df-94b4ac918457 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:19.373412 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ac12b7b2-7882-42fe-90df-94b4ac918457 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:19.442014 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac12b7b2-7882-42fe-90df-94b4ac918457 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:19.445927 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cf849-ba73-44e9-a5aa-1398988382a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:19.446656 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cf849-ba73-44e9-a5aa-1398988382a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:19.447000 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cf849-ba73-44e9-a5aa-1398988382a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:19.448315 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cf849-ba73-44e9-a5aa-1398988382a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:19.546076 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3cf849-ba73-44e9-a5aa-1398988382a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:19.548750 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3cf849-ba73-44e9-a5aa-1398988382a4 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:19.565360 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1109/2211] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:26:19 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 15:26:19.648425 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab5e68-91e3-4931-afa4-c35a0a8dd3d7 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:19.689683 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cf849-ba73-44e9-a5aa-1398988382a4 service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:19.691428 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9a3cf849-ba73-44e9-a5aa-1398988382a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:19.726491 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aab5e68-91e3-4931-afa4-c35a0a8dd3d7 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:19.731008 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc750c-1ded-458b-800a-c8bc4bd0a9ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:19.731770 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc750c-1ded-458b-800a-c8bc4bd0a9ee service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:19.731960 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc750c-1ded-458b-800a-c8bc4bd0a9ee service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:19.732346 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc750c-1ded-458b-800a-c8bc4bd0a9ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:19.734156 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-11fc750c-1ded-458b-800a-c8bc4bd0a9ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:19.782433 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cf849-ba73-44e9-a5aa-1398988382a4 service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:19.789164 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222f6ca2-79cb-41ee-9eff-600537a3b862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:19.791933 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f6ca2-79cb-41ee-9eff-600537a3b862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:19.792400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f6ca2-79cb-41ee-9eff-600537a3b862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:19.792753 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f6ca2-79cb-41ee-9eff-600537a3b862 admin admin] PATH_INFO: `/v3/projects/be903323fed24a8493bf3babebf4dea3` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:19.794100 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f6ca2-79cb-41ee-9eff-600537a3b862 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be903323fed24a8493bf3babebf4dea3)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:19.796096 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222f6ca2-79cb-41ee-9eff-600537a3b862 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:19.819423 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc750c-1ded-458b-800a-c8bc4bd0a9ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:19.821257 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc750c-1ded-458b-800a-c8bc4bd0a9ee service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:19.834183 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1103/2212] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:26:19 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:26:19.861407 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-222f6ca2-79cb-41ee-9eff-600537a3b862 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be903323fed24a8493bf3babebf4dea3', 'request_id': 'req-222f6ca2-79cb-41ee-9eff-600537a3b862'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:19.863023 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:19.870271 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-222f6ca2-79cb-41ee-9eff-600537a3b862 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be903323fed24a8493bf3babebf4dea3', 'request_id': 'req-222f6ca2-79cb-41ee-9eff-600537a3b862'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:19.879545 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-222f6ca2-79cb-41ee-9eff-600537a3b862 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be903323fed24a8493bf3babebf4dea3', 'request_id': 'req-222f6ca2-79cb-41ee-9eff-600537a3b862'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:19.896661 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-222f6ca2-79cb-41ee-9eff-600537a3b862 admin admin] The token cache is being invalidate because project be903323fed24a8493bf3babebf4dea3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:26:19.896867 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-222f6ca2-79cb-41ee-9eff-600537a3b862 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:19.897480 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-222f6ca2-79cb-41ee-9eff-600537a3b862 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:19.899107 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1110/2213] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:26:19 2022] DELETE /identity/v3/projects/be903323fed24a8493bf3babebf4dea3 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:26:19.906048 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba4650-aa6b-40ee-905b-6f549f3959b0 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:19.906341 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba4650-aa6b-40ee-905b-6f549f3959b0 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:19.906619 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba4650-aa6b-40ee-905b-6f549f3959b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:19.928873 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-32ba4650-aa6b-40ee-905b-6f549f3959b0 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:19.930082 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-32ba4650-aa6b-40ee-905b-6f549f3959b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:19.964255 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:20.002178 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1104/2214] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:26:20.013801 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81add408-d367-467d-9562-d065574069f0 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:20.014089 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81add408-d367-467d-9562-d065574069f0 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:20.014369 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81add408-d367-467d-9562-d065574069f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:20.034359 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-81add408-d367-467d-9562-d065574069f0 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:20.035553 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-81add408-d367-467d-9562-d065574069f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:20.044321 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1111/2215] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:26:20.048461 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba4650-aa6b-40ee-905b-6f549f3959b0 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:20.058074 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba4650-aa6b-40ee-905b-6f549f3959b0 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:20.062677 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83a9e7-3848-4408-b61d-721a1ccfaabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:20.063277 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83a9e7-3848-4408-b61d-721a1ccfaabe admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:20.063558 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83a9e7-3848-4408-b61d-721a1ccfaabe admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:20.063833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83a9e7-3848-4408-b61d-721a1ccfaabe admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:20.064563 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83a9e7-3848-4408-b61d-721a1ccfaabe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:26:20.064868 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83a9e7-3848-4408-b61d-721a1ccfaabe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:20.066519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83a9e7-3848-4408-b61d-721a1ccfaabe admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:20.078826 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1105/2216] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:26:20.083102 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81add408-d367-467d-9562-d065574069f0 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:20.093137 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81add408-d367-467d-9562-d065574069f0 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:20.097818 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6db1e-4d81-4aac-9277-474a08d4afde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:20.098420 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6db1e-4d81-4aac-9277-474a08d4afde admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:20.098699 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6db1e-4d81-4aac-9277-474a08d4afde admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:20.098982 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6db1e-4d81-4aac-9277-474a08d4afde admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:20.099639 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6db1e-4d81-4aac-9277-474a08d4afde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:20.101628 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6db1e-4d81-4aac-9277-474a08d4afde admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:20.129417 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1112/2217] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:26:20 2022] POST /identity/v3/projects => generated 401 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:26:20.133557 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83a9e7-3848-4408-b61d-721a1ccfaabe admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:20.143913 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83a9e7-3848-4408-b61d-721a1ccfaabe admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:20.213265 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172b8dc-e148-4a46-8415-c59d8515a93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:20.213932 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172b8dc-e148-4a46-8415-c59d8515a93c admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:20.214240 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172b8dc-e148-4a46-8415-c59d8515a93c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:20.214492 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172b8dc-e148-4a46-8415-c59d8515a93c admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:20.215190 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172b8dc-e148-4a46-8415-c59d8515a93c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:20.217234 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172b8dc-e148-4a46-8415-c59d8515a93c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:20.241971 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1106/2218] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:26:20 2022] POST /identity/v3/users => generated 301 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:26:20.246055 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6db1e-4d81-4aac-9277-474a08d4afde admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:20.256908 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6db1e-4d81-4aac-9277-474a08d4afde admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:20.262552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687c916-d1d1-4e77-8185-ae83559a1666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:20.263167 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687c916-d1d1-4e77-8185-ae83559a1666 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:20.263452 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687c916-d1d1-4e77-8185-ae83559a1666 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:20.263750 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3687c916-d1d1-4e77-8185-ae83559a1666 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:20.264481 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687c916-d1d1-4e77-8185-ae83559a1666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:20.266165 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3687c916-d1d1-4e77-8185-ae83559a1666 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:20.277231 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1113/2219] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 15:26:20.281168 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172b8dc-e148-4a46-8415-c59d8515a93c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:20.291163 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172b8dc-e148-4a46-8415-c59d8515a93c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:20.296073 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09561870-6e15-4459-b6c2-ab161c37a10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:20.296678 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09561870-6e15-4459-b6c2-ab161c37a10a admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:20.296993 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09561870-6e15-4459-b6c2-ab161c37a10a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:20.297345 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09561870-6e15-4459-b6c2-ab161c37a10a admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:20.298140 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09561870-6e15-4459-b6c2-ab161c37a10a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:20.299729 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09561870-6e15-4459-b6c2-ab161c37a10a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:20.310294 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1107/2220] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:26:20.314294 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687c916-d1d1-4e77-8185-ae83559a1666 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:20.324870 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3687c916-d1d1-4e77-8185-ae83559a1666 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:20.329793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f98e3-df88-486c-b245-cb2777c566a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:20.330455 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f98e3-df88-486c-b245-cb2777c566a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:20.330754 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f98e3-df88-486c-b245-cb2777c566a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:20.331024 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f98e3-df88-486c-b245-cb2777c566a2 admin admin] PATH_INFO: `/v3/projects/4db06d1bec0f419496664f5b2130aba3/users/7eea0247c865463790e5a5f5d42d83f7/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:20.347079 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f98e3-df88-486c-b245-cb2777c566a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4db06d1bec0f419496664f5b2130aba3, user_id=7eea0247c865463790e5a5f5d42d83f7, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:20.350022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f98e3-df88-486c-b245-cb2777c566a2 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:20.362164 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1114/2221] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:26:20 2022] PUT /identity/v3/projects/4db06d1bec0f419496664f5b2130aba3/users/7eea0247c865463790e5a5f5d42d83f7/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:20.374087 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082111f-1243-4ee7-92a3-96d741c595ef None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:20.374539 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082111f-1243-4ee7-92a3-96d741c595ef None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:20.374904 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9082111f-1243-4ee7-92a3-96d741c595ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:20.403459 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9082111f-1243-4ee7-92a3-96d741c595ef None None] MFA Rules not processed for user `7eea0247c865463790e5a5f5d42d83f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:20.404729 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9082111f-1243-4ee7-92a3-96d741c595ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:20.471195 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1108/2222] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:20.475812 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f98e3-df88-486c-b245-cb2777c566a2 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:20.572950 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f98e3-df88-486c-b245-cb2777c566a2 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:20.600182 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fda34-7387-40d9-90a7-72d16266334b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:20.600182 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fda34-7387-40d9-90a7-72d16266334b admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:20.600182 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fda34-7387-40d9-90a7-72d16266334b admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:20.600182 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27fda34-7387-40d9-90a7-72d16266334b admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:20.601024 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27fda34-7387-40d9-90a7-72d16266334b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:20.601024 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27fda34-7387-40d9-90a7-72d16266334b admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:20.626049 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1115/2223] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:26:20 2022] POST /identity/v3/projects => generated 401 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:26:20.630107 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082111f-1243-4ee7-92a3-96d741c595ef None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:20.641922 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9082111f-1243-4ee7-92a3-96d741c595ef None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:20.673802 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:20.706004 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076e2c7-ffc7-4f58-b165-b2388d8ec9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:20.706725 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076e2c7-ffc7-4f58-b165-b2388d8ec9ea admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:20.707016 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076e2c7-ffc7-4f58-b165-b2388d8ec9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:20.707279 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f076e2c7-ffc7-4f58-b165-b2388d8ec9ea admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:20.708122 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076e2c7-ffc7-4f58-b165-b2388d8ec9ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:20.710671 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f076e2c7-ffc7-4f58-b165-b2388d8ec9ea admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:20.736032 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1109/2224] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:26:20 2022] POST /identity/v3/users => generated 307 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:26:20.737179 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fda34-7387-40d9-90a7-72d16266334b admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:20.747767 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27fda34-7387-40d9-90a7-72d16266334b admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:20.752303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56393770-40a3-465a-b602-4d01ec27f581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:20.752952 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56393770-40a3-465a-b602-4d01ec27f581 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:20.753234 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56393770-40a3-465a-b602-4d01ec27f581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:20.753506 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56393770-40a3-465a-b602-4d01ec27f581 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:20.754220 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56393770-40a3-465a-b602-4d01ec27f581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:20.755794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56393770-40a3-465a-b602-4d01ec27f581 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:20.767597 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1116/2225] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:26:20.771784 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076e2c7-ffc7-4f58-b165-b2388d8ec9ea admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:20.781886 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f076e2c7-ffc7-4f58-b165-b2388d8ec9ea admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:20.786575 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df21d1-e826-4dfc-98b2-3265b70f54bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:20.787223 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df21d1-e826-4dfc-98b2-3265b70f54bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:20.787507 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df21d1-e826-4dfc-98b2-3265b70f54bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:20.787783 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df21d1-e826-4dfc-98b2-3265b70f54bf admin admin] PATH_INFO: `/v3/projects/c8cc4be77a2240149d0338a02d382baf/users/c56a10ecee4742f3bb2a9bbbf16c84ef/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:20.803641 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df21d1-e826-4dfc-98b2-3265b70f54bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8cc4be77a2240149d0338a02d382baf, user_id=c56a10ecee4742f3bb2a9bbbf16c84ef, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:20.806862 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2df21d1-e826-4dfc-98b2-3265b70f54bf admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:20.821159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1110/2226] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:26:20 2022] PUT /identity/v3/projects/c8cc4be77a2240149d0338a02d382baf/users/c56a10ecee4742f3bb2a9bbbf16c84ef/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:20.825771 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56393770-40a3-465a-b602-4d01ec27f581 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:20.835721 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56393770-40a3-465a-b602-4d01ec27f581 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:20.887400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:20.903200 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86b04b7-37bc-4a4a-a310-65a035d44032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:20.903821 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b04b7-37bc-4a4a-a310-65a035d44032 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:20.904137 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b04b7-37bc-4a4a-a310-65a035d44032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:20.904414 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86b04b7-37bc-4a4a-a310-65a035d44032 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:20.905120 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86b04b7-37bc-4a4a-a310-65a035d44032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:20.906832 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86b04b7-37bc-4a4a-a310-65a035d44032 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:20.921279 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1117/2227] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 15:26:20.922658 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df21d1-e826-4dfc-98b2-3265b70f54bf admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:20.934233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df21d1-e826-4dfc-98b2-3265b70f54bf admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:20.940860 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295c6da-4fea-4526-b8c9-4bc7b4abc7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:20.941594 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295c6da-4fea-4526-b8c9-4bc7b4abc7be admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:20.942118 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295c6da-4fea-4526-b8c9-4bc7b4abc7be admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:20.942292 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295c6da-4fea-4526-b8c9-4bc7b4abc7be admin admin] PATH_INFO: `/v3/projects/c8cc4be77a2240149d0338a02d382baf/users/c56a10ecee4742f3bb2a9bbbf16c84ef/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:20.964289 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295c6da-4fea-4526-b8c9-4bc7b4abc7be admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8cc4be77a2240149d0338a02d382baf, user_id=c56a10ecee4742f3bb2a9bbbf16c84ef, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:20.965748 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3295c6da-4fea-4526-b8c9-4bc7b4abc7be admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:20.989035 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1111/2228] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:26:20 2022] PUT /identity/v3/projects/c8cc4be77a2240149d0338a02d382baf/users/c56a10ecee4742f3bb2a9bbbf16c84ef/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:26:20.999967 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f89ce3-8f32-45e6-b64c-37cf77f3ef4c None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:21.000226 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f89ce3-8f32-45e6-b64c-37cf77f3ef4c None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:21.000505 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f89ce3-8f32-45e6-b64c-37cf77f3ef4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:21.067872 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-30f89ce3-8f32-45e6-b64c-37cf77f3ef4c None None] MFA Rules not processed for user `c56a10ecee4742f3bb2a9bbbf16c84ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:21.069317 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-30f89ce3-8f32-45e6-b64c-37cf77f3ef4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:21.156125 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1118/2229] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:20 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:21.212736 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295c6da-4fea-4526-b8c9-4bc7b4abc7be admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:21.215202 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3295c6da-4fea-4526-b8c9-4bc7b4abc7be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:21.297197 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295c6da-4fea-4526-b8c9-4bc7b4abc7be admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:21.300853 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22454fc-e2cb-476b-9aea-2c6d5bd8f4c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:21.301476 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22454fc-e2cb-476b-9aea-2c6d5bd8f4c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:21.301757 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22454fc-e2cb-476b-9aea-2c6d5bd8f4c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:21.302031 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22454fc-e2cb-476b-9aea-2c6d5bd8f4c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:21.312022 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22454fc-e2cb-476b-9aea-2c6d5bd8f4c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:21.314011 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22454fc-e2cb-476b-9aea-2c6d5bd8f4c2 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:21.324541 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1112/2230] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:26:21 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:26:21.401963 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f89ce3-8f32-45e6-b64c-37cf77f3ef4c None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:21.411365 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f89ce3-8f32-45e6-b64c-37cf77f3ef4c None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:21.414836 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ff099b-d28f-45a0-a565-a85395aad675 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:21.416193 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff099b-d28f-45a0-a565-a85395aad675 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:21.416730 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff099b-d28f-45a0-a565-a85395aad675 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:21.417001 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ff099b-d28f-45a0-a565-a85395aad675 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:21.472283 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff099b-d28f-45a0-a565-a85395aad675 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:21.473705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ff099b-d28f-45a0-a565-a85395aad675 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:21.483058 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1119/2231] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:26:21 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:26:26.727704 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22454fc-e2cb-476b-9aea-2c6d5bd8f4c2 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:26.792623 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22454fc-e2cb-476b-9aea-2c6d5bd8f4c2 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:26.797174 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189f399-02a6-4702-b194-d4d3c403751b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:26.797811 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189f399-02a6-4702-b194-d4d3c403751b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:26.798090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189f399-02a6-4702-b194-d4d3c403751b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:26.798362 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0189f399-02a6-4702-b194-d4d3c403751b admin admin] PATH_INFO: `/v3/users/7eea0247c865463790e5a5f5d42d83f7` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:26.799552 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189f399-02a6-4702-b194-d4d3c403751b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eea0247c865463790e5a5f5d42d83f7)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:26.801475 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0189f399-02a6-4702-b194-d4d3c403751b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:26.837447 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:26.862321 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0189f399-02a6-4702-b194-d4d3c403751b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eea0247c865463790e5a5f5d42d83f7'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:26.862974 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0189f399-02a6-4702-b194-d4d3c403751b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eea0247c865463790e5a5f5d42d83f7'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:26.870609 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0189f399-02a6-4702-b194-d4d3c403751b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eea0247c865463790e5a5f5d42d83f7'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:26.871261 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0189f399-02a6-4702-b194-d4d3c403751b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eea0247c865463790e5a5f5d42d83f7'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:26.884201 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0189f399-02a6-4702-b194-d4d3c403751b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eea0247c865463790e5a5f5d42d83f7'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:26.900960 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1113/2232] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:26:26 2022] DELETE /identity/v3/users/7eea0247c865463790e5a5f5d42d83f7 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:26.902911 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5c8ba-606b-41f5-855c-9b7ee6a51d10 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:26.903459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5c8ba-606b-41f5-855c-9b7ee6a51d10 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:26.904020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5c8ba-606b-41f5-855c-9b7ee6a51d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:26.924023 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-5ff5c8ba-606b-41f5-855c-9b7ee6a51d10 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:26.925251 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5ff5c8ba-606b-41f5-855c-9b7ee6a51d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:26.987735 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1120/2233] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:26.997589 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189f399-02a6-4702-b194-d4d3c403751b admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:26.999060 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0189f399-02a6-4702-b194-d4d3c403751b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:27.060669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0189f399-02a6-4702-b194-d4d3c403751b admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:27.064453 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97240656-1907-4098-a90d-6b9f37bf8c69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:27.065071 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97240656-1907-4098-a90d-6b9f37bf8c69 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:27.065353 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97240656-1907-4098-a90d-6b9f37bf8c69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:27.065623 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97240656-1907-4098-a90d-6b9f37bf8c69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:27.074763 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97240656-1907-4098-a90d-6b9f37bf8c69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:27.076222 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97240656-1907-4098-a90d-6b9f37bf8c69 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:27.085863 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1114/2234] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:26:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:26:27.544523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5c8ba-606b-41f5-855c-9b7ee6a51d10 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:27.558327 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5ff5c8ba-606b-41f5-855c-9b7ee6a51d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:27.574056 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5c8ba-606b-41f5-855c-9b7ee6a51d10 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:27.605270 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f347f-023a-4cbc-b935-5d77d44579a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:27.606099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f347f-023a-4cbc-b935-5d77d44579a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:27.606494 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f347f-023a-4cbc-b935-5d77d44579a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:27.607531 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119f347f-023a-4cbc-b935-5d77d44579a9 admin admin] PATH_INFO: `/v3/projects/4db06d1bec0f419496664f5b2130aba3` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:27.612071 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f347f-023a-4cbc-b935-5d77d44579a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4db06d1bec0f419496664f5b2130aba3)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:27.612071 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119f347f-023a-4cbc-b935-5d77d44579a9 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:27.615360 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:27.698063 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-119f347f-023a-4cbc-b935-5d77d44579a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4db06d1bec0f419496664f5b2130aba3', 'request_id': 'req-119f347f-023a-4cbc-b935-5d77d44579a9'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:27.708675 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-119f347f-023a-4cbc-b935-5d77d44579a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4db06d1bec0f419496664f5b2130aba3', 'request_id': 'req-119f347f-023a-4cbc-b935-5d77d44579a9'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:27.734930 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-119f347f-023a-4cbc-b935-5d77d44579a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4db06d1bec0f419496664f5b2130aba3', 'request_id': 'req-119f347f-023a-4cbc-b935-5d77d44579a9'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:27.752669 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-119f347f-023a-4cbc-b935-5d77d44579a9 admin admin] The token cache is being invalidate because project 4db06d1bec0f419496664f5b2130aba3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:26:27.752961 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-119f347f-023a-4cbc-b935-5d77d44579a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:27.753888 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-119f347f-023a-4cbc-b935-5d77d44579a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:27.756526 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1121/2235] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:26:27 2022] DELETE /identity/v3/projects/4db06d1bec0f419496664f5b2130aba3 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:27.760974 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97240656-1907-4098-a90d-6b9f37bf8c69 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:27.772383 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97240656-1907-4098-a90d-6b9f37bf8c69 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:27.840332 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad2a3a-0b08-4145-9b30-df7deb3f0df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:27.841120 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad2a3a-0b08-4145-9b30-df7deb3f0df8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:27.841467 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad2a3a-0b08-4145-9b30-df7deb3f0df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:27.841778 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad2a3a-0b08-4145-9b30-df7deb3f0df8 admin admin] PATH_INFO: `/v3/users/c56a10ecee4742f3bb2a9bbbf16c84ef` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:27.842967 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad2a3a-0b08-4145-9b30-df7deb3f0df8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c56a10ecee4742f3bb2a9bbbf16c84ef)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:27.844925 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ad2a3a-0b08-4145-9b30-df7deb3f0df8 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:27.894927 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d0ad2a3a-0b08-4145-9b30-df7deb3f0df8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c56a10ecee4742f3bb2a9bbbf16c84ef'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:27.895609 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d0ad2a3a-0b08-4145-9b30-df7deb3f0df8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c56a10ecee4742f3bb2a9bbbf16c84ef'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:27.897677 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:27.904677 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d0ad2a3a-0b08-4145-9b30-df7deb3f0df8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c56a10ecee4742f3bb2a9bbbf16c84ef'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:27.905860 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d0ad2a3a-0b08-4145-9b30-df7deb3f0df8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c56a10ecee4742f3bb2a9bbbf16c84ef'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:27.920324 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d0ad2a3a-0b08-4145-9b30-df7deb3f0df8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c56a10ecee4742f3bb2a9bbbf16c84ef'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:27.933472 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1115/2236] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:26:27 2022] DELETE /identity/v3/users/c56a10ecee4742f3bb2a9bbbf16c84ef => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:28.287461 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f347f-023a-4cbc-b935-5d77d44579a9 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:28.289249 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-119f347f-023a-4cbc-b935-5d77d44579a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:28.305882 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119f347f-023a-4cbc-b935-5d77d44579a9 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:28.372356 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3c2d8-7b42-4481-a18e-e1d509e64d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:28.373391 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3c2d8-7b42-4481-a18e-e1d509e64d79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:28.373718 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3c2d8-7b42-4481-a18e-e1d509e64d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:28.374171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3c2d8-7b42-4481-a18e-e1d509e64d79 admin admin] PATH_INFO: `/v3/projects/c8cc4be77a2240149d0338a02d382baf` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:28.375331 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3c2d8-7b42-4481-a18e-e1d509e64d79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8cc4be77a2240149d0338a02d382baf)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:28.377707 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3c2d8-7b42-4481-a18e-e1d509e64d79 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:28.435982 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-77e3c2d8-7b42-4481-a18e-e1d509e64d79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8cc4be77a2240149d0338a02d382baf', 'request_id': 'req-77e3c2d8-7b42-4481-a18e-e1d509e64d79'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:28.443872 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-77e3c2d8-7b42-4481-a18e-e1d509e64d79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8cc4be77a2240149d0338a02d382baf', 'request_id': 'req-77e3c2d8-7b42-4481-a18e-e1d509e64d79'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:28.451140 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-77e3c2d8-7b42-4481-a18e-e1d509e64d79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8cc4be77a2240149d0338a02d382baf', 'request_id': 'req-77e3c2d8-7b42-4481-a18e-e1d509e64d79'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:28.467291 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-77e3c2d8-7b42-4481-a18e-e1d509e64d79 admin admin] The token cache is being invalidate because project c8cc4be77a2240149d0338a02d382baf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:26:28.467550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-77e3c2d8-7b42-4481-a18e-e1d509e64d79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:28.468334 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-77e3c2d8-7b42-4481-a18e-e1d509e64d79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:28.473607 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1122/2237] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:26:28 2022] DELETE /identity/v3/projects/c8cc4be77a2240149d0338a02d382baf => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:28.475210 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd439cb-a3c8-45e7-bae3-ba805517ecaf None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:28.475740 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd439cb-a3c8-45e7-bae3-ba805517ecaf None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:28.476076 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd439cb-a3c8-45e7-bae3-ba805517ecaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:28.500914 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-8bd439cb-a3c8-45e7-bae3-ba805517ecaf None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:28.502235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8bd439cb-a3c8-45e7-bae3-ba805517ecaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:28.594512 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7536e-72fe-47c6-bd3c-9cb8c08355c4 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:28.594864 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7536e-72fe-47c6-bd3c-9cb8c08355c4 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:28.595273 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f7536e-72fe-47c6-bd3c-9cb8c08355c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:28.599435 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1116/2238] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:26:28.625239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-68f7536e-72fe-47c6-bd3c-9cb8c08355c4 None None] MFA Rules not processed for user `4c5b5285ca70478ca580f7661663f522`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:28.626519 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-68f7536e-72fe-47c6-bd3c-9cb8c08355c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:28.652261 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:28.658103 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7db038-f408-403b-a515-8375745fa135 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:28.658391 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7db038-f408-403b-a515-8375745fa135 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:28.658679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7db038-f408-403b-a515-8375745fa135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:28.687128 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-bb7db038-f408-403b-a515-8375745fa135 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:28.688408 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bb7db038-f408-403b-a515-8375745fa135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:28.700032 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1117/2239] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:26:28.702087 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7db038-f408-403b-a515-8375745fa135 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:28.713540 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7db038-f408-403b-a515-8375745fa135 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:28.718671 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1123/2240] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:28.718794 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33752054-4b46-413e-8eeb-6a649c0e2a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:28.719388 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33752054-4b46-413e-8eeb-6a649c0e2a1b admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:28.719672 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33752054-4b46-413e-8eeb-6a649c0e2a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:28.719946 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33752054-4b46-413e-8eeb-6a649c0e2a1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:28.720689 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33752054-4b46-413e-8eeb-6a649c0e2a1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:26:28.721000 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33752054-4b46-413e-8eeb-6a649c0e2a1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:28.723068 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33752054-4b46-413e-8eeb-6a649c0e2a1b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:28.735914 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1118/2241] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:26:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:26:28.740619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7536e-72fe-47c6-bd3c-9cb8c08355c4 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:28.751886 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f7536e-72fe-47c6-bd3c-9cb8c08355c4 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:28.757601 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9c632-ce7d-4904-ad41-69c7177659c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:28.758205 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9c632-ce7d-4904-ad41-69c7177659c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:28.758490 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9c632-ce7d-4904-ad41-69c7177659c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:28.758814 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9c632-ce7d-4904-ad41-69c7177659c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:28.759480 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e9c632-ce7d-4904-ad41-69c7177659c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:28.761458 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e9c632-ce7d-4904-ad41-69c7177659c3 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:28.808089 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1124/2242] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:26:28 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:26:28.810545 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33752054-4b46-413e-8eeb-6a649c0e2a1b admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:28.825847 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33752054-4b46-413e-8eeb-6a649c0e2a1b admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:28.915464 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645e769-82e0-4cf4-a905-b1d7c9c4aaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:28.916273 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645e769-82e0-4cf4-a905-b1d7c9c4aaa2 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:28.917342 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645e769-82e0-4cf4-a905-b1d7c9c4aaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:28.917342 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645e769-82e0-4cf4-a905-b1d7c9c4aaa2 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:28.917906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5645e769-82e0-4cf4-a905-b1d7c9c4aaa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:28.919925 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5645e769-82e0-4cf4-a905-b1d7c9c4aaa2 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:28.948425 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1119/2243] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:26:28 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:26:28.952133 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9c632-ce7d-4904-ad41-69c7177659c3 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:28.965252 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e9c632-ce7d-4904-ad41-69c7177659c3 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:28.978207 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec8fd8-7c93-4718-b678-f15566c4629a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:28.979387 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec8fd8-7c93-4718-b678-f15566c4629a admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:28.979668 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec8fd8-7c93-4718-b678-f15566c4629a admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:28.979938 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec8fd8-7c93-4718-b678-f15566c4629a admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:28.980717 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec8fd8-7c93-4718-b678-f15566c4629a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:28.982468 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bec8fd8-7c93-4718-b678-f15566c4629a admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:28.994869 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1125/2244] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:26:29.001359 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645e769-82e0-4cf4-a905-b1d7c9c4aaa2 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:29.014695 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645e769-82e0-4cf4-a905-b1d7c9c4aaa2 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:29.019465 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1901d-8e61-4114-b563-d86c41594123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:29.020190 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1901d-8e61-4114-b563-d86c41594123 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:29.020541 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1901d-8e61-4114-b563-d86c41594123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:29.021109 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1901d-8e61-4114-b563-d86c41594123 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:29.021793 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1901d-8e61-4114-b563-d86c41594123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:29.023554 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1901d-8e61-4114-b563-d86c41594123 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:29.036554 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1120/2245] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:26:29.040524 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec8fd8-7c93-4718-b678-f15566c4629a admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:29.052666 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec8fd8-7c93-4718-b678-f15566c4629a admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:29.058073 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df530b8-a263-4adb-8f40-c584028b953f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:29.058809 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df530b8-a263-4adb-8f40-c584028b953f admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:29.059089 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df530b8-a263-4adb-8f40-c584028b953f admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:29.059362 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df530b8-a263-4adb-8f40-c584028b953f admin admin] PATH_INFO: `/v3/projects/f87d76a3ba854e2eb451d9b2310ddf67/users/573c1d81fa19459f8af05af30e9eb7f6/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:29.075954 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df530b8-a263-4adb-8f40-c584028b953f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f87d76a3ba854e2eb451d9b2310ddf67, user_id=573c1d81fa19459f8af05af30e9eb7f6, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:29.078954 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df530b8-a263-4adb-8f40-c584028b953f admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:29.096125 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1126/2246] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:26:29 2022] PUT /identity/v3/projects/f87d76a3ba854e2eb451d9b2310ddf67/users/573c1d81fa19459f8af05af30e9eb7f6/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:26:29.107130 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f83bc-b080-49a0-b0c3-0e8d3d3d84f2 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:29.107701 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f83bc-b080-49a0-b0c3-0e8d3d3d84f2 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:29.107977 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f83bc-b080-49a0-b0c3-0e8d3d3d84f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:29.165393 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9b7f83bc-b080-49a0-b0c3-0e8d3d3d84f2 None None] MFA Rules not processed for user `573c1d81fa19459f8af05af30e9eb7f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:29.167407 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9b7f83bc-b080-49a0-b0c3-0e8d3d3d84f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:29.191669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:29.255203 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1121/2247] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:29.267426 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df530b8-a263-4adb-8f40-c584028b953f admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:29.269198 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-7df530b8-a263-4adb-8f40-c584028b953f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:29.342934 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df530b8-a263-4adb-8f40-c584028b953f admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:29.347336 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e119aaa2-3c79-4804-b9cb-8e273ba0f15f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:29.352276 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119aaa2-3c79-4804-b9cb-8e273ba0f15f service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:29.352976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119aaa2-3c79-4804-b9cb-8e273ba0f15f service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:29.354376 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e119aaa2-3c79-4804-b9cb-8e273ba0f15f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:29.367401 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119aaa2-3c79-4804-b9cb-8e273ba0f15f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:29.370219 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e119aaa2-3c79-4804-b9cb-8e273ba0f15f service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:29.383282 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1127/2248] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:26:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:26:29.407484 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f83bc-b080-49a0-b0c3-0e8d3d3d84f2 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:29.509390 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f83bc-b080-49a0-b0c3-0e8d3d3d84f2 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:29.514625 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935a384-2c22-442d-8a50-3ddcf8b42d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:29.515327 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935a384-2c22-442d-8a50-3ddcf8b42d99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:29.515699 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935a384-2c22-442d-8a50-3ddcf8b42d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:29.516068 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3935a384-2c22-442d-8a50-3ddcf8b42d99 admin admin] PATH_INFO: `/v3/users/573c1d81fa19459f8af05af30e9eb7f6` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:29.517313 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3935a384-2c22-442d-8a50-3ddcf8b42d99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=573c1d81fa19459f8af05af30e9eb7f6)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:29.519282 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3935a384-2c22-442d-8a50-3ddcf8b42d99 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:29.569469 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3935a384-2c22-442d-8a50-3ddcf8b42d99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '573c1d81fa19459f8af05af30e9eb7f6'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:29.570755 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3935a384-2c22-442d-8a50-3ddcf8b42d99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '573c1d81fa19459f8af05af30e9eb7f6'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:29.580200 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3935a384-2c22-442d-8a50-3ddcf8b42d99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '573c1d81fa19459f8af05af30e9eb7f6'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:29.581396 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3935a384-2c22-442d-8a50-3ddcf8b42d99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '573c1d81fa19459f8af05af30e9eb7f6'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:29.595217 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3935a384-2c22-442d-8a50-3ddcf8b42d99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '573c1d81fa19459f8af05af30e9eb7f6'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:29.612017 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1122/2249] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:26:29 2022] DELETE /identity/v3/users/573c1d81fa19459f8af05af30e9eb7f6 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:29.613973 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a2df6-3309-408e-bc3c-55800ad1f3f7 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:29.614341 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a2df6-3309-408e-bc3c-55800ad1f3f7 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:29.614700 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a2df6-3309-408e-bc3c-55800ad1f3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:29.644442 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-790a2df6-3309-408e-bc3c-55800ad1f3f7 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:29.645847 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-790a2df6-3309-408e-bc3c-55800ad1f3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:29.721640 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1128/2250] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:26:29.732397 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935a384-2c22-442d-8a50-3ddcf8b42d99 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:29.734503 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3935a384-2c22-442d-8a50-3ddcf8b42d99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:29.783800 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:29.811350 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3935a384-2c22-442d-8a50-3ddcf8b42d99 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:29.816186 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf906da-7808-4f5c-818e-ca6869ebc4df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:29.817200 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf906da-7808-4f5c-818e-ca6869ebc4df service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:29.817200 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf906da-7808-4f5c-818e-ca6869ebc4df service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:29.817356 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf906da-7808-4f5c-818e-ca6869ebc4df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:29.828486 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf906da-7808-4f5c-818e-ca6869ebc4df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:29.829936 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf906da-7808-4f5c-818e-ca6869ebc4df service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:29.841372 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1123/2251] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:26:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:26:30.170192 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a2df6-3309-408e-bc3c-55800ad1f3f7 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:30.171663 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-790a2df6-3309-408e-bc3c-55800ad1f3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:30.185158 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a2df6-3309-408e-bc3c-55800ad1f3f7 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:30.190325 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eddc16-e196-4e4a-8bdd-77a6c252c919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:30.190969 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eddc16-e196-4e4a-8bdd-77a6c252c919 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:30.191239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eddc16-e196-4e4a-8bdd-77a6c252c919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:30.191513 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eddc16-e196-4e4a-8bdd-77a6c252c919 admin admin] PATH_INFO: `/v3/projects/f87d76a3ba854e2eb451d9b2310ddf67` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:30.192870 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eddc16-e196-4e4a-8bdd-77a6c252c919 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f87d76a3ba854e2eb451d9b2310ddf67)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:30.195308 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eddc16-e196-4e4a-8bdd-77a6c252c919 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:30.215896 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:30.267400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-27eddc16-e196-4e4a-8bdd-77a6c252c919 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f87d76a3ba854e2eb451d9b2310ddf67', 'request_id': 'req-27eddc16-e196-4e4a-8bdd-77a6c252c919'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:30.274299 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-27eddc16-e196-4e4a-8bdd-77a6c252c919 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f87d76a3ba854e2eb451d9b2310ddf67', 'request_id': 'req-27eddc16-e196-4e4a-8bdd-77a6c252c919'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:30.281962 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-27eddc16-e196-4e4a-8bdd-77a6c252c919 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f87d76a3ba854e2eb451d9b2310ddf67', 'request_id': 'req-27eddc16-e196-4e4a-8bdd-77a6c252c919'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:30.297381 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-27eddc16-e196-4e4a-8bdd-77a6c252c919 admin admin] The token cache is being invalidate because project f87d76a3ba854e2eb451d9b2310ddf67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:26:30.297763 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-27eddc16-e196-4e4a-8bdd-77a6c252c919 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:30.299169 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-27eddc16-e196-4e4a-8bdd-77a6c252c919 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:30.301179 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1129/2252] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:26:30 2022] DELETE /identity/v3/projects/f87d76a3ba854e2eb451d9b2310ddf67 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:36.762928 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf906da-7808-4f5c-818e-ca6869ebc4df service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:36.764868 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ddf906da-7808-4f5c-818e-ca6869ebc4df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:36.779269 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf906da-7808-4f5c-818e-ca6869ebc4df service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:36.838634 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347cd90-da23-40d7-8a09-b27e2251da68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:36.839281 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347cd90-da23-40d7-8a09-b27e2251da68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:36.839564 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347cd90-da23-40d7-8a09-b27e2251da68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:36.839841 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347cd90-da23-40d7-8a09-b27e2251da68 admin admin] PATH_INFO: `/v3/users/d21c3dd9f4044b4fab06a9af3b2af3a1` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:36.841501 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347cd90-da23-40d7-8a09-b27e2251da68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d21c3dd9f4044b4fab06a9af3b2af3a1)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:36.843922 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347cd90-da23-40d7-8a09-b27e2251da68 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:36.890620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4347cd90-da23-40d7-8a09-b27e2251da68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd21c3dd9f4044b4fab06a9af3b2af3a1'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:36.891301 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4347cd90-da23-40d7-8a09-b27e2251da68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd21c3dd9f4044b4fab06a9af3b2af3a1'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:36.898692 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4347cd90-da23-40d7-8a09-b27e2251da68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd21c3dd9f4044b4fab06a9af3b2af3a1'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:36.899349 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4347cd90-da23-40d7-8a09-b27e2251da68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd21c3dd9f4044b4fab06a9af3b2af3a1'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:36.912554 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-4347cd90-da23-40d7-8a09-b27e2251da68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd21c3dd9f4044b4fab06a9af3b2af3a1'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:36.926234 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1124/2253] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:26:36 2022] DELETE /identity/v3/users/d21c3dd9f4044b4fab06a9af3b2af3a1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:36.934660 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ca199-ae3c-4c2c-9760-40d4c41ed452 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:36.935117 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ca199-ae3c-4c2c-9760-40d4c41ed452 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:36.935219 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ca199-ae3c-4c2c-9760-40d4c41ed452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:36.954125 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-fb9ca199-ae3c-4c2c-9760-40d4c41ed452 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:36.955304 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-fb9ca199-ae3c-4c2c-9760-40d4c41ed452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:37.017336 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1130/2254] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:37.027165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347cd90-da23-40d7-8a09-b27e2251da68 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:37.028614 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4347cd90-da23-40d7-8a09-b27e2251da68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:37.085467 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347cd90-da23-40d7-8a09-b27e2251da68 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:37.089146 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99de3bd-8c09-430b-96bb-0a54c208eb9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:37.089760 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99de3bd-8c09-430b-96bb-0a54c208eb9c service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:37.090043 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99de3bd-8c09-430b-96bb-0a54c208eb9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:37.090320 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99de3bd-8c09-430b-96bb-0a54c208eb9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:37.099337 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99de3bd-8c09-430b-96bb-0a54c208eb9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:37.100790 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99de3bd-8c09-430b-96bb-0a54c208eb9c service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:37.105707 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:37.110775 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1125/2255] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:26:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:26:37.426824 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ca199-ae3c-4c2c-9760-40d4c41ed452 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:37.428250 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-fb9ca199-ae3c-4c2c-9760-40d4c41ed452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:37.442459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ca199-ae3c-4c2c-9760-40d4c41ed452 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:37.447376 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1089dd0-d80e-4347-a8aa-4de4cc99c677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:37.448107 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1089dd0-d80e-4347-a8aa-4de4cc99c677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:37.448405 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1089dd0-d80e-4347-a8aa-4de4cc99c677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:37.448682 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1089dd0-d80e-4347-a8aa-4de4cc99c677 admin admin] PATH_INFO: `/v3/projects/7451ad1cfa534cdbb55268b2b03eb981` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:37.449849 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1089dd0-d80e-4347-a8aa-4de4cc99c677 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7451ad1cfa534cdbb55268b2b03eb981)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:37.451759 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1089dd0-d80e-4347-a8aa-4de4cc99c677 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:37.503161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e1089dd0-d80e-4347-a8aa-4de4cc99c677 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7451ad1cfa534cdbb55268b2b03eb981', 'request_id': 'req-e1089dd0-d80e-4347-a8aa-4de4cc99c677'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:37.510059 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e1089dd0-d80e-4347-a8aa-4de4cc99c677 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7451ad1cfa534cdbb55268b2b03eb981', 'request_id': 'req-e1089dd0-d80e-4347-a8aa-4de4cc99c677'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:37.517777 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e1089dd0-d80e-4347-a8aa-4de4cc99c677 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7451ad1cfa534cdbb55268b2b03eb981', 'request_id': 'req-e1089dd0-d80e-4347-a8aa-4de4cc99c677'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:37.532913 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e1089dd0-d80e-4347-a8aa-4de4cc99c677 admin admin] The token cache is being invalidate because project 7451ad1cfa534cdbb55268b2b03eb981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:26:37.533209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e1089dd0-d80e-4347-a8aa-4de4cc99c677 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:37.533854 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e1089dd0-d80e-4347-a8aa-4de4cc99c677 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:37.540052 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1131/2256] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:26:37 2022] DELETE /identity/v3/projects/7451ad1cfa534cdbb55268b2b03eb981 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:37.621347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99de3bd-8c09-430b-96bb-0a54c208eb9c service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:37.623025 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d99de3bd-8c09-430b-96bb-0a54c208eb9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:37.638890 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99de3bd-8c09-430b-96bb-0a54c208eb9c service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:37.706186 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017388e-659d-4ffd-b7a6-b79f0745a203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:37.706765 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017388e-659d-4ffd-b7a6-b79f0745a203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:37.707064 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017388e-659d-4ffd-b7a6-b79f0745a203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:37.707338 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6017388e-659d-4ffd-b7a6-b79f0745a203 admin admin] PATH_INFO: `/v3/users/ab09e5669d4f4cfca875654e41325d58` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:37.708675 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6017388e-659d-4ffd-b7a6-b79f0745a203 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab09e5669d4f4cfca875654e41325d58)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:37.710661 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6017388e-659d-4ffd-b7a6-b79f0745a203 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:37.765726 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6017388e-659d-4ffd-b7a6-b79f0745a203 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab09e5669d4f4cfca875654e41325d58'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:37.766879 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6017388e-659d-4ffd-b7a6-b79f0745a203 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab09e5669d4f4cfca875654e41325d58'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:37.774377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6017388e-659d-4ffd-b7a6-b79f0745a203 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab09e5669d4f4cfca875654e41325d58'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:37.775042 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6017388e-659d-4ffd-b7a6-b79f0745a203 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab09e5669d4f4cfca875654e41325d58'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:37.790249 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6017388e-659d-4ffd-b7a6-b79f0745a203 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab09e5669d4f4cfca875654e41325d58'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:37.809293 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1126/2257] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:26:37 2022] DELETE /identity/v3/users/ab09e5669d4f4cfca875654e41325d58 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:37.813546 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecb146-9e25-4f3e-8cfe-7d00d5c772ad None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:37.813855 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecb146-9e25-4f3e-8cfe-7d00d5c772ad None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:37.814130 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecb146-9e25-4f3e-8cfe-7d00d5c772ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:37.835175 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-d4ecb146-9e25-4f3e-8cfe-7d00d5c772ad None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:37.836492 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d4ecb146-9e25-4f3e-8cfe-7d00d5c772ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:37.850017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:37.899496 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1132/2258] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:37.909802 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017388e-659d-4ffd-b7a6-b79f0745a203 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:37.911249 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6017388e-659d-4ffd-b7a6-b79f0745a203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:37.972383 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6017388e-659d-4ffd-b7a6-b79f0745a203 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:37.981624 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318541fd-4ea0-4c19-b5ea-fe0281a79214 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:37.982252 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318541fd-4ea0-4c19-b5ea-fe0281a79214 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:37.982537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318541fd-4ea0-4c19-b5ea-fe0281a79214 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:37.982810 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318541fd-4ea0-4c19-b5ea-fe0281a79214 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:37.997286 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318541fd-4ea0-4c19-b5ea-fe0281a79214 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:37.998743 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318541fd-4ea0-4c19-b5ea-fe0281a79214 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:38.008424 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1127/2259] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:26:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:26:38.277761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ecb146-9e25-4f3e-8cfe-7d00d5c772ad None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:38.279238 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d4ecb146-9e25-4f3e-8cfe-7d00d5c772ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:38.293410 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ecb146-9e25-4f3e-8cfe-7d00d5c772ad None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:38.298007 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b23a7-034e-4ee9-81c5-89537bd59485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:38.299131 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b23a7-034e-4ee9-81c5-89537bd59485 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:38.299415 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b23a7-034e-4ee9-81c5-89537bd59485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:38.299845 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b23a7-034e-4ee9-81c5-89537bd59485 admin admin] PATH_INFO: `/v3/projects/b12306355f9f40a98f86555f6927974d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:38.301040 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b23a7-034e-4ee9-81c5-89537bd59485 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b12306355f9f40a98f86555f6927974d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:38.302923 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b23a7-034e-4ee9-81c5-89537bd59485 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:38.360650 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6a5b23a7-034e-4ee9-81c5-89537bd59485 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b12306355f9f40a98f86555f6927974d', 'request_id': 'req-6a5b23a7-034e-4ee9-81c5-89537bd59485'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:38.366574 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6a5b23a7-034e-4ee9-81c5-89537bd59485 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b12306355f9f40a98f86555f6927974d', 'request_id': 'req-6a5b23a7-034e-4ee9-81c5-89537bd59485'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:38.372636 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6a5b23a7-034e-4ee9-81c5-89537bd59485 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b12306355f9f40a98f86555f6927974d', 'request_id': 'req-6a5b23a7-034e-4ee9-81c5-89537bd59485'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:38.386491 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6a5b23a7-034e-4ee9-81c5-89537bd59485 admin admin] The token cache is being invalidate because project b12306355f9f40a98f86555f6927974d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:26:38.386771 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6a5b23a7-034e-4ee9-81c5-89537bd59485 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:38.387399 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6a5b23a7-034e-4ee9-81c5-89537bd59485 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:38.388936 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1133/2260] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:26:38 2022] DELETE /identity/v3/projects/b12306355f9f40a98f86555f6927974d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:38.392915 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318541fd-4ea0-4c19-b5ea-fe0281a79214 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:38.402633 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318541fd-4ea0-4c19-b5ea-fe0281a79214 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:38.421666 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:38.461733 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2398a586-e143-4679-b987-d05eef0baf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:38.462358 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398a586-e143-4679-b987-d05eef0baf34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:38.463141 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398a586-e143-4679-b987-d05eef0baf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:38.463431 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2398a586-e143-4679-b987-d05eef0baf34 admin admin] PATH_INFO: `/v3/users/ada120e049354ce2a76e2feb48fad8eb` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:38.464605 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398a586-e143-4679-b987-d05eef0baf34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ada120e049354ce2a76e2feb48fad8eb)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:38.466557 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2398a586-e143-4679-b987-d05eef0baf34 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:38.510454 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2398a586-e143-4679-b987-d05eef0baf34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ada120e049354ce2a76e2feb48fad8eb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:38.511022 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2398a586-e143-4679-b987-d05eef0baf34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ada120e049354ce2a76e2feb48fad8eb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:38.517696 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2398a586-e143-4679-b987-d05eef0baf34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ada120e049354ce2a76e2feb48fad8eb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:38.518401 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2398a586-e143-4679-b987-d05eef0baf34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ada120e049354ce2a76e2feb48fad8eb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:38.530408 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2398a586-e143-4679-b987-d05eef0baf34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ada120e049354ce2a76e2feb48fad8eb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:38.543399 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1128/2261] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:26:38 2022] DELETE /identity/v3/users/ada120e049354ce2a76e2feb48fad8eb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:38.854738 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b23a7-034e-4ee9-81c5-89537bd59485 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:38.856312 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6a5b23a7-034e-4ee9-81c5-89537bd59485 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:38.884186 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b23a7-034e-4ee9-81c5-89537bd59485 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:38.957483 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec690f-d9e8-448c-ad6e-700f3fdb8533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:38.958233 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec690f-d9e8-448c-ad6e-700f3fdb8533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:38.958575 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec690f-d9e8-448c-ad6e-700f3fdb8533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:38.959023 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec690f-d9e8-448c-ad6e-700f3fdb8533 admin admin] PATH_INFO: `/v3/projects/9faaf2f5d5fd49c78d17eb55235e6fad` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:38.960246 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec690f-d9e8-448c-ad6e-700f3fdb8533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9faaf2f5d5fd49c78d17eb55235e6fad)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:38.962255 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ec690f-d9e8-448c-ad6e-700f3fdb8533 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:39.014095 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:39.017111 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-85ec690f-d9e8-448c-ad6e-700f3fdb8533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9faaf2f5d5fd49c78d17eb55235e6fad', 'request_id': 'req-85ec690f-d9e8-448c-ad6e-700f3fdb8533'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:39.026475 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-85ec690f-d9e8-448c-ad6e-700f3fdb8533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9faaf2f5d5fd49c78d17eb55235e6fad', 'request_id': 'req-85ec690f-d9e8-448c-ad6e-700f3fdb8533'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:39.033106 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-85ec690f-d9e8-448c-ad6e-700f3fdb8533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9faaf2f5d5fd49c78d17eb55235e6fad', 'request_id': 'req-85ec690f-d9e8-448c-ad6e-700f3fdb8533'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:39.063135 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-85ec690f-d9e8-448c-ad6e-700f3fdb8533 admin admin] The token cache is being invalidate because project 9faaf2f5d5fd49c78d17eb55235e6fad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:26:39.064114 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-85ec690f-d9e8-448c-ad6e-700f3fdb8533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:39.065222 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-85ec690f-d9e8-448c-ad6e-700f3fdb8533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:39.067538 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1134/2262] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:26:38 2022] DELETE /identity/v3/projects/9faaf2f5d5fd49c78d17eb55235e6fad => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:39.072994 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a250c-4737-423f-b3ce-baa5427d701f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:39.073519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a250c-4737-423f-b3ce-baa5427d701f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:39.073609 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a250c-4737-423f-b3ce-baa5427d701f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:39.101294 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-e34a250c-4737-423f-b3ce-baa5427d701f None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:39.102496 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e34a250c-4737-423f-b3ce-baa5427d701f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:39.170271 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1129/2263] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:39.177530 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50415910-d8c9-4f7a-a5c2-385d5eb45428 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:39.177815 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50415910-d8c9-4f7a-a5c2-385d5eb45428 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:39.178087 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50415910-d8c9-4f7a-a5c2-385d5eb45428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:39.198790 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-50415910-d8c9-4f7a-a5c2-385d5eb45428 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:39.200022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-50415910-d8c9-4f7a-a5c2-385d5eb45428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:39.208627 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1135/2264] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:26:39.213563 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a250c-4737-423f-b3ce-baa5427d701f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:39.223713 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a250c-4737-423f-b3ce-baa5427d701f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:39.229735 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27f96d-7e26-42ce-a370-4c103f1475c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:39.230356 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27f96d-7e26-42ce-a370-4c103f1475c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:39.230754 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27f96d-7e26-42ce-a370-4c103f1475c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:39.231046 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d27f96d-7e26-42ce-a370-4c103f1475c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:39.232105 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27f96d-7e26-42ce-a370-4c103f1475c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:26:39.232501 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27f96d-7e26-42ce-a370-4c103f1475c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:39.234130 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d27f96d-7e26-42ce-a370-4c103f1475c1 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:39.252023 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1130/2265] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:26:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:26:39.253360 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50415910-d8c9-4f7a-a5c2-385d5eb45428 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:39.262595 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50415910-d8c9-4f7a-a5c2-385d5eb45428 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:39.267189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd90b51-a437-487a-af94-6f0e9f84ea07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:39.267727 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd90b51-a437-487a-af94-6f0e9f84ea07 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:39.268012 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd90b51-a437-487a-af94-6f0e9f84ea07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:39.268378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd90b51-a437-487a-af94-6f0e9f84ea07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:39.269040 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd90b51-a437-487a-af94-6f0e9f84ea07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:39.271284 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd90b51-a437-487a-af94-6f0e9f84ea07 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:39.299878 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1136/2266] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:26:39 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:26:39.304288 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27f96d-7e26-42ce-a370-4c103f1475c1 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:39.314884 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d27f96d-7e26-42ce-a370-4c103f1475c1 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:39.341459 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:39.374217 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8accb1f-4691-4484-989b-1c80557081ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:39.374869 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8accb1f-4691-4484-989b-1c80557081ae admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:39.375157 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8accb1f-4691-4484-989b-1c80557081ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:39.375437 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8accb1f-4691-4484-989b-1c80557081ae admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:39.376296 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8accb1f-4691-4484-989b-1c80557081ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:39.378527 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8accb1f-4691-4484-989b-1c80557081ae admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:39.398278 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1131/2267] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:26:39 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:26:39.402917 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd90b51-a437-487a-af94-6f0e9f84ea07 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:39.413332 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd90b51-a437-487a-af94-6f0e9f84ea07 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:39.419365 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb387815-5236-4ff2-ad9b-870d89778a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:39.420011 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb387815-5236-4ff2-ad9b-870d89778a4a admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:39.420366 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb387815-5236-4ff2-ad9b-870d89778a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:39.420641 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb387815-5236-4ff2-ad9b-870d89778a4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:39.421424 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb387815-5236-4ff2-ad9b-870d89778a4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:39.423011 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb387815-5236-4ff2-ad9b-870d89778a4a admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:39.432842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1137/2268] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:26:39.436715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8accb1f-4691-4484-989b-1c80557081ae admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:39.446606 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8accb1f-4691-4484-989b-1c80557081ae admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:39.451223 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ed5a10-901a-464f-919e-d134fd2a95db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:39.451818 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed5a10-901a-464f-919e-d134fd2a95db admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:39.452140 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed5a10-901a-464f-919e-d134fd2a95db admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:39.452417 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ed5a10-901a-464f-919e-d134fd2a95db admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:39.453105 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed5a10-901a-464f-919e-d134fd2a95db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:39.454690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ed5a10-901a-464f-919e-d134fd2a95db admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:39.465860 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1132/2269] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:26:39.469922 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb387815-5236-4ff2-ad9b-870d89778a4a admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:39.480486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb387815-5236-4ff2-ad9b-870d89778a4a admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:39.485051 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f405131-9edc-4a8e-a90f-ee8356dfefd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:39.485695 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f405131-9edc-4a8e-a90f-ee8356dfefd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:39.485967 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f405131-9edc-4a8e-a90f-ee8356dfefd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:39.486236 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f405131-9edc-4a8e-a90f-ee8356dfefd9 admin admin] PATH_INFO: `/v3/projects/044dca628a3c43cca93bc566f1251180/users/a43a4cf4e7894e32ad3f8821b6c105fb/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:39.500604 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f405131-9edc-4a8e-a90f-ee8356dfefd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=044dca628a3c43cca93bc566f1251180, user_id=a43a4cf4e7894e32ad3f8821b6c105fb, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:39.503252 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f405131-9edc-4a8e-a90f-ee8356dfefd9 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:39.515816 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1138/2270] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:26:39 2022] PUT /identity/v3/projects/044dca628a3c43cca93bc566f1251180/users/a43a4cf4e7894e32ad3f8821b6c105fb/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:39.527608 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3fce1-5d6c-4d97-8f41-10f903fba134 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:39.527836 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3fce1-5d6c-4d97-8f41-10f903fba134 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:39.528177 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da3fce1-5d6c-4d97-8f41-10f903fba134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:39.566320 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-6da3fce1-5d6c-4d97-8f41-10f903fba134 None None] MFA Rules not processed for user `a43a4cf4e7894e32ad3f8821b6c105fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:39.567678 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6da3fce1-5d6c-4d97-8f41-10f903fba134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:39.633908 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1133/2271] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:39.638816 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f405131-9edc-4a8e-a90f-ee8356dfefd9 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:39.701953 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f405131-9edc-4a8e-a90f-ee8356dfefd9 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:39.706665 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b49dfa-e1b1-4478-aa4f-f07b59d93ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:39.707276 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b49dfa-e1b1-4478-aa4f-f07b59d93ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:39.707560 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b49dfa-e1b1-4478-aa4f-f07b59d93ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:39.707839 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b49dfa-e1b1-4478-aa4f-f07b59d93ed1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:39.708533 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b49dfa-e1b1-4478-aa4f-f07b59d93ed1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:39.710425 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b49dfa-e1b1-4478-aa4f-f07b59d93ed1 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:39.737836 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1139/2272] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:26:39 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:26:39.741890 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3fce1-5d6c-4d97-8f41-10f903fba134 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:39.752572 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da3fce1-5d6c-4d97-8f41-10f903fba134 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:39.810049 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd4952-f37c-4e1d-86ab-752f573bb4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:39.810694 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd4952-f37c-4e1d-86ab-752f573bb4c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:39.811093 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd4952-f37c-4e1d-86ab-752f573bb4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:39.811376 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd4952-f37c-4e1d-86ab-752f573bb4c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:39.812098 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd4952-f37c-4e1d-86ab-752f573bb4c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:39.814053 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bd4952-f37c-4e1d-86ab-752f573bb4c4 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:39.835745 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1134/2273] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:26:39 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:26:39.840533 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b49dfa-e1b1-4478-aa4f-f07b59d93ed1 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:39.850700 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b49dfa-e1b1-4478-aa4f-f07b59d93ed1 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:39.855314 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b754755-7f2f-4596-bd42-f5af56988b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:39.855911 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b754755-7f2f-4596-bd42-f5af56988b93 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:39.856228 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b754755-7f2f-4596-bd42-f5af56988b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:39.856503 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b754755-7f2f-4596-bd42-f5af56988b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:39.857196 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b754755-7f2f-4596-bd42-f5af56988b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:39.858807 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b754755-7f2f-4596-bd42-f5af56988b93 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:39.869184 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1140/2274] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:26:39.873372 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd4952-f37c-4e1d-86ab-752f573bb4c4 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:39.883842 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bd4952-f37c-4e1d-86ab-752f573bb4c4 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:39.888944 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2bc3b-0217-444b-acb3-a42aa906e5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:39.889589 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2bc3b-0217-444b-acb3-a42aa906e5d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:39.889867 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2bc3b-0217-444b-acb3-a42aa906e5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:39.890181 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2bc3b-0217-444b-acb3-a42aa906e5d5 admin admin] PATH_INFO: `/v3/projects/ad4433164b304393b72f1abcf2d7dcb7/users/e7eb3be1543b4cecb4e5b505f491b189/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:39.905032 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2bc3b-0217-444b-acb3-a42aa906e5d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad4433164b304393b72f1abcf2d7dcb7, user_id=e7eb3be1543b4cecb4e5b505f491b189, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:39.907650 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2bc3b-0217-444b-acb3-a42aa906e5d5 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:39.920250 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1135/2275] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:26:39 2022] PUT /identity/v3/projects/ad4433164b304393b72f1abcf2d7dcb7/users/e7eb3be1543b4cecb4e5b505f491b189/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:39.924277 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b754755-7f2f-4596-bd42-f5af56988b93 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:39.934015 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b754755-7f2f-4596-bd42-f5af56988b93 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:39.975564 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:39.991385 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad58451-0795-4d2d-acbb-5269a648f433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:39.992003 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad58451-0795-4d2d-acbb-5269a648f433 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:39.992298 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad58451-0795-4d2d-acbb-5269a648f433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:39.992570 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad58451-0795-4d2d-acbb-5269a648f433 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:39.993252 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad58451-0795-4d2d-acbb-5269a648f433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:39.995344 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad58451-0795-4d2d-acbb-5269a648f433 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:40.004747 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1141/2276] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:26:40.008909 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2bc3b-0217-444b-acb3-a42aa906e5d5 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:40.015141 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:40.021490 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2bc3b-0217-444b-acb3-a42aa906e5d5 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:40.026572 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7ac4a-2764-4ea3-9377-eda1b5de464f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:40.027309 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7ac4a-2764-4ea3-9377-eda1b5de464f admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:40.027522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7ac4a-2764-4ea3-9377-eda1b5de464f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:40.027801 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def7ac4a-2764-4ea3-9377-eda1b5de464f admin admin] PATH_INFO: `/v3/projects/ad4433164b304393b72f1abcf2d7dcb7/users/e7eb3be1543b4cecb4e5b505f491b189/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:40.032225 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7ac4a-2764-4ea3-9377-eda1b5de464f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad4433164b304393b72f1abcf2d7dcb7, user_id=e7eb3be1543b4cecb4e5b505f491b189, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:40.034998 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def7ac4a-2764-4ea3-9377-eda1b5de464f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:40.048461 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1136/2277] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:26:40 2022] PUT /identity/v3/projects/ad4433164b304393b72f1abcf2d7dcb7/users/e7eb3be1543b4cecb4e5b505f491b189/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:40.059586 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f641b71-59a6-45b9-ac40-cb370182ab75 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:40.060013 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f641b71-59a6-45b9-ac40-cb370182ab75 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:40.060359 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f641b71-59a6-45b9-ac40-cb370182ab75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:40.088383 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-2f641b71-59a6-45b9-ac40-cb370182ab75 None None] MFA Rules not processed for user `e7eb3be1543b4cecb4e5b505f491b189`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:40.091164 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-2f641b71-59a6-45b9-ac40-cb370182ab75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:40.177912 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1142/2278] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:40.189041 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7ac4a-2764-4ea3-9377-eda1b5de464f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:40.190855 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-def7ac4a-2764-4ea3-9377-eda1b5de464f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:40.246878 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def7ac4a-2764-4ea3-9377-eda1b5de464f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:40.250506 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b412b2d-c588-474a-adc6-f9d60e9e1aa5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:40.251105 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b412b2d-c588-474a-adc6-f9d60e9e1aa5 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:40.251381 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b412b2d-c588-474a-adc6-f9d60e9e1aa5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:40.251709 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b412b2d-c588-474a-adc6-f9d60e9e1aa5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:40.316439 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b412b2d-c588-474a-adc6-f9d60e9e1aa5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:40.317802 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b412b2d-c588-474a-adc6-f9d60e9e1aa5 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:40.327475 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1137/2279] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:26:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 15:26:44.566751 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f641b71-59a6-45b9-ac40-cb370182ab75 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:44.568233 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-2f641b71-59a6-45b9-ac40-cb370182ab75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:44.601167 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f641b71-59a6-45b9-ac40-cb370182ab75 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:44.605396 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8481a0-d5c3-4f58-b5a3-8590b95da674 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:44.606084 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8481a0-d5c3-4f58-b5a3-8590b95da674 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:44.606398 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8481a0-d5c3-4f58-b5a3-8590b95da674 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:44.606671 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8481a0-d5c3-4f58-b5a3-8590b95da674 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:44.617554 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8481a0-d5c3-4f58-b5a3-8590b95da674 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:44.619525 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8481a0-d5c3-4f58-b5a3-8590b95da674 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:44.629675 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1143/2280] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:26:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:26:49.834201 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f3623-c727-4fb2-a14d-1a598a590971 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:49.834670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f3623-c727-4fb2-a14d-1a598a590971 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:49.834764 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f3623-c727-4fb2-a14d-1a598a590971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:49.854705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-1d1f3623-c727-4fb2-a14d-1a598a590971 None None] MFA Rules not processed for user `b470b4c2ca1a4d1a8a864789bf603d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:49.855951 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1d1f3623-c727-4fb2-a14d-1a598a590971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:49.911247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1138/2281] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Jul 27 15:26:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:49.956787 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8481a0-d5c3-4f58-b5a3-8590b95da674 service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:49.958221 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-4c8481a0-d5c3-4f58-b5a3-8590b95da674 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:50.028625 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8481a0-d5c3-4f58-b5a3-8590b95da674 service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:50.033501 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccae37d-9d0b-4356-9ff6-a953f497971b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68bbf8bb59a84829afacd9677c9639a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:50.034128 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccae37d-9d0b-4356-9ff6-a953f497971b service swift] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:50.034404 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccae37d-9d0b-4356-9ff6-a953f497971b service swift] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:50.034673 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccae37d-9d0b-4356-9ff6-a953f497971b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:50.043203 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccae37d-9d0b-4356-9ff6-a953f497971b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:50.045118 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccae37d-9d0b-4356-9ff6-a953f497971b service swift] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:50.053282 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1144/2282] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Jul 27 15:26:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 15:26:50.616080 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f3623-c727-4fb2-a14d-1a598a590971 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:50.725045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:50.747864 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f3623-c727-4fb2-a14d-1a598a590971 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:50.754499 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b066aa8-2e34-4b60-8b32-eb54e9b36f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:50.755454 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b066aa8-2e34-4b60-8b32-eb54e9b36f8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:50.755845 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b066aa8-2e34-4b60-8b32-eb54e9b36f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:50.756434 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b066aa8-2e34-4b60-8b32-eb54e9b36f8d admin admin] PATH_INFO: `/v3/users/a43a4cf4e7894e32ad3f8821b6c105fb` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:50.758022 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b066aa8-2e34-4b60-8b32-eb54e9b36f8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a43a4cf4e7894e32ad3f8821b6c105fb)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:50.760962 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b066aa8-2e34-4b60-8b32-eb54e9b36f8d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:50.834083 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8b066aa8-2e34-4b60-8b32-eb54e9b36f8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a43a4cf4e7894e32ad3f8821b6c105fb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:50.834678 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8b066aa8-2e34-4b60-8b32-eb54e9b36f8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a43a4cf4e7894e32ad3f8821b6c105fb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:50.843468 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8b066aa8-2e34-4b60-8b32-eb54e9b36f8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a43a4cf4e7894e32ad3f8821b6c105fb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:50.844516 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8b066aa8-2e34-4b60-8b32-eb54e9b36f8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a43a4cf4e7894e32ad3f8821b6c105fb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:50.859829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8b066aa8-2e34-4b60-8b32-eb54e9b36f8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a43a4cf4e7894e32ad3f8821b6c105fb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:50.878925 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1139/2283] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:26:50 2022] DELETE /identity/v3/users/a43a4cf4e7894e32ad3f8821b6c105fb => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:50.881200 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab235db2-3874-41e2-acbd-0bcacc97de49 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:50.881495 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab235db2-3874-41e2-acbd-0bcacc97de49 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:50.881764 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab235db2-3874-41e2-acbd-0bcacc97de49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:50.902286 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-ab235db2-3874-41e2-acbd-0bcacc97de49 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:50.903502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ab235db2-3874-41e2-acbd-0bcacc97de49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:50.953659 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:50.979884 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1145/2284] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:26:50.990360 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b066aa8-2e34-4b60-8b32-eb54e9b36f8d admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:50.992191 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8b066aa8-2e34-4b60-8b32-eb54e9b36f8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:51.066285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b066aa8-2e34-4b60-8b32-eb54e9b36f8d admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:51.070125 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9358f95-cf55-4151-ae87-6255fb19de41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:51.070770 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9358f95-cf55-4151-ae87-6255fb19de41 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:51.071052 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9358f95-cf55-4151-ae87-6255fb19de41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:51.071326 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9358f95-cf55-4151-ae87-6255fb19de41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:51.081532 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9358f95-cf55-4151-ae87-6255fb19de41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:51.082945 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9358f95-cf55-4151-ae87-6255fb19de41 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:51.095415 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1140/2285] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:26:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:26:51.396278 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab235db2-3874-41e2-acbd-0bcacc97de49 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:51.397451 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ab235db2-3874-41e2-acbd-0bcacc97de49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:51.433691 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab235db2-3874-41e2-acbd-0bcacc97de49 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:51.440036 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe96878-8404-4024-b593-4ea596e6c4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:51.440899 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe96878-8404-4024-b593-4ea596e6c4e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:51.441205 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe96878-8404-4024-b593-4ea596e6c4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:51.441631 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe96878-8404-4024-b593-4ea596e6c4e3 admin admin] PATH_INFO: `/v3/projects/044dca628a3c43cca93bc566f1251180` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:51.445403 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe96878-8404-4024-b593-4ea596e6c4e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=044dca628a3c43cca93bc566f1251180)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:51.447891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe96878-8404-4024-b593-4ea596e6c4e3 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:51.519653 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-afe96878-8404-4024-b593-4ea596e6c4e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '044dca628a3c43cca93bc566f1251180', 'request_id': 'req-afe96878-8404-4024-b593-4ea596e6c4e3'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:51.527398 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-afe96878-8404-4024-b593-4ea596e6c4e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '044dca628a3c43cca93bc566f1251180', 'request_id': 'req-afe96878-8404-4024-b593-4ea596e6c4e3'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:51.536192 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-afe96878-8404-4024-b593-4ea596e6c4e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '044dca628a3c43cca93bc566f1251180', 'request_id': 'req-afe96878-8404-4024-b593-4ea596e6c4e3'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:51.552788 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-afe96878-8404-4024-b593-4ea596e6c4e3 admin admin] The token cache is being invalidate because project 044dca628a3c43cca93bc566f1251180 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:26:51.553149 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-afe96878-8404-4024-b593-4ea596e6c4e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:51.556320 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-afe96878-8404-4024-b593-4ea596e6c4e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:51.562664 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1146/2286] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:26:51 2022] DELETE /identity/v3/projects/044dca628a3c43cca93bc566f1251180 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:51.563795 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9358f95-cf55-4151-ae87-6255fb19de41 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:51.575546 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9358f95-cf55-4151-ae87-6255fb19de41 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:51.654114 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bada35-72b0-476c-8e49-3282135194ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:51.654935 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bada35-72b0-476c-8e49-3282135194ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:51.655221 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bada35-72b0-476c-8e49-3282135194ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:51.655500 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bada35-72b0-476c-8e49-3282135194ed admin admin] PATH_INFO: `/v3/users/e7eb3be1543b4cecb4e5b505f491b189` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:51.656803 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bada35-72b0-476c-8e49-3282135194ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7eb3be1543b4cecb4e5b505f491b189)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:51.658741 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bada35-72b0-476c-8e49-3282135194ed admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:51.679741 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:51.833850 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c5bada35-72b0-476c-8e49-3282135194ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7eb3be1543b4cecb4e5b505f491b189'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:51.835542 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c5bada35-72b0-476c-8e49-3282135194ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7eb3be1543b4cecb4e5b505f491b189'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:51.843721 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c5bada35-72b0-476c-8e49-3282135194ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7eb3be1543b4cecb4e5b505f491b189'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:51.845681 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c5bada35-72b0-476c-8e49-3282135194ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7eb3be1543b4cecb4e5b505f491b189'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:51.862646 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c5bada35-72b0-476c-8e49-3282135194ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7eb3be1543b4cecb4e5b505f491b189'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:51.886881 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1141/2287] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:26:51 2022] DELETE /identity/v3/users/e7eb3be1543b4cecb4e5b505f491b189 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:26:52.218741 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe96878-8404-4024-b593-4ea596e6c4e3 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:52.220394 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-afe96878-8404-4024-b593-4ea596e6c4e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:52.237141 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe96878-8404-4024-b593-4ea596e6c4e3 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:52.308949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67741c7-88e4-4d5e-a665-33d3dd1b9f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:52.309732 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67741c7-88e4-4d5e-a665-33d3dd1b9f3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:52.310099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67741c7-88e4-4d5e-a665-33d3dd1b9f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:52.310471 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67741c7-88e4-4d5e-a665-33d3dd1b9f3e admin admin] PATH_INFO: `/v3/projects/ad4433164b304393b72f1abcf2d7dcb7` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:52.311740 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67741c7-88e4-4d5e-a665-33d3dd1b9f3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad4433164b304393b72f1abcf2d7dcb7)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:52.313854 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67741c7-88e4-4d5e-a665-33d3dd1b9f3e admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:52.381398 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b67741c7-88e4-4d5e-a665-33d3dd1b9f3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad4433164b304393b72f1abcf2d7dcb7', 'request_id': 'req-b67741c7-88e4-4d5e-a665-33d3dd1b9f3e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:52.388036 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b67741c7-88e4-4d5e-a665-33d3dd1b9f3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad4433164b304393b72f1abcf2d7dcb7', 'request_id': 'req-b67741c7-88e4-4d5e-a665-33d3dd1b9f3e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:52.396070 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b67741c7-88e4-4d5e-a665-33d3dd1b9f3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad4433164b304393b72f1abcf2d7dcb7', 'request_id': 'req-b67741c7-88e4-4d5e-a665-33d3dd1b9f3e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:52.403182 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:52.420359 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b67741c7-88e4-4d5e-a665-33d3dd1b9f3e admin admin] The token cache is being invalidate because project ad4433164b304393b72f1abcf2d7dcb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:26:52.421285 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b67741c7-88e4-4d5e-a665-33d3dd1b9f3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:52.422465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b67741c7-88e4-4d5e-a665-33d3dd1b9f3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:52.425221 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1147/2288] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:26:52 2022] DELETE /identity/v3/projects/ad4433164b304393b72f1abcf2d7dcb7 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:52.431393 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1d014-52be-4ec0-a08f-8e63168bb5a5 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:52.432272 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1d014-52be-4ec0-a08f-8e63168bb5a5 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:52.432570 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e1d014-52be-4ec0-a08f-8e63168bb5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:52.455179 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f2e1d014-52be-4ec0-a08f-8e63168bb5a5 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:52.456774 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f2e1d014-52be-4ec0-a08f-8e63168bb5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:52.544558 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1142/2289] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:52.547720 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaea5b0-fd59-4b1d-bea0-9c73a33cfd7f None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:52.548025 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaea5b0-fd59-4b1d-bea0-9c73a33cfd7f None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:52.548313 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaea5b0-fd59-4b1d-bea0-9c73a33cfd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:52.571136 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-efaea5b0-fd59-4b1d-bea0-9c73a33cfd7f None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:52.572737 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-efaea5b0-fd59-4b1d-bea0-9c73a33cfd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:52.593367 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1148/2290] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:52.594614 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1d014-52be-4ec0-a08f-8e63168bb5a5 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:52.609726 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e1d014-52be-4ec0-a08f-8e63168bb5a5 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:52.614772 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc47b8-aa81-4940-98fb-1f2560ea3349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:52.615396 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc47b8-aa81-4940-98fb-1f2560ea3349 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:52.615657 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc47b8-aa81-4940-98fb-1f2560ea3349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:52.615893 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dc47b8-aa81-4940-98fb-1f2560ea3349 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:52.616612 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc47b8-aa81-4940-98fb-1f2560ea3349 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:26:52.617102 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc47b8-aa81-4940-98fb-1f2560ea3349 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:52.618657 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dc47b8-aa81-4940-98fb-1f2560ea3349 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:52.636642 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1143/2291] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:26:52.637395 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaea5b0-fd59-4b1d-bea0-9c73a33cfd7f None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:52.649521 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaea5b0-fd59-4b1d-bea0-9c73a33cfd7f None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:52.655590 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c4da5-2998-41ff-8bc8-b542128fec3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:52.656466 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c4da5-2998-41ff-8bc8-b542128fec3d admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:52.656917 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c4da5-2998-41ff-8bc8-b542128fec3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:52.657361 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35c4da5-2998-41ff-8bc8-b542128fec3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:52.658191 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c4da5-2998-41ff-8bc8-b542128fec3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:52.661607 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35c4da5-2998-41ff-8bc8-b542128fec3d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:52.696863 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1149/2292] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:26:52 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:26:52.701267 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc47b8-aa81-4940-98fb-1f2560ea3349 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:52.714842 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dc47b8-aa81-4940-98fb-1f2560ea3349 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:52.788829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb603940-710f-40e2-bc0f-c0f1c84c3e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:52.789838 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb603940-710f-40e2-bc0f-c0f1c84c3e95 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:52.790283 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb603940-710f-40e2-bc0f-c0f1c84c3e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:52.790757 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb603940-710f-40e2-bc0f-c0f1c84c3e95 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:52.793018 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb603940-710f-40e2-bc0f-c0f1c84c3e95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:52.795622 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb603940-710f-40e2-bc0f-c0f1c84c3e95 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:52.825832 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1144/2293] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:26:52 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:26:52.861036 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c4da5-2998-41ff-8bc8-b542128fec3d admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:52.887854 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35c4da5-2998-41ff-8bc8-b542128fec3d admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:52.892921 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f5a5d-d806-4d57-843e-f2add5efa154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:52.893571 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f5a5d-d806-4d57-843e-f2add5efa154 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:52.893851 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f5a5d-d806-4d57-843e-f2add5efa154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:52.894126 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f5a5d-d806-4d57-843e-f2add5efa154 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:52.894887 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f5a5d-d806-4d57-843e-f2add5efa154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:52.896994 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f5a5d-d806-4d57-843e-f2add5efa154 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:52.911444 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1150/2294] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:26:52.915694 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb603940-710f-40e2-bc0f-c0f1c84c3e95 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:52.926690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb603940-710f-40e2-bc0f-c0f1c84c3e95 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:52.931280 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838c13b-e5a4-44ae-b192-66ed916ddd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:52.931917 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838c13b-e5a4-44ae-b192-66ed916ddd40 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:52.932307 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838c13b-e5a4-44ae-b192-66ed916ddd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:52.932583 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838c13b-e5a4-44ae-b192-66ed916ddd40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:52.933301 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838c13b-e5a4-44ae-b192-66ed916ddd40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:52.934985 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838c13b-e5a4-44ae-b192-66ed916ddd40 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:52.936272 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:52.950794 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1145/2295] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:26:52.952356 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f5a5d-d806-4d57-843e-f2add5efa154 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:52.963915 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f5a5d-d806-4d57-843e-f2add5efa154 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:52.968987 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043d61c-423b-4d2a-8311-3edd14ff0440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:52.969705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043d61c-423b-4d2a-8311-3edd14ff0440 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:52.969987 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043d61c-423b-4d2a-8311-3edd14ff0440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:52.970270 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043d61c-423b-4d2a-8311-3edd14ff0440 admin admin] PATH_INFO: `/v3/projects/d6c6ae4fedff40a8b04c3c00ddb9dc10/users/47cfb946e8334b87b31bc7f30124492b/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:52.987430 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043d61c-423b-4d2a-8311-3edd14ff0440 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c6ae4fedff40a8b04c3c00ddb9dc10, user_id=47cfb946e8334b87b31bc7f30124492b, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:52.990331 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e043d61c-423b-4d2a-8311-3edd14ff0440 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:53.004903 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1151/2296] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:26:52 2022] PUT /identity/v3/projects/d6c6ae4fedff40a8b04c3c00ddb9dc10/users/47cfb946e8334b87b31bc7f30124492b/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:53.017793 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd9b14-2d41-49db-8f60-95250a05307e None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:53.018170 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd9b14-2d41-49db-8f60-95250a05307e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:53.018503 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabd9b14-2d41-49db-8f60-95250a05307e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:53.049639 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-cabd9b14-2d41-49db-8f60-95250a05307e None None] MFA Rules not processed for user `47cfb946e8334b87b31bc7f30124492b`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:53.050768 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-cabd9b14-2d41-49db-8f60-95250a05307e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:53.125008 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1146/2297] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:53.129460 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043d61c-423b-4d2a-8311-3edd14ff0440 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:53.200980 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e043d61c-423b-4d2a-8311-3edd14ff0440 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:53.205913 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c8ab1-8e81-496e-a9ca-3056ea9e939b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:53.206621 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c8ab1-8e81-496e-a9ca-3056ea9e939b admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:53.206902 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c8ab1-8e81-496e-a9ca-3056ea9e939b admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:53.207178 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52c8ab1-8e81-496e-a9ca-3056ea9e939b admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:53.207838 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c8ab1-8e81-496e-a9ca-3056ea9e939b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:53.209759 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52c8ab1-8e81-496e-a9ca-3056ea9e939b admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:53.245294 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1152/2298] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:26:53 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:26:53.251524 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd9b14-2d41-49db-8f60-95250a05307e None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:53.269910 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabd9b14-2d41-49db-8f60-95250a05307e None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:53.348864 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7acd6ec-4f8a-4e5b-aeb8-7cd81f535951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:53.349581 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acd6ec-4f8a-4e5b-aeb8-7cd81f535951 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:53.349971 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acd6ec-4f8a-4e5b-aeb8-7cd81f535951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:53.350275 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7acd6ec-4f8a-4e5b-aeb8-7cd81f535951 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:53.350966 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7acd6ec-4f8a-4e5b-aeb8-7cd81f535951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:53.353023 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7acd6ec-4f8a-4e5b-aeb8-7cd81f535951 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:53.381198 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c8ab1-8e81-496e-a9ca-3056ea9e939b admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:53.381591 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1147/2299] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:26:53 2022] POST /identity/v3/users => generated 294 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:26:53.393369 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52c8ab1-8e81-496e-a9ca-3056ea9e939b admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:53.398105 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719c263-0ea8-4920-9c79-17c7d630088e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:53.398737 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719c263-0ea8-4920-9c79-17c7d630088e admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:53.399023 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719c263-0ea8-4920-9c79-17c7d630088e admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:53.399307 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f719c263-0ea8-4920-9c79-17c7d630088e admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:53.400070 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719c263-0ea8-4920-9c79-17c7d630088e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:53.402292 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f719c263-0ea8-4920-9c79-17c7d630088e admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:53.414400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1153/2300] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 15:26:53.419082 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7acd6ec-4f8a-4e5b-aeb8-7cd81f535951 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:53.430338 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7acd6ec-4f8a-4e5b-aeb8-7cd81f535951 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:53.436009 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d78cc-a3cf-4095-b2e7-dbd67b7234f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:53.436736 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d78cc-a3cf-4095-b2e7-dbd67b7234f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:53.437044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d78cc-a3cf-4095-b2e7-dbd67b7234f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:53.438626 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d78cc-a3cf-4095-b2e7-dbd67b7234f8 admin admin] PATH_INFO: `/v3/projects/8e6fc5d47a7741e78de0cfc3b5883c9e/users/17750e27f00b44be84241a93d9f901cf/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:53.456662 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d78cc-a3cf-4095-b2e7-dbd67b7234f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e6fc5d47a7741e78de0cfc3b5883c9e, user_id=17750e27f00b44be84241a93d9f901cf, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:53.459371 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d78cc-a3cf-4095-b2e7-dbd67b7234f8 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:53.475185 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1148/2301] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:26:53 2022] PUT /identity/v3/projects/8e6fc5d47a7741e78de0cfc3b5883c9e/users/17750e27f00b44be84241a93d9f901cf/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:53.479808 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719c263-0ea8-4920-9c79-17c7d630088e admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:53.491171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f719c263-0ea8-4920-9c79-17c7d630088e admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:53.565559 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b091d60-fa45-4632-aeec-1aa95a9108e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:53.566347 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b091d60-fa45-4632-aeec-1aa95a9108e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:53.566729 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b091d60-fa45-4632-aeec-1aa95a9108e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:53.567094 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b091d60-fa45-4632-aeec-1aa95a9108e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:53.567895 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b091d60-fa45-4632-aeec-1aa95a9108e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:53.569582 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b091d60-fa45-4632-aeec-1aa95a9108e7 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:53.584485 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1154/2302] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:26:53 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:26:53.587272 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d78cc-a3cf-4095-b2e7-dbd67b7234f8 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:53.602558 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d78cc-a3cf-4095-b2e7-dbd67b7234f8 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:53.610549 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6600b-a991-402f-8422-9b452f323a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:53.611553 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6600b-a991-402f-8422-9b452f323a3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:53.612142 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6600b-a991-402f-8422-9b452f323a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:53.612661 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6600b-a991-402f-8422-9b452f323a3a admin admin] PATH_INFO: `/v3/projects/8e6fc5d47a7741e78de0cfc3b5883c9e/users/17750e27f00b44be84241a93d9f901cf/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:53.615462 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6600b-a991-402f-8422-9b452f323a3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e6fc5d47a7741e78de0cfc3b5883c9e, user_id=17750e27f00b44be84241a93d9f901cf, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:53.620310 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6600b-a991-402f-8422-9b452f323a3a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:53.634017 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1149/2303] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:26:53 2022] PUT /identity/v3/projects/8e6fc5d47a7741e78de0cfc3b5883c9e/users/17750e27f00b44be84241a93d9f901cf/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:53.645363 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb721488-cb58-4483-b547-c48a926030a9 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:53.645671 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb721488-cb58-4483-b547-c48a926030a9 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:53.646099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb721488-cb58-4483-b547-c48a926030a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:53.654708 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:53.689077 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-fb721488-cb58-4483-b547-c48a926030a9 None None] MFA Rules not processed for user `17750e27f00b44be84241a93d9f901cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:53.691668 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-fb721488-cb58-4483-b547-c48a926030a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:53.778613 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1155/2304] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:53.794505 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6600b-a991-402f-8422-9b452f323a3a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:53.796427 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f3d6600b-a991-402f-8422-9b452f323a3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:53.871580 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:53.893610 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6600b-a991-402f-8422-9b452f323a3a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:53.901285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f5918b-f233-472d-8806-825793e37ed9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:53.901922 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5918b-f233-472d-8806-825793e37ed9 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:53.902209 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5918b-f233-472d-8806-825793e37ed9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:53.902485 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f5918b-f233-472d-8806-825793e37ed9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:54.006623 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5918b-f233-472d-8806-825793e37ed9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:54.008112 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f5918b-f233-472d-8806-825793e37ed9 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:54.019485 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1150/2305] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:26:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:26:56.830320 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb721488-cb58-4483-b547-c48a926030a9 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:56.936114 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb721488-cb58-4483-b547-c48a926030a9 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:56.941073 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8cd1cf-a7a9-470a-88ac-e0fed5362cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:56.941725 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cd1cf-a7a9-470a-88ac-e0fed5362cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:56.942007 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cd1cf-a7a9-470a-88ac-e0fed5362cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:56.942284 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cd1cf-a7a9-470a-88ac-e0fed5362cb9 admin admin] PATH_INFO: `/v3/users/47cfb946e8334b87b31bc7f30124492b` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:56.943468 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8cd1cf-a7a9-470a-88ac-e0fed5362cb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47cfb946e8334b87b31bc7f30124492b)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:56.945431 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8cd1cf-a7a9-470a-88ac-e0fed5362cb9 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:57.050162 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1f8cd1cf-a7a9-470a-88ac-e0fed5362cb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47cfb946e8334b87b31bc7f30124492b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:57.051178 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1f8cd1cf-a7a9-470a-88ac-e0fed5362cb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47cfb946e8334b87b31bc7f30124492b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:57.059645 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1f8cd1cf-a7a9-470a-88ac-e0fed5362cb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47cfb946e8334b87b31bc7f30124492b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:57.070248 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1f8cd1cf-a7a9-470a-88ac-e0fed5362cb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47cfb946e8334b87b31bc7f30124492b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:57.089867 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1f8cd1cf-a7a9-470a-88ac-e0fed5362cb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47cfb946e8334b87b31bc7f30124492b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:57.098873 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1156/2306] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:26:56 2022] DELETE /identity/v3/users/47cfb946e8334b87b31bc7f30124492b => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:57.103757 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f192b-49fb-41d0-a313-aa39edbe672f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:57.105974 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f192b-49fb-41d0-a313-aa39edbe672f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:57.106257 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2f192b-49fb-41d0-a313-aa39edbe672f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:57.129040 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9a2f192b-49fb-41d0-a313-aa39edbe672f None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:57.130504 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9a2f192b-49fb-41d0-a313-aa39edbe672f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:57.209786 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1151/2307] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:57.221453 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8cd1cf-a7a9-470a-88ac-e0fed5362cb9 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:57.223512 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-1f8cd1cf-a7a9-470a-88ac-e0fed5362cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:57.235799 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:57.289433 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8cd1cf-a7a9-470a-88ac-e0fed5362cb9 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:57.294880 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa13bbd-a819-465d-873a-fd36c2dd72cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:57.295373 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa13bbd-a819-465d-873a-fd36c2dd72cd service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:57.295680 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa13bbd-a819-465d-873a-fd36c2dd72cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:57.295956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa13bbd-a819-465d-873a-fd36c2dd72cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:57.306830 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa13bbd-a819-465d-873a-fd36c2dd72cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:57.308431 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa13bbd-a819-465d-873a-fd36c2dd72cd service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:57.324170 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1157/2308] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:26:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 15:26:57.659720 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f192b-49fb-41d0-a313-aa39edbe672f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:57.661390 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9a2f192b-49fb-41d0-a313-aa39edbe672f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:57.685799 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2f192b-49fb-41d0-a313-aa39edbe672f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:57.706716 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a922c3f-7195-4caf-9eb0-b7830c2cd908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:57.707487 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a922c3f-7195-4caf-9eb0-b7830c2cd908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:57.708223 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a922c3f-7195-4caf-9eb0-b7830c2cd908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:57.708509 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a922c3f-7195-4caf-9eb0-b7830c2cd908 admin admin] PATH_INFO: `/v3/projects/d6c6ae4fedff40a8b04c3c00ddb9dc10` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:57.709702 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a922c3f-7195-4caf-9eb0-b7830c2cd908 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6c6ae4fedff40a8b04c3c00ddb9dc10)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:57.711659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a922c3f-7195-4caf-9eb0-b7830c2cd908 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:57.775160 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6a922c3f-7195-4caf-9eb0-b7830c2cd908 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6c6ae4fedff40a8b04c3c00ddb9dc10', 'request_id': 'req-6a922c3f-7195-4caf-9eb0-b7830c2cd908'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:57.786180 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6a922c3f-7195-4caf-9eb0-b7830c2cd908 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6c6ae4fedff40a8b04c3c00ddb9dc10', 'request_id': 'req-6a922c3f-7195-4caf-9eb0-b7830c2cd908'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:57.795268 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6a922c3f-7195-4caf-9eb0-b7830c2cd908 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6c6ae4fedff40a8b04c3c00ddb9dc10', 'request_id': 'req-6a922c3f-7195-4caf-9eb0-b7830c2cd908'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:57.812706 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6a922c3f-7195-4caf-9eb0-b7830c2cd908 admin admin] The token cache is being invalidate because project d6c6ae4fedff40a8b04c3c00ddb9dc10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:26:57.812999 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6a922c3f-7195-4caf-9eb0-b7830c2cd908 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:57.813730 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6a922c3f-7195-4caf-9eb0-b7830c2cd908 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:57.815246 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1152/2309] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:26:57 2022] DELETE /identity/v3/projects/d6c6ae4fedff40a8b04c3c00ddb9dc10 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:26:57.819842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa13bbd-a819-465d-873a-fd36c2dd72cd service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:57.833285 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa13bbd-a819-465d-873a-fd36c2dd72cd service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:57.913959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763e911-89b1-48d5-b42f-834cf419dd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:57.914577 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763e911-89b1-48d5-b42f-834cf419dd65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:57.914932 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763e911-89b1-48d5-b42f-834cf419dd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:57.915337 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763e911-89b1-48d5-b42f-834cf419dd65 admin admin] PATH_INFO: `/v3/users/17750e27f00b44be84241a93d9f901cf` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:57.917070 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763e911-89b1-48d5-b42f-834cf419dd65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17750e27f00b44be84241a93d9f901cf)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:57.918812 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763e911-89b1-48d5-b42f-834cf419dd65 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:57.981135 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f763e911-89b1-48d5-b42f-834cf419dd65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17750e27f00b44be84241a93d9f901cf'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:57.982055 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f763e911-89b1-48d5-b42f-834cf419dd65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17750e27f00b44be84241a93d9f901cf'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:57.992722 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f763e911-89b1-48d5-b42f-834cf419dd65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17750e27f00b44be84241a93d9f901cf'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:58.020170 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f763e911-89b1-48d5-b42f-834cf419dd65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17750e27f00b44be84241a93d9f901cf'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:58.048447 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f763e911-89b1-48d5-b42f-834cf419dd65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17750e27f00b44be84241a93d9f901cf'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:58.062524 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1158/2310] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:26:57 2022] DELETE /identity/v3/users/17750e27f00b44be84241a93d9f901cf => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:58.433316 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a922c3f-7195-4caf-9eb0-b7830c2cd908 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:58.436164 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6a922c3f-7195-4caf-9eb0-b7830c2cd908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:58.454452 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a922c3f-7195-4caf-9eb0-b7830c2cd908 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:58.470049 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:58.533509 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c88acfc-c303-4167-a839-10790c431a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:58.534357 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88acfc-c303-4167-a839-10790c431a23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:58.534894 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88acfc-c303-4167-a839-10790c431a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:58.535469 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88acfc-c303-4167-a839-10790c431a23 admin admin] PATH_INFO: `/v3/projects/8e6fc5d47a7741e78de0cfc3b5883c9e` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:58.536940 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c88acfc-c303-4167-a839-10790c431a23 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e6fc5d47a7741e78de0cfc3b5883c9e)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:58.539431 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c88acfc-c303-4167-a839-10790c431a23 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:58.610140 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3c88acfc-c303-4167-a839-10790c431a23 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e6fc5d47a7741e78de0cfc3b5883c9e', 'request_id': 'req-3c88acfc-c303-4167-a839-10790c431a23'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:58.617479 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3c88acfc-c303-4167-a839-10790c431a23 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e6fc5d47a7741e78de0cfc3b5883c9e', 'request_id': 'req-3c88acfc-c303-4167-a839-10790c431a23'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:58.625244 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3c88acfc-c303-4167-a839-10790c431a23 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e6fc5d47a7741e78de0cfc3b5883c9e', 'request_id': 'req-3c88acfc-c303-4167-a839-10790c431a23'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:58.639425 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3c88acfc-c303-4167-a839-10790c431a23 admin admin] The token cache is being invalidate because project 8e6fc5d47a7741e78de0cfc3b5883c9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:26:58.639723 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3c88acfc-c303-4167-a839-10790c431a23 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:58.640393 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3c88acfc-c303-4167-a839-10790c431a23 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:26:58.642186 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1153/2311] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:26:58 2022] DELETE /identity/v3/projects/8e6fc5d47a7741e78de0cfc3b5883c9e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:58.648053 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5f94f-76cb-4d49-95ee-dea31e44de6d None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:58.648528 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5f94f-76cb-4d49-95ee-dea31e44de6d None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:58.648990 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab5f94f-76cb-4d49-95ee-dea31e44de6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:58.670966 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-fab5f94f-76cb-4d49-95ee-dea31e44de6d None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:58.672557 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-fab5f94f-76cb-4d49-95ee-dea31e44de6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:58.700014 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:58.751592 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1159/2312] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:58.759295 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c098e6-6d1d-4db7-a3f1-0adcd2e383a9 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:58.759526 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c098e6-6d1d-4db7-a3f1-0adcd2e383a9 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:58.759817 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c098e6-6d1d-4db7-a3f1-0adcd2e383a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:58.780524 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b3c098e6-6d1d-4db7-a3f1-0adcd2e383a9 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:58.781767 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b3c098e6-6d1d-4db7-a3f1-0adcd2e383a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:58.790683 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1154/2313] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:58.795745 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5f94f-76cb-4d49-95ee-dea31e44de6d None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:58.806303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab5f94f-76cb-4d49-95ee-dea31e44de6d None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:58.812300 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003771d-2991-49be-8e17-08f06738df4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:58.813333 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003771d-2991-49be-8e17-08f06738df4e admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:58.813873 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003771d-2991-49be-8e17-08f06738df4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:58.814332 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f003771d-2991-49be-8e17-08f06738df4e admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:58.815231 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003771d-2991-49be-8e17-08f06738df4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:26:58.815653 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003771d-2991-49be-8e17-08f06738df4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:58.817465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f003771d-2991-49be-8e17-08f06738df4e admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:58.831635 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1160/2314] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:26:58.837675 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c098e6-6d1d-4db7-a3f1-0adcd2e383a9 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:58.852031 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c098e6-6d1d-4db7-a3f1-0adcd2e383a9 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:58.858358 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754317cb-3cb4-46fb-a058-cf621e9d4602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:58.859274 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754317cb-3cb4-46fb-a058-cf621e9d4602 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:58.859622 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754317cb-3cb4-46fb-a058-cf621e9d4602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:58.860067 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754317cb-3cb4-46fb-a058-cf621e9d4602 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:58.860739 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754317cb-3cb4-46fb-a058-cf621e9d4602 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:58.862964 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754317cb-3cb4-46fb-a058-cf621e9d4602 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:58.902554 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1155/2315] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:26:58 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:26:58.904920 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003771d-2991-49be-8e17-08f06738df4e admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:58.919894 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f003771d-2991-49be-8e17-08f06738df4e admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:58.986081 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf701536-8c91-4d3a-a4ff-6692dc1f3ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:58.986806 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf701536-8c91-4d3a-a4ff-6692dc1f3ffa admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:58.987185 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf701536-8c91-4d3a-a4ff-6692dc1f3ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:58.987494 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf701536-8c91-4d3a-a4ff-6692dc1f3ffa admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:58.988473 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf701536-8c91-4d3a-a4ff-6692dc1f3ffa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:58.990511 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf701536-8c91-4d3a-a4ff-6692dc1f3ffa admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:59.019670 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1161/2316] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:26:58 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:26:59.023580 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754317cb-3cb4-46fb-a058-cf621e9d4602 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:59.043860 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754317cb-3cb4-46fb-a058-cf621e9d4602 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:59.050874 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac56347-26fe-43c9-aae1-bf8e60303ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:59.051508 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac56347-26fe-43c9-aae1-bf8e60303ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:59.051793 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac56347-26fe-43c9-aae1-bf8e60303ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:59.052277 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac56347-26fe-43c9-aae1-bf8e60303ed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:59.053147 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac56347-26fe-43c9-aae1-bf8e60303ed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:59.054830 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac56347-26fe-43c9-aae1-bf8e60303ed0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:59.072039 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1156/2317] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:26:59.074801 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf701536-8c91-4d3a-a4ff-6692dc1f3ffa admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:59.085678 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf701536-8c91-4d3a-a4ff-6692dc1f3ffa admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:59.094507 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8df59a-ba84-443f-932c-7bc1d1f16f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:59.099261 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8df59a-ba84-443f-932c-7bc1d1f16f16 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:59.099983 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8df59a-ba84-443f-932c-7bc1d1f16f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:59.101511 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8df59a-ba84-443f-932c-7bc1d1f16f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:59.105721 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8df59a-ba84-443f-932c-7bc1d1f16f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:59.107927 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8df59a-ba84-443f-932c-7bc1d1f16f16 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:59.130864 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1162/2318] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:26:59.134197 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac56347-26fe-43c9-aae1-bf8e60303ed0 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:59.158890 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac56347-26fe-43c9-aae1-bf8e60303ed0 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:59.170139 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df8c06-67c9-4dc6-b8bb-653956906bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:59.170984 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df8c06-67c9-4dc6-b8bb-653956906bdf admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:59.171350 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df8c06-67c9-4dc6-b8bb-653956906bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:59.171941 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0df8c06-67c9-4dc6-b8bb-653956906bdf admin admin] PATH_INFO: `/v3/projects/973d3d39b20447389e8351804064ffdb/users/dbf4182a42094b26bc400fdd18119002/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:59.197061 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df8c06-67c9-4dc6-b8bb-653956906bdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=973d3d39b20447389e8351804064ffdb, user_id=dbf4182a42094b26bc400fdd18119002, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:59.199065 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0df8c06-67c9-4dc6-b8bb-653956906bdf admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:59.218745 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1157/2319] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:26:59 2022] PUT /identity/v3/projects/973d3d39b20447389e8351804064ffdb/users/dbf4182a42094b26bc400fdd18119002/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:26:59.230634 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640bd00-8571-4219-90ce-9a7fa435e987 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:59.231063 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640bd00-8571-4219-90ce-9a7fa435e987 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:59.231644 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640bd00-8571-4219-90ce-9a7fa435e987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:59.276580 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-2640bd00-8571-4219-90ce-9a7fa435e987 None None] MFA Rules not processed for user `dbf4182a42094b26bc400fdd18119002`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:26:59.277913 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-2640bd00-8571-4219-90ce-9a7fa435e987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:59.352045 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1163/2320] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:26:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:26:59.362820 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df8c06-67c9-4dc6-b8bb-653956906bdf admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:26:59.364743 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c0df8c06-67c9-4dc6-b8bb-653956906bdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:26:59.422077 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:26:59.437883 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0df8c06-67c9-4dc6-b8bb-653956906bdf admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:26:59.443919 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da92af8-7ce3-42b8-837a-5753c714c7f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:26:59.444566 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da92af8-7ce3-42b8-837a-5753c714c7f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:26:59.444856 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da92af8-7ce3-42b8-837a-5753c714c7f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:26:59.445131 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da92af8-7ce3-42b8-837a-5753c714c7f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:26:59.454116 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da92af8-7ce3-42b8-837a-5753c714c7f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:26:59.455538 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da92af8-7ce3-42b8-837a-5753c714c7f1 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:26:59.464849 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1158/2321] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:26:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:27:00.304614 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640bd00-8571-4219-90ce-9a7fa435e987 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:00.306348 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-2640bd00-8571-4219-90ce-9a7fa435e987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:00.366221 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:27:00.413490 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640bd00-8571-4219-90ce-9a7fa435e987 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:00.418266 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272daff0-d9f1-44a8-8bd7-0f26d1201908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:00.418908 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272daff0-d9f1-44a8-8bd7-0f26d1201908 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:00.419194 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272daff0-d9f1-44a8-8bd7-0f26d1201908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:00.419466 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272daff0-d9f1-44a8-8bd7-0f26d1201908 admin admin] PATH_INFO: `/v3/users/20cdeed33451489aa91570d45c49cf56` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:00.420975 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272daff0-d9f1-44a8-8bd7-0f26d1201908 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20cdeed33451489aa91570d45c49cf56)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:00.422972 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272daff0-d9f1-44a8-8bd7-0f26d1201908 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:00.523754 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-272daff0-d9f1-44a8-8bd7-0f26d1201908 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20cdeed33451489aa91570d45c49cf56'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:00.524613 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-272daff0-d9f1-44a8-8bd7-0f26d1201908 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20cdeed33451489aa91570d45c49cf56'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:00.532304 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-272daff0-d9f1-44a8-8bd7-0f26d1201908 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20cdeed33451489aa91570d45c49cf56'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:00.539803 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-272daff0-d9f1-44a8-8bd7-0f26d1201908 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20cdeed33451489aa91570d45c49cf56'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:00.555248 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-272daff0-d9f1-44a8-8bd7-0f26d1201908 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20cdeed33451489aa91570d45c49cf56'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:00.564669 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1164/2322] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:27:00 2022] DELETE /identity/v3/users/20cdeed33451489aa91570d45c49cf56 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:27:00.569667 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd8d97-b5e8-421a-ba5f-db12ac23a385 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:00.570832 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd8d97-b5e8-421a-ba5f-db12ac23a385 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:00.598530 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bd8d97-b5e8-421a-ba5f-db12ac23a385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:00.625368 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-10bd8d97-b5e8-421a-ba5f-db12ac23a385 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:27:00.629501 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-10bd8d97-b5e8-421a-ba5f-db12ac23a385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:00.710648 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1159/2323] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:27:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:27:00.717370 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272daff0-d9f1-44a8-8bd7-0f26d1201908 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:00.719849 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-272daff0-d9f1-44a8-8bd7-0f26d1201908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:00.799309 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272daff0-d9f1-44a8-8bd7-0f26d1201908 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:00.803179 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b020933-b0cb-4178-a9b5-3317cc4599ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:00.803868 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b020933-b0cb-4178-a9b5-3317cc4599ce service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:00.804394 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b020933-b0cb-4178-a9b5-3317cc4599ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:00.804811 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b020933-b0cb-4178-a9b5-3317cc4599ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:00.818297 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b020933-b0cb-4178-a9b5-3317cc4599ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:00.820496 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b020933-b0cb-4178-a9b5-3317cc4599ce service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:00.835201 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1165/2324] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:27:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 15:27:01.269170 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd8d97-b5e8-421a-ba5f-db12ac23a385 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:01.271202 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-10bd8d97-b5e8-421a-ba5f-db12ac23a385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:01.315723 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bd8d97-b5e8-421a-ba5f-db12ac23a385 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:01.331268 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d911dde-ac68-4800-9777-c965cfa74374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:01.332027 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d911dde-ac68-4800-9777-c965cfa74374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:01.332383 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d911dde-ac68-4800-9777-c965cfa74374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:01.332728 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d911dde-ac68-4800-9777-c965cfa74374 admin admin] PATH_INFO: `/v3/projects/bc246b90006e41a1aec45ee204a95086` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:01.333995 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d911dde-ac68-4800-9777-c965cfa74374 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc246b90006e41a1aec45ee204a95086)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:01.336936 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d911dde-ac68-4800-9777-c965cfa74374 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:01.417002 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5d911dde-ac68-4800-9777-c965cfa74374 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc246b90006e41a1aec45ee204a95086', 'request_id': 'req-5d911dde-ac68-4800-9777-c965cfa74374'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:01.434034 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5d911dde-ac68-4800-9777-c965cfa74374 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc246b90006e41a1aec45ee204a95086', 'request_id': 'req-5d911dde-ac68-4800-9777-c965cfa74374'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:01.453857 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5d911dde-ac68-4800-9777-c965cfa74374 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc246b90006e41a1aec45ee204a95086', 'request_id': 'req-5d911dde-ac68-4800-9777-c965cfa74374'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:01.478202 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5d911dde-ac68-4800-9777-c965cfa74374 admin admin] The token cache is being invalidate because project bc246b90006e41a1aec45ee204a95086 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:27:01.478505 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5d911dde-ac68-4800-9777-c965cfa74374 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:01.479218 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5d911dde-ac68-4800-9777-c965cfa74374 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:01.481812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1160/2325] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:27:01 2022] DELETE /identity/v3/projects/bc246b90006e41a1aec45ee204a95086 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:27:01.486653 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86757a62-1483-46e6-a797-ccc4a3479646 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:01.487580 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86757a62-1483-46e6-a797-ccc4a3479646 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:01.488022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86757a62-1483-46e6-a797-ccc4a3479646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:01.515304 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-86757a62-1483-46e6-a797-ccc4a3479646 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:27:01.516662 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-86757a62-1483-46e6-a797-ccc4a3479646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:01.564320 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:27:01.599984 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1166/2326] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:27:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:27:01.609620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6690f05-a64b-434c-9a6d-caaf1beebb52 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:01.610622 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6690f05-a64b-434c-9a6d-caaf1beebb52 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:01.611173 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6690f05-a64b-434c-9a6d-caaf1beebb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:01.634308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-e6690f05-a64b-434c-9a6d-caaf1beebb52 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:27:01.636487 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e6690f05-a64b-434c-9a6d-caaf1beebb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:01.647413 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1161/2327] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:27:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:27:01.652197 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86757a62-1483-46e6-a797-ccc4a3479646 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:01.670636 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86757a62-1483-46e6-a797-ccc4a3479646 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:01.677346 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ee430-9577-412f-ba46-571bdd8890ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:01.677957 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ee430-9577-412f-ba46-571bdd8890ee admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:01.679776 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ee430-9577-412f-ba46-571bdd8890ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:01.680093 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3ee430-9577-412f-ba46-571bdd8890ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:01.680806 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ee430-9577-412f-ba46-571bdd8890ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:27:01.681112 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ee430-9577-412f-ba46-571bdd8890ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:01.683237 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3ee430-9577-412f-ba46-571bdd8890ee admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:01.696125 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1167/2328] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:27:01.701302 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6690f05-a64b-434c-9a6d-caaf1beebb52 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:01.712951 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6690f05-a64b-434c-9a6d-caaf1beebb52 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:01.718248 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a754028-c120-4888-bc46-9d99a7e4e607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:01.718957 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a754028-c120-4888-bc46-9d99a7e4e607 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:01.719335 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a754028-c120-4888-bc46-9d99a7e4e607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:01.719704 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a754028-c120-4888-bc46-9d99a7e4e607 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:01.720611 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a754028-c120-4888-bc46-9d99a7e4e607 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:01.722881 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a754028-c120-4888-bc46-9d99a7e4e607 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:01.762179 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1162/2329] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:27:01 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:27:01.763925 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ee430-9577-412f-ba46-571bdd8890ee admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:01.774886 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3ee430-9577-412f-ba46-571bdd8890ee admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:01.848336 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0752f3-8843-49a8-a305-7af69593e66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:01.848977 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0752f3-8843-49a8-a305-7af69593e66e admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:01.849238 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0752f3-8843-49a8-a305-7af69593e66e admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:01.849511 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0752f3-8843-49a8-a305-7af69593e66e admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:01.850170 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0752f3-8843-49a8-a305-7af69593e66e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:01.852116 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0752f3-8843-49a8-a305-7af69593e66e admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:01.882473 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1168/2330] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:27:01 2022] POST /identity/v3/users => generated 288 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:27:01.886612 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a754028-c120-4888-bc46-9d99a7e4e607 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:01.897674 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a754028-c120-4888-bc46-9d99a7e4e607 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:01.905590 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa67ca-c9a7-41b5-84a1-6a41dd5aa72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:01.908054 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa67ca-c9a7-41b5-84a1-6a41dd5aa72c admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:01.908054 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa67ca-c9a7-41b5-84a1-6a41dd5aa72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:01.908054 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa67ca-c9a7-41b5-84a1-6a41dd5aa72c admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:01.909535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa67ca-c9a7-41b5-84a1-6a41dd5aa72c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:01.911278 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa67ca-c9a7-41b5-84a1-6a41dd5aa72c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:01.928211 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1163/2331] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:27:01.929837 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0752f3-8843-49a8-a305-7af69593e66e admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:01.945475 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0752f3-8843-49a8-a305-7af69593e66e admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:01.952247 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3801d-097d-422d-af9a-ebb2e4d31b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:01.953352 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3801d-097d-422d-af9a-ebb2e4d31b59 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:01.953641 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3801d-097d-422d-af9a-ebb2e4d31b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:01.953913 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3801d-097d-422d-af9a-ebb2e4d31b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:01.954798 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3801d-097d-422d-af9a-ebb2e4d31b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:01.956721 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3801d-097d-422d-af9a-ebb2e4d31b59 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:01.969491 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1169/2332] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:27:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:27:01.974159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa67ca-c9a7-41b5-84a1-6a41dd5aa72c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:01.985252 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa67ca-c9a7-41b5-84a1-6a41dd5aa72c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:01.990415 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d288303-c3f2-4a43-9dcd-5208c7b120b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:01.991247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d288303-c3f2-4a43-9dcd-5208c7b120b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:01.991567 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d288303-c3f2-4a43-9dcd-5208c7b120b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:01.991923 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d288303-c3f2-4a43-9dcd-5208c7b120b4 admin admin] PATH_INFO: `/v3/projects/d66d2ad442af4eba961e8c975291e021/users/4a5bf4c88e87446d82bec92afbf316e2/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:02.009266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d288303-c3f2-4a43-9dcd-5208c7b120b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d66d2ad442af4eba961e8c975291e021, user_id=4a5bf4c88e87446d82bec92afbf316e2, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:02.012156 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d288303-c3f2-4a43-9dcd-5208c7b120b4 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:02.029617 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1164/2333] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:27:01 2022] PUT /identity/v3/projects/d66d2ad442af4eba961e8c975291e021/users/4a5bf4c88e87446d82bec92afbf316e2/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:27:02.042426 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd76df0-7c5d-428f-ad59-1f34331b9ab6 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:02.043283 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd76df0-7c5d-428f-ad59-1f34331b9ab6 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:02.043283 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd76df0-7c5d-428f-ad59-1f34331b9ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:02.076272 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-7cd76df0-7c5d-428f-ad59-1f34331b9ab6 None None] MFA Rules not processed for user `4a5bf4c88e87446d82bec92afbf316e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:27:02.078146 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-7cd76df0-7c5d-428f-ad59-1f34331b9ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:02.157918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1170/2334] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:27:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:27:02.168828 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d288303-c3f2-4a43-9dcd-5208c7b120b4 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:02.171037 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2d288303-c3f2-4a43-9dcd-5208c7b120b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:02.178048 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:27:02.237598 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d288303-c3f2-4a43-9dcd-5208c7b120b4 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:02.242951 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b61104-0d23-40ff-8af5-fe2f9eae59c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:02.243694 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b61104-0d23-40ff-8af5-fe2f9eae59c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:02.244114 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b61104-0d23-40ff-8af5-fe2f9eae59c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:02.244506 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b61104-0d23-40ff-8af5-fe2f9eae59c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:02.253778 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b61104-0d23-40ff-8af5-fe2f9eae59c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:02.255455 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b61104-0d23-40ff-8af5-fe2f9eae59c0 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:02.266634 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1165/2335] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:27:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:27:02.991760 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd76df0-7c5d-428f-ad59-1f34331b9ab6 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:02.993363 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-7cd76df0-7c5d-428f-ad59-1f34331b9ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:03.054264 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:27:03.084924 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd76df0-7c5d-428f-ad59-1f34331b9ab6 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:03.092078 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c6492-5faa-48c4-87a5-baad1b893591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:03.092904 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c6492-5faa-48c4-87a5-baad1b893591 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:03.093718 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c6492-5faa-48c4-87a5-baad1b893591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:03.094489 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c6492-5faa-48c4-87a5-baad1b893591 admin admin] PATH_INFO: `/v3/users/dbf4182a42094b26bc400fdd18119002` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:03.095860 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c6492-5faa-48c4-87a5-baad1b893591 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbf4182a42094b26bc400fdd18119002)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:03.098734 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c6492-5faa-48c4-87a5-baad1b893591 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:03.159955 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4e4c6492-5faa-48c4-87a5-baad1b893591 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbf4182a42094b26bc400fdd18119002'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:03.160894 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4e4c6492-5faa-48c4-87a5-baad1b893591 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbf4182a42094b26bc400fdd18119002'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:03.183229 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4e4c6492-5faa-48c4-87a5-baad1b893591 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbf4182a42094b26bc400fdd18119002'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:03.192635 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4e4c6492-5faa-48c4-87a5-baad1b893591 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbf4182a42094b26bc400fdd18119002'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:03.207627 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4e4c6492-5faa-48c4-87a5-baad1b893591 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbf4182a42094b26bc400fdd18119002'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:03.217928 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1171/2336] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:27:02 2022] DELETE /identity/v3/users/dbf4182a42094b26bc400fdd18119002 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:27:03.222758 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135e2c6-a8be-4666-ae76-295759336113 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:03.223537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135e2c6-a8be-4666-ae76-295759336113 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:03.223537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3135e2c6-a8be-4666-ae76-295759336113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:03.253725 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-3135e2c6-a8be-4666-ae76-295759336113 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:27:03.256019 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3135e2c6-a8be-4666-ae76-295759336113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:03.349761 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1166/2337] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:27:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:27:03.359761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c6492-5faa-48c4-87a5-baad1b893591 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:03.361581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-4e4c6492-5faa-48c4-87a5-baad1b893591 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:03.449404 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c6492-5faa-48c4-87a5-baad1b893591 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:03.455230 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28313b-222a-46cb-94dc-f90c25f67707 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:03.456888 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28313b-222a-46cb-94dc-f90c25f67707 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:03.457175 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28313b-222a-46cb-94dc-f90c25f67707 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:03.457462 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b28313b-222a-46cb-94dc-f90c25f67707 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:03.471062 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28313b-222a-46cb-94dc-f90c25f67707 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:03.472956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b28313b-222a-46cb-94dc-f90c25f67707 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:03.486079 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1172/2338] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:27:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:27:03.749237 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cbe21-e717-4460-a3a7-274b209ba251 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:03.749237 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cbe21-e717-4460-a3a7-274b209ba251 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:03.749237 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154cbe21-e717-4460-a3a7-274b209ba251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:03.772740 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-154cbe21-e717-4460-a3a7-274b209ba251 None None] MFA Rules not processed for user `4a5bf4c88e87446d82bec92afbf316e2`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:27:03.774031 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-154cbe21-e717-4460-a3a7-274b209ba251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:03.848318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1167/2339] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:27:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:27:04.067233 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28313b-222a-46cb-94dc-f90c25f67707 service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:04.070296 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-1b28313b-222a-46cb-94dc-f90c25f67707 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:04.151047 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b28313b-222a-46cb-94dc-f90c25f67707 service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:04.157792 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef112e-8186-4cea-a44c-7e63adb33503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:04.158829 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef112e-8186-4cea-a44c-7e63adb33503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:04.159270 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef112e-8186-4cea-a44c-7e63adb33503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:04.159633 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef112e-8186-4cea-a44c-7e63adb33503 admin admin] PATH_INFO: `/v3/projects/973d3d39b20447389e8351804064ffdb` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:04.160986 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef112e-8186-4cea-a44c-7e63adb33503 admin admin] RBAC: Authorizing `identity:delete_project(project_id=973d3d39b20447389e8351804064ffdb)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:04.162947 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef112e-8186-4cea-a44c-7e63adb33503 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:04.382292 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2eef112e-8186-4cea-a44c-7e63adb33503 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '973d3d39b20447389e8351804064ffdb', 'request_id': 'req-2eef112e-8186-4cea-a44c-7e63adb33503'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:04.390817 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2eef112e-8186-4cea-a44c-7e63adb33503 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '973d3d39b20447389e8351804064ffdb', 'request_id': 'req-2eef112e-8186-4cea-a44c-7e63adb33503'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:04.402453 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:27:04.409436 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2eef112e-8186-4cea-a44c-7e63adb33503 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '973d3d39b20447389e8351804064ffdb', 'request_id': 'req-2eef112e-8186-4cea-a44c-7e63adb33503'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:04.433998 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2eef112e-8186-4cea-a44c-7e63adb33503 admin admin] The token cache is being invalidate because project 973d3d39b20447389e8351804064ffdb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:27:04.434312 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2eef112e-8186-4cea-a44c-7e63adb33503 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:04.435772 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-2eef112e-8186-4cea-a44c-7e63adb33503 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:04.439801 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1173/2340] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:27:04 2022] DELETE /identity/v3/projects/973d3d39b20447389e8351804064ffdb => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:27:04.445083 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463bc53-58fa-4f65-985b-abf966616e40 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:04.446047 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463bc53-58fa-4f65-985b-abf966616e40 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:04.446528 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b463bc53-58fa-4f65-985b-abf966616e40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:04.485077 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b463bc53-58fa-4f65-985b-abf966616e40 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:27:04.486361 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b463bc53-58fa-4f65-985b-abf966616e40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:04.543742 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:27:04.562625 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1168/2341] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:27:04.571737 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2c120-9c82-4041-a37d-f613ce49541f None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:04.572051 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2c120-9c82-4041-a37d-f613ce49541f None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:04.572334 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d2c120-9c82-4041-a37d-f613ce49541f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:04.608438 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-b1d2c120-9c82-4041-a37d-f613ce49541f None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:27:04.609626 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b1d2c120-9c82-4041-a37d-f613ce49541f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:04.620421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1174/2342] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:27:04.623861 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463bc53-58fa-4f65-985b-abf966616e40 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:04.638487 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b463bc53-58fa-4f65-985b-abf966616e40 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:04.644277 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236dbff-e2a7-439f-9fad-3df865192b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:04.644903 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236dbff-e2a7-439f-9fad-3df865192b46 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:04.645348 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236dbff-e2a7-439f-9fad-3df865192b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:04.645646 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b236dbff-e2a7-439f-9fad-3df865192b46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:04.646317 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b236dbff-e2a7-439f-9fad-3df865192b46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:27:04.646668 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b236dbff-e2a7-439f-9fad-3df865192b46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:04.648253 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b236dbff-e2a7-439f-9fad-3df865192b46 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:04.693864 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1169/2343] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:27:04.701331 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2c120-9c82-4041-a37d-f613ce49541f None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:04.712968 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d2c120-9c82-4041-a37d-f613ce49541f None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:04.718926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37ebec-1c23-47f7-a452-a9fcfc7ad044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:04.719641 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37ebec-1c23-47f7-a452-a9fcfc7ad044 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:04.720208 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37ebec-1c23-47f7-a452-a9fcfc7ad044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:04.720560 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37ebec-1c23-47f7-a452-a9fcfc7ad044 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:04.721363 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37ebec-1c23-47f7-a452-a9fcfc7ad044 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:04.724157 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37ebec-1c23-47f7-a452-a9fcfc7ad044 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:04.779727 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236dbff-e2a7-439f-9fad-3df865192b46 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:04.785353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1175/2344] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:27:04 2022] POST /identity/v3/projects => generated 367 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:27:04.798938 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b236dbff-e2a7-439f-9fad-3df865192b46 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:04.901791 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0795e9-aa0b-4cf2-a8bb-aac69156d0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:04.902555 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0795e9-aa0b-4cf2-a8bb-aac69156d0ba admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:04.902828 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0795e9-aa0b-4cf2-a8bb-aac69156d0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:04.903093 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0795e9-aa0b-4cf2-a8bb-aac69156d0ba admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:04.903771 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0795e9-aa0b-4cf2-a8bb-aac69156d0ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:04.905878 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0795e9-aa0b-4cf2-a8bb-aac69156d0ba admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:04.948039 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1170/2345] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:27:04 2022] POST /identity/v3/users => generated 284 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:27:04.951621 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37ebec-1c23-47f7-a452-a9fcfc7ad044 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:04.967129 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37ebec-1c23-47f7-a452-a9fcfc7ad044 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:04.981177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d6d81-2a47-40a4-8fe0-3e855bfaf5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:04.983031 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d6d81-2a47-40a4-8fe0-3e855bfaf5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:04.984174 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d6d81-2a47-40a4-8fe0-3e855bfaf5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:04.984856 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d6d81-2a47-40a4-8fe0-3e855bfaf5c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:04.987668 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2d6d81-2a47-40a4-8fe0-3e855bfaf5c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:04.990150 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2d6d81-2a47-40a4-8fe0-3e855bfaf5c9 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:05.010647 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1176/2346] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:27:05.012377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0795e9-aa0b-4cf2-a8bb-aac69156d0ba admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:05.028660 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0795e9-aa0b-4cf2-a8bb-aac69156d0ba admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:05.034707 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb66558e-0469-4253-afa1-2ea9208121f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:05.035377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66558e-0469-4253-afa1-2ea9208121f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:05.035775 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66558e-0469-4253-afa1-2ea9208121f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:05.036092 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb66558e-0469-4253-afa1-2ea9208121f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:05.036765 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb66558e-0469-4253-afa1-2ea9208121f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:05.038413 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb66558e-0469-4253-afa1-2ea9208121f6 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:05.052031 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1171/2347] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:27:05.057903 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d6d81-2a47-40a4-8fe0-3e855bfaf5c9 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:05.071023 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d6d81-2a47-40a4-8fe0-3e855bfaf5c9 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:05.078747 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4632e-9ec4-492d-b6be-939fe9ca4725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:05.079599 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4632e-9ec4-492d-b6be-939fe9ca4725 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:05.079883 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4632e-9ec4-492d-b6be-939fe9ca4725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:05.080206 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b4632e-9ec4-492d-b6be-939fe9ca4725 admin admin] PATH_INFO: `/v3/projects/4e6bdc97cdc44684a823cf49a880ae1e/users/948250a5cfdf483c8bb7984fb7a113a1/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:05.097977 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4632e-9ec4-492d-b6be-939fe9ca4725 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e6bdc97cdc44684a823cf49a880ae1e, user_id=948250a5cfdf483c8bb7984fb7a113a1, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:05.100643 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b4632e-9ec4-492d-b6be-939fe9ca4725 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:05.116102 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1177/2348] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:27:05 2022] PUT /identity/v3/projects/4e6bdc97cdc44684a823cf49a880ae1e/users/948250a5cfdf483c8bb7984fb7a113a1/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:27:05.130542 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f5e21-c296-491f-844b-d79c9b00e462 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:05.130844 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f5e21-c296-491f-844b-d79c9b00e462 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:05.131119 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f5e21-c296-491f-844b-d79c9b00e462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:05.163886 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-590f5e21-c296-491f-844b-d79c9b00e462 None None] MFA Rules not processed for user `948250a5cfdf483c8bb7984fb7a113a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:27:05.165340 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-590f5e21-c296-491f-844b-d79c9b00e462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:05.246680 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1172/2349] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:27:05 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:27:05.259067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4632e-9ec4-492d-b6be-939fe9ca4725 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:05.261139 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e1b4632e-9ec4-492d-b6be-939fe9ca4725 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:05.325263 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b4632e-9ec4-492d-b6be-939fe9ca4725 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:05.329224 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ae2f2-3a67-41f0-bda3-1ccacc2492e5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f71721ca75a461d92044091564de424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:05.330030 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ae2f2-3a67-41f0-bda3-1ccacc2492e5 service glance] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:05.330471 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ae2f2-3a67-41f0-bda3-1ccacc2492e5 service glance] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:05.330766 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ae2f2-3a67-41f0-bda3-1ccacc2492e5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:05.339947 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ae2f2-3a67-41f0-bda3-1ccacc2492e5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:05.341470 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ae2f2-3a67-41f0-bda3-1ccacc2492e5 service glance] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:05.350963 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1178/2350] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:27:05 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:27:10.045503 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde77529-3807-4d61-b063-e24d04472346 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:10.046034 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde77529-3807-4d61-b063-e24d04472346 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:10.046122 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde77529-3807-4d61-b063-e24d04472346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:10.071519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-cde77529-3807-4d61-b063-e24d04472346 None None] MFA Rules not processed for user `b470b4c2ca1a4d1a8a864789bf603d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:27:10.073693 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-cde77529-3807-4d61-b063-e24d04472346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:10.128635 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:27:10.142752 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1173/2351] 10.222.0.40 () {58 vars in 967 bytes} [Wed Jul 27 15:27:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:27:10.169052 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ae2f2-3a67-41f0-bda3-1ccacc2492e5 service glance] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:10.170547 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-582ae2f2-3a67-41f0-bda3-1ccacc2492e5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:10.275579 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ae2f2-3a67-41f0-bda3-1ccacc2492e5 service glance] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:10.280737 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c533cc-3479-451b-963a-f98082d8520f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68bbf8bb59a84829afacd9677c9639a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:10.281362 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c533cc-3479-451b-963a-f98082d8520f service swift] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:10.281692 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c533cc-3479-451b-963a-f98082d8520f service swift] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:10.282071 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c533cc-3479-451b-963a-f98082d8520f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:10.291155 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c533cc-3479-451b-963a-f98082d8520f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:10.293873 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c533cc-3479-451b-963a-f98082d8520f service swift] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:10.303126 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1179/2352] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Jul 27 15:27:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 15:27:11.529304 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0549f97-83fb-46f2-9ecb-6f9107f160c3 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:11.530174 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0549f97-83fb-46f2-9ecb-6f9107f160c3 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:11.530174 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0549f97-83fb-46f2-9ecb-6f9107f160c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:11.548918 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d0549f97-83fb-46f2-9ecb-6f9107f160c3 None None] MFA Rules not processed for user `d815c45c04314dd0abe18cd9b4d9b744`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:27:11.550100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d0549f97-83fb-46f2-9ecb-6f9107f160c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:11.604343 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1174/2353] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:27:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:27:12.371567 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c533cc-3479-451b-963a-f98082d8520f service swift] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:12.373580 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b9c533cc-3479-451b-963a-f98082d8520f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:12.399823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:27:12.452794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c533cc-3479-451b-963a-f98082d8520f service swift] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:12.457540 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b494245-eb9c-4e71-8b6f-93f5133e3a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:12.458182 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b494245-eb9c-4e71-8b6f-93f5133e3a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:12.458455 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b494245-eb9c-4e71-8b6f-93f5133e3a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:12.458894 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b494245-eb9c-4e71-8b6f-93f5133e3a68 admin admin] PATH_INFO: `/v3/users/4c5b5285ca70478ca580f7661663f522` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:12.460076 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b494245-eb9c-4e71-8b6f-93f5133e3a68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c5b5285ca70478ca580f7661663f522)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:12.462009 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b494245-eb9c-4e71-8b6f-93f5133e3a68 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:12.507804 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1b494245-eb9c-4e71-8b6f-93f5133e3a68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c5b5285ca70478ca580f7661663f522'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:12.508533 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1b494245-eb9c-4e71-8b6f-93f5133e3a68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c5b5285ca70478ca580f7661663f522'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:12.516900 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1b494245-eb9c-4e71-8b6f-93f5133e3a68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c5b5285ca70478ca580f7661663f522'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:12.524684 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1b494245-eb9c-4e71-8b6f-93f5133e3a68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c5b5285ca70478ca580f7661663f522'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:12.538062 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-1b494245-eb9c-4e71-8b6f-93f5133e3a68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c5b5285ca70478ca580f7661663f522'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:12.544988 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1180/2354] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:27:12 2022] DELETE /identity/v3/users/4c5b5285ca70478ca580f7661663f522 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:27:12.825053 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0549f97-83fb-46f2-9ecb-6f9107f160c3 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:12.836781 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0549f97-83fb-46f2-9ecb-6f9107f160c3 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:12.893890 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc22e7-5cc3-4a45-acfb-de23de766ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:12.894541 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc22e7-5cc3-4a45-acfb-de23de766ea2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:12.894821 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc22e7-5cc3-4a45-acfb-de23de766ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:12.895092 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc22e7-5cc3-4a45-acfb-de23de766ea2 admin admin] PATH_INFO: `/v3/projects/62dd80f0e7794f9ca582fb9206ddc289` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:12.896304 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc22e7-5cc3-4a45-acfb-de23de766ea2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62dd80f0e7794f9ca582fb9206ddc289)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:12.898194 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc22e7-5cc3-4a45-acfb-de23de766ea2 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:12.944448 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-79fc22e7-5cc3-4a45-acfb-de23de766ea2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62dd80f0e7794f9ca582fb9206ddc289', 'request_id': 'req-79fc22e7-5cc3-4a45-acfb-de23de766ea2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:12.950387 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-79fc22e7-5cc3-4a45-acfb-de23de766ea2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62dd80f0e7794f9ca582fb9206ddc289', 'request_id': 'req-79fc22e7-5cc3-4a45-acfb-de23de766ea2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:12.955812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-79fc22e7-5cc3-4a45-acfb-de23de766ea2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62dd80f0e7794f9ca582fb9206ddc289', 'request_id': 'req-79fc22e7-5cc3-4a45-acfb-de23de766ea2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:12.967822 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-79fc22e7-5cc3-4a45-acfb-de23de766ea2 admin admin] The token cache is being invalidate because project 62dd80f0e7794f9ca582fb9206ddc289 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:27:12.968137 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-79fc22e7-5cc3-4a45-acfb-de23de766ea2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:12.968747 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-79fc22e7-5cc3-4a45-acfb-de23de766ea2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:12.970225 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1175/2355] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:27:12 2022] DELETE /identity/v3/projects/62dd80f0e7794f9ca582fb9206ddc289 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:27:12.975070 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d42d1d-cd8a-49de-ac51-799193dadfb2 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:12.975432 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d42d1d-cd8a-49de-ac51-799193dadfb2 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:12.975720 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d42d1d-cd8a-49de-ac51-799193dadfb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:12.996896 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-d5d42d1d-cd8a-49de-ac51-799193dadfb2 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:27:12.998666 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d5d42d1d-cd8a-49de-ac51-799193dadfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:13.057804 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1181/2356] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:27:13.066222 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55645779-3759-44eb-b7d4-82f44c31c705 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:13.066518 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55645779-3759-44eb-b7d4-82f44c31c705 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:13.066799 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55645779-3759-44eb-b7d4-82f44c31c705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:13.087117 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-55645779-3759-44eb-b7d4-82f44c31c705 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:27:13.088909 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-55645779-3759-44eb-b7d4-82f44c31c705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:13.097359 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1176/2357] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:27:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:27:13.101578 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d42d1d-cd8a-49de-ac51-799193dadfb2 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:13.112015 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d42d1d-cd8a-49de-ac51-799193dadfb2 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:13.116825 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c330ad7-41aa-4ed1-ae4d-461c072a9c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:13.117448 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c330ad7-41aa-4ed1-ae4d-461c072a9c36 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:13.117720 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c330ad7-41aa-4ed1-ae4d-461c072a9c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:13.117991 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c330ad7-41aa-4ed1-ae4d-461c072a9c36 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:13.118684 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c330ad7-41aa-4ed1-ae4d-461c072a9c36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:27:13.118987 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c330ad7-41aa-4ed1-ae4d-461c072a9c36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:13.120604 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c330ad7-41aa-4ed1-ae4d-461c072a9c36 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:13.131952 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1182/2358] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:27:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:27:13.136116 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55645779-3759-44eb-b7d4-82f44c31c705 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:13.145232 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55645779-3759-44eb-b7d4-82f44c31c705 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:13.149934 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694ef29-62ff-4d7f-ab42-ac2f69a88deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:13.151024 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694ef29-62ff-4d7f-ab42-ac2f69a88deb admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:13.151308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694ef29-62ff-4d7f-ab42-ac2f69a88deb admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:13.151581 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f694ef29-62ff-4d7f-ab42-ac2f69a88deb admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:13.152277 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694ef29-62ff-4d7f-ab42-ac2f69a88deb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:13.154163 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f694ef29-62ff-4d7f-ab42-ac2f69a88deb admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:13.175853 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:27:13.188420 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1177/2359] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:27:13 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:27:13.189304 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c330ad7-41aa-4ed1-ae4d-461c072a9c36 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:13.200201 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c330ad7-41aa-4ed1-ae4d-461c072a9c36 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:13.222032 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:27:13.265201 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5cae4-63f0-49a8-8095-83c1b5de6cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:13.265869 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5cae4-63f0-49a8-8095-83c1b5de6cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:13.266192 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5cae4-63f0-49a8-8095-83c1b5de6cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:13.266469 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5cae4-63f0-49a8-8095-83c1b5de6cf2 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:13.267168 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5cae4-63f0-49a8-8095-83c1b5de6cf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:13.269126 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5cae4-63f0-49a8-8095-83c1b5de6cf2 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:13.297574 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1183/2360] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:27:13 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:27:13.301742 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694ef29-62ff-4d7f-ab42-ac2f69a88deb admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:13.313507 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f694ef29-62ff-4d7f-ab42-ac2f69a88deb admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:13.318638 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b05cf9-7a2b-40e2-8e29-91faf543fa04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:13.319323 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b05cf9-7a2b-40e2-8e29-91faf543fa04 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:13.319710 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b05cf9-7a2b-40e2-8e29-91faf543fa04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:13.320089 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b05cf9-7a2b-40e2-8e29-91faf543fa04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:13.320929 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b05cf9-7a2b-40e2-8e29-91faf543fa04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:13.322735 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b05cf9-7a2b-40e2-8e29-91faf543fa04 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:13.336031 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1178/2361] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:27:13.340270 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5cae4-63f0-49a8-8095-83c1b5de6cf2 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:13.351528 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5cae4-63f0-49a8-8095-83c1b5de6cf2 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:13.356877 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e189f-379b-4fcb-9814-b2cb94b0a179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:13.357686 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e189f-379b-4fcb-9814-b2cb94b0a179 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:13.358039 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e189f-379b-4fcb-9814-b2cb94b0a179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:13.358834 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e189f-379b-4fcb-9814-b2cb94b0a179 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:13.359621 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e189f-379b-4fcb-9814-b2cb94b0a179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:13.361338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e189f-379b-4fcb-9814-b2cb94b0a179 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:13.374481 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1184/2362] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:27:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:27:13.378866 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b05cf9-7a2b-40e2-8e29-91faf543fa04 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:13.389772 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b05cf9-7a2b-40e2-8e29-91faf543fa04 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:13.413877 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0adf5-fe8a-4a97-85e0-759c775dad32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:13.414583 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0adf5-fe8a-4a97-85e0-759c775dad32 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:13.414867 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0adf5-fe8a-4a97-85e0-759c775dad32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:13.415146 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0adf5-fe8a-4a97-85e0-759c775dad32 admin admin] PATH_INFO: `/v3/projects/dbaf5900376643c38cff7adadeb89a49/users/781b3630220d40d8a58870cbb9409964/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:13.434865 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0adf5-fe8a-4a97-85e0-759c775dad32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbaf5900376643c38cff7adadeb89a49, user_id=781b3630220d40d8a58870cbb9409964, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:13.437907 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0adf5-fe8a-4a97-85e0-759c775dad32 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:13.468075 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1179/2363] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:27:13 2022] PUT /identity/v3/projects/dbaf5900376643c38cff7adadeb89a49/users/781b3630220d40d8a58870cbb9409964/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:27:13.479403 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4a340-7885-4910-8416-5607c92130f5 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:13.479837 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4a340-7885-4910-8416-5607c92130f5 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:13.480517 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f4a340-7885-4910-8416-5607c92130f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:13.515093 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-c1f4a340-7885-4910-8416-5607c92130f5 None None] MFA Rules not processed for user `781b3630220d40d8a58870cbb9409964`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:27:13.516484 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-c1f4a340-7885-4910-8416-5607c92130f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:13.594540 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1185/2364] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:27:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:27:13.605435 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0adf5-fe8a-4a97-85e0-759c775dad32 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:13.607132 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-cdb0adf5-fe8a-4a97-85e0-759c775dad32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:13.668736 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0adf5-fe8a-4a97-85e0-759c775dad32 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:13.672420 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4c1c1e-79f4-435b-bd01-849abb813bb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:13.673034 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c1c1e-79f4-435b-bd01-849abb813bb7 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:13.673318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c1c1e-79f4-435b-bd01-849abb813bb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:13.673593 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4c1c1e-79f4-435b-bd01-849abb813bb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:13.681839 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c1c1e-79f4-435b-bd01-849abb813bb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:13.683256 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4c1c1e-79f4-435b-bd01-849abb813bb7 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:13.691924 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1180/2365] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:27:13 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:27:23.590842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=56,keystone:INSERT=3 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:27:23.688052 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=41,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:27:23.953162 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4a340-7885-4910-8416-5607c92130f5 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:24.015695 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f4a340-7885-4910-8416-5607c92130f5 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:24.020188 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81eac3-be44-4075-8fa3-9a02422d8fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:24.020812 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81eac3-be44-4075-8fa3-9a02422d8fd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:24.021092 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81eac3-be44-4075-8fa3-9a02422d8fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:24.021365 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa81eac3-be44-4075-8fa3-9a02422d8fd2 admin admin] PATH_INFO: `/v3/users/781b3630220d40d8a58870cbb9409964` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:24.022500 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81eac3-be44-4075-8fa3-9a02422d8fd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=781b3630220d40d8a58870cbb9409964)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:24.024431 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa81eac3-be44-4075-8fa3-9a02422d8fd2 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:24.071508 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-aa81eac3-be44-4075-8fa3-9a02422d8fd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '781b3630220d40d8a58870cbb9409964'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:24.072196 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-aa81eac3-be44-4075-8fa3-9a02422d8fd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '781b3630220d40d8a58870cbb9409964'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:24.082489 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-aa81eac3-be44-4075-8fa3-9a02422d8fd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '781b3630220d40d8a58870cbb9409964'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:24.090308 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-aa81eac3-be44-4075-8fa3-9a02422d8fd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '781b3630220d40d8a58870cbb9409964'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:24.101991 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-aa81eac3-be44-4075-8fa3-9a02422d8fd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '781b3630220d40d8a58870cbb9409964'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:24.108013 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1186/2366] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:27:23 2022] DELETE /identity/v3/users/781b3630220d40d8a58870cbb9409964 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:27:24.112412 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5179c43-ea4e-4665-8743-31e77e54af73 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:24.112701 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5179c43-ea4e-4665-8743-31e77e54af73 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:24.112978 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5179c43-ea4e-4665-8743-31e77e54af73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:24.131795 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b5179c43-ea4e-4665-8743-31e77e54af73 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:27:24.133008 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b5179c43-ea4e-4665-8743-31e77e54af73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:24.193074 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1181/2367] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:27:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:27:24.204474 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81eac3-be44-4075-8fa3-9a02422d8fd2 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:24.205869 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-aa81eac3-be44-4075-8fa3-9a02422d8fd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:24.263529 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa81eac3-be44-4075-8fa3-9a02422d8fd2 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:24.267159 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb54c7-0903-49dc-865d-5b8346beae05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:24.267779 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb54c7-0903-49dc-865d-5b8346beae05 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:24.268089 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb54c7-0903-49dc-865d-5b8346beae05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:24.268367 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb54c7-0903-49dc-865d-5b8346beae05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:24.277648 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb54c7-0903-49dc-865d-5b8346beae05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:24.279074 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb54c7-0903-49dc-865d-5b8346beae05 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:24.288671 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1187/2368] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:27:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:27:24.566940 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5179c43-ea4e-4665-8743-31e77e54af73 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:24.568470 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b5179c43-ea4e-4665-8743-31e77e54af73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:24.586881 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5179c43-ea4e-4665-8743-31e77e54af73 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:24.597860 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd28676-4390-4c42-ae3e-270355271bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:24.598507 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd28676-4390-4c42-ae3e-270355271bb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:24.598787 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd28676-4390-4c42-ae3e-270355271bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:24.599060 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd28676-4390-4c42-ae3e-270355271bb2 admin admin] PATH_INFO: `/v3/projects/dbaf5900376643c38cff7adadeb89a49` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:24.600340 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd28676-4390-4c42-ae3e-270355271bb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbaf5900376643c38cff7adadeb89a49)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:24.602133 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd28676-4390-4c42-ae3e-270355271bb2 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:24.648112 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5bd28676-4390-4c42-ae3e-270355271bb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbaf5900376643c38cff7adadeb89a49', 'request_id': 'req-5bd28676-4390-4c42-ae3e-270355271bb2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:24.654987 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5bd28676-4390-4c42-ae3e-270355271bb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbaf5900376643c38cff7adadeb89a49', 'request_id': 'req-5bd28676-4390-4c42-ae3e-270355271bb2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:24.660822 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5bd28676-4390-4c42-ae3e-270355271bb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbaf5900376643c38cff7adadeb89a49', 'request_id': 'req-5bd28676-4390-4c42-ae3e-270355271bb2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:24.673585 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5bd28676-4390-4c42-ae3e-270355271bb2 admin admin] The token cache is being invalidate because project dbaf5900376643c38cff7adadeb89a49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:27:24.673875 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5bd28676-4390-4c42-ae3e-270355271bb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:24.674498 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-5bd28676-4390-4c42-ae3e-270355271bb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:24.676031 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1182/2369] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:27:24 2022] DELETE /identity/v3/projects/dbaf5900376643c38cff7adadeb89a49 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:27:24.680964 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ac1e3-87de-41cf-95b0-0eba050dac67 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:24.681481 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ac1e3-87de-41cf-95b0-0eba050dac67 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:24.681609 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7ac1e3-87de-41cf-95b0-0eba050dac67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:24.700949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-4a7ac1e3-87de-41cf-95b0-0eba050dac67 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:27:24.702073 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-4a7ac1e3-87de-41cf-95b0-0eba050dac67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:24.719055 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:27:24.762429 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1188/2370] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:27:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:27:24.771746 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf43d2b-0edb-4b10-abca-be7aee7c8e6e None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:24.772200 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf43d2b-0edb-4b10-abca-be7aee7c8e6e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:24.772375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf43d2b-0edb-4b10-abca-be7aee7c8e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:24.792650 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-8bf43d2b-0edb-4b10-abca-be7aee7c8e6e None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:27:24.793851 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8bf43d2b-0edb-4b10-abca-be7aee7c8e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:24.801891 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1183/2371] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:27:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:27:24.806352 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7ac1e3-87de-41cf-95b0-0eba050dac67 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:24.816244 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7ac1e3-87de-41cf-95b0-0eba050dac67 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:24.821131 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e14e71-a72a-4a7e-b28e-68d6ff483f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:24.821823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e14e71-a72a-4a7e-b28e-68d6ff483f1d admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:24.822473 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e14e71-a72a-4a7e-b28e-68d6ff483f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:24.822761 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e14e71-a72a-4a7e-b28e-68d6ff483f1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:24.823472 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e14e71-a72a-4a7e-b28e-68d6ff483f1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:27:24.824312 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e14e71-a72a-4a7e-b28e-68d6ff483f1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:24.825937 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e14e71-a72a-4a7e-b28e-68d6ff483f1d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:24.838014 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1189/2372] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:27:24.843012 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf43d2b-0edb-4b10-abca-be7aee7c8e6e None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:24.852517 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf43d2b-0edb-4b10-abca-be7aee7c8e6e None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:24.857380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d311130-27a9-4145-bf68-cc7706eae26d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:24.857811 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d311130-27a9-4145-bf68-cc7706eae26d admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:24.858099 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d311130-27a9-4145-bf68-cc7706eae26d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:24.858472 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d311130-27a9-4145-bf68-cc7706eae26d admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:24.859025 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d311130-27a9-4145-bf68-cc7706eae26d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:24.860966 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d311130-27a9-4145-bf68-cc7706eae26d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:24.890609 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1184/2373] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:27:24 2022] POST /identity/v3/projects => generated 399 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:27:24.895016 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e14e71-a72a-4a7e-b28e-68d6ff483f1d admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:24.905257 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e14e71-a72a-4a7e-b28e-68d6ff483f1d admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:24.961670 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bee18e-f668-4e4d-b97d-b734bcdfe295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:24.962213 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bee18e-f668-4e4d-b97d-b734bcdfe295 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:24.962496 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bee18e-f668-4e4d-b97d-b734bcdfe295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:24.962767 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bee18e-f668-4e4d-b97d-b734bcdfe295 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:24.963422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bee18e-f668-4e4d-b97d-b734bcdfe295 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:24.965387 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bee18e-f668-4e4d-b97d-b734bcdfe295 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:24.985195 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1190/2374] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:27:24 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:27:24.989448 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d311130-27a9-4145-bf68-cc7706eae26d admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:25.000065 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d311130-27a9-4145-bf68-cc7706eae26d admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:25.004628 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7eac75-dfa5-42d6-abf4-ae3fe86ebd37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:25.005220 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7eac75-dfa5-42d6-abf4-ae3fe86ebd37 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:25.005506 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7eac75-dfa5-42d6-abf4-ae3fe86ebd37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:25.005776 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7eac75-dfa5-42d6-abf4-ae3fe86ebd37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:25.006455 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7eac75-dfa5-42d6-abf4-ae3fe86ebd37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:25.008057 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7eac75-dfa5-42d6-abf4-ae3fe86ebd37 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:25.018361 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1185/2375] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:27:25.022297 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bee18e-f668-4e4d-b97d-b734bcdfe295 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:25.032078 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bee18e-f668-4e4d-b97d-b734bcdfe295 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:25.036629 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846d91c7-47fa-4eda-bbd9-d1dcb707bd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:25.037223 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d91c7-47fa-4eda-bbd9-d1dcb707bd31 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:25.037501 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d91c7-47fa-4eda-bbd9-d1dcb707bd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:25.037795 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846d91c7-47fa-4eda-bbd9-d1dcb707bd31 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:25.038480 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d91c7-47fa-4eda-bbd9-d1dcb707bd31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:25.040094 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846d91c7-47fa-4eda-bbd9-d1dcb707bd31 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:25.050498 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1191/2376] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:27:25.054305 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7eac75-dfa5-42d6-abf4-ae3fe86ebd37 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:25.064660 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7eac75-dfa5-42d6-abf4-ae3fe86ebd37 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:25.069329 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00735186-bb73-4cc8-b78f-df3af6c99e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:25.070006 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00735186-bb73-4cc8-b78f-df3af6c99e4d admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:25.070311 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00735186-bb73-4cc8-b78f-df3af6c99e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:25.070589 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00735186-bb73-4cc8-b78f-df3af6c99e4d admin admin] PATH_INFO: `/v3/projects/0fd48c872e654b82ace33b2ea0363885/users/7bee6eaa792c4536a7507044941af80e/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:25.085626 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00735186-bb73-4cc8-b78f-df3af6c99e4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fd48c872e654b82ace33b2ea0363885, user_id=7bee6eaa792c4536a7507044941af80e, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:25.088401 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00735186-bb73-4cc8-b78f-df3af6c99e4d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:25.101695 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1186/2377] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:27:25 2022] PUT /identity/v3/projects/0fd48c872e654b82ace33b2ea0363885/users/7bee6eaa792c4536a7507044941af80e/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:27:25.111916 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba2b13-5c93-407b-9600-da81e84bff63 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:25.112236 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba2b13-5c93-407b-9600-da81e84bff63 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:25.112510 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba2b13-5c93-407b-9600-da81e84bff63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:25.140248 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-b5ba2b13-5c93-407b-9600-da81e84bff63 None None] MFA Rules not processed for user `7bee6eaa792c4536a7507044941af80e`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:27:25.141441 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b5ba2b13-5c93-407b-9600-da81e84bff63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:25.204194 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1192/2378] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:27:25 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:27:25.215567 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00735186-bb73-4cc8-b78f-df3af6c99e4d admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:25.217216 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-00735186-bb73-4cc8-b78f-df3af6c99e4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:25.239521 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:27:25.275529 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00735186-bb73-4cc8-b78f-df3af6c99e4d admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:25.279251 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d1436-8b09-4970-8a5d-495680e8a599 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:25.279845 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d1436-8b09-4970-8a5d-495680e8a599 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:25.280162 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d1436-8b09-4970-8a5d-495680e8a599 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:25.280440 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428d1436-8b09-4970-8a5d-495680e8a599 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:25.288827 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d1436-8b09-4970-8a5d-495680e8a599 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:25.290254 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428d1436-8b09-4970-8a5d-495680e8a599 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:25.299799 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1187/2379] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:27:25 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:27:28.513640 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6f176-9433-4fd1-9e01-d966db3823e2 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:28.514176 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6f176-9433-4fd1-9e01-d966db3823e2 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:28.514275 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6f176-9433-4fd1-9e01-d966db3823e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:28.534815 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-10c6f176-9433-4fd1-9e01-d966db3823e2 None None] MFA Rules not processed for user `b470b4c2ca1a4d1a8a864789bf603d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:27:28.536052 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-10c6f176-9433-4fd1-9e01-d966db3823e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:28.548837 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:27:28.597996 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1193/2380] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Jul 27 15:27:28 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:27:28.609565 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d1436-8b09-4970-8a5d-495680e8a599 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:28.610993 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-428d1436-8b09-4970-8a5d-495680e8a599 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:28.684681 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428d1436-8b09-4970-8a5d-495680e8a599 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:28.689889 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bce209-5686-4095-8187-12b542840eb9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68bbf8bb59a84829afacd9677c9639a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:28.690507 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bce209-5686-4095-8187-12b542840eb9 service swift] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:28.690789 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bce209-5686-4095-8187-12b542840eb9 service swift] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:28.691069 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bce209-5686-4095-8187-12b542840eb9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:28.700779 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bce209-5686-4095-8187-12b542840eb9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:28.702316 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bce209-5686-4095-8187-12b542840eb9 service swift] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:28.710891 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1188/2381] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Jul 27 15:27:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 15:27:29.334200 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f961fd-c23b-4cfc-a7e3-a3041e59965f None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:29.334573 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f961fd-c23b-4cfc-a7e3-a3041e59965f None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:29.334933 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f961fd-c23b-4cfc-a7e3-a3041e59965f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:29.356713 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-38f961fd-c23b-4cfc-a7e3-a3041e59965f None None] MFA Rules not processed for user `b470b4c2ca1a4d1a8a864789bf603d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:27:29.358261 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-38f961fd-c23b-4cfc-a7e3-a3041e59965f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:29.375781 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1194/2382] 10.222.0.40 () {58 vars in 967 bytes} [Wed Jul 27 15:27:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:27:29.385212 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bce209-5686-4095-8187-12b542840eb9 service swift] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:29.398546 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bce209-5686-4095-8187-12b542840eb9 service swift] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:29.407317 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27394a-6a7d-4157-a6ae-51a9e1287840 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68bbf8bb59a84829afacd9677c9639a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:29.408268 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27394a-6a7d-4157-a6ae-51a9e1287840 service swift] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:29.408659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27394a-6a7d-4157-a6ae-51a9e1287840 service swift] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:29.409181 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27394a-6a7d-4157-a6ae-51a9e1287840 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:29.427752 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27394a-6a7d-4157-a6ae-51a9e1287840 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:29.430150 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27394a-6a7d-4157-a6ae-51a9e1287840 service swift] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:29.441549 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1189/2383] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Jul 27 15:27:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 15:27:29.758098 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdc453-605e-4563-813f-e5bda31fe61e None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:29.758669 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdc453-605e-4563-813f-e5bda31fe61e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:29.758669 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfdc453-605e-4563-813f-e5bda31fe61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:29.779102 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-6bfdc453-605e-4563-813f-e5bda31fe61e None None] MFA Rules not processed for user `b470b4c2ca1a4d1a8a864789bf603d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:27:29.780436 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6bfdc453-605e-4563-813f-e5bda31fe61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:29.799742 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1195/2384] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Jul 27 15:27:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:27:29.822014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27394a-6a7d-4157-a6ae-51a9e1287840 service swift] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:29.837399 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27394a-6a7d-4157-a6ae-51a9e1287840 service swift] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:29.848337 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab332b5-6aed-445a-8f90-32e9df7b67e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68bbf8bb59a84829afacd9677c9639a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:29.848992 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab332b5-6aed-445a-8f90-32e9df7b67e9 service swift] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:29.849708 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab332b5-6aed-445a-8f90-32e9df7b67e9 service swift] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:29.850176 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab332b5-6aed-445a-8f90-32e9df7b67e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:29.861119 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab332b5-6aed-445a-8f90-32e9df7b67e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:29.862864 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab332b5-6aed-445a-8f90-32e9df7b67e9 service swift] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:29.873713 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1190/2385] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Jul 27 15:27:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 15:27:30.232517 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed45b36-b1af-4a68-8b1f-5d0c11e1bf7a None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:30.232850 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed45b36-b1af-4a68-8b1f-5d0c11e1bf7a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:30.233203 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed45b36-b1af-4a68-8b1f-5d0c11e1bf7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:30.259916 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-bed45b36-b1af-4a68-8b1f-5d0c11e1bf7a None None] MFA Rules not processed for user `b470b4c2ca1a4d1a8a864789bf603d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:27:30.261257 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-bed45b36-b1af-4a68-8b1f-5d0c11e1bf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:30.270131 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1196/2386] 10.222.0.40 () {58 vars in 967 bytes} [Wed Jul 27 15:27:30 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:27:30.284622 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab332b5-6aed-445a-8f90-32e9df7b67e9 service swift] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:30.296553 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab332b5-6aed-445a-8f90-32e9df7b67e9 service swift] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:30.301705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07172033-c407-4851-84bf-4d97b4183384 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68bbf8bb59a84829afacd9677c9639a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:30.302503 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07172033-c407-4851-84bf-4d97b4183384 service swift] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:30.302986 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07172033-c407-4851-84bf-4d97b4183384 service swift] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:30.303267 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07172033-c407-4851-84bf-4d97b4183384 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:30.312423 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07172033-c407-4851-84bf-4d97b4183384 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:30.314108 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07172033-c407-4851-84bf-4d97b4183384 service swift] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:30.323280 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1191/2387] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Jul 27 15:27:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 15:27:31.424700 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed45b36-b1af-4a68-8b1f-5d0c11e1bf7a None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:31.488222 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed45b36-b1af-4a68-8b1f-5d0c11e1bf7a None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:31.492621 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69db5bb-5056-447e-b2be-a1826781789a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:31.493250 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69db5bb-5056-447e-b2be-a1826781789a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:31.493524 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69db5bb-5056-447e-b2be-a1826781789a admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:31.493790 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69db5bb-5056-447e-b2be-a1826781789a admin admin] PATH_INFO: `/v3/users/7bee6eaa792c4536a7507044941af80e` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:31.494917 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69db5bb-5056-447e-b2be-a1826781789a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bee6eaa792c4536a7507044941af80e)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:31.497545 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69db5bb-5056-447e-b2be-a1826781789a admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:31.543683 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e69db5bb-5056-447e-b2be-a1826781789a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bee6eaa792c4536a7507044941af80e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:31.544291 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e69db5bb-5056-447e-b2be-a1826781789a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bee6eaa792c4536a7507044941af80e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:31.551374 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e69db5bb-5056-447e-b2be-a1826781789a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bee6eaa792c4536a7507044941af80e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:31.559286 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e69db5bb-5056-447e-b2be-a1826781789a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bee6eaa792c4536a7507044941af80e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:31.571548 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e69db5bb-5056-447e-b2be-a1826781789a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bee6eaa792c4536a7507044941af80e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:31.577883 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1197/2388] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:27:31 2022] DELETE /identity/v3/users/7bee6eaa792c4536a7507044941af80e => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:27:31.582588 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f704b-b9a3-42ed-a8e3-b3badbcc9134 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:31.583038 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f704b-b9a3-42ed-a8e3-b3badbcc9134 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:31.583142 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f704b-b9a3-42ed-a8e3-b3badbcc9134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:31.605299 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-0c8f704b-b9a3-42ed-a8e3-b3badbcc9134 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:27:31.606531 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0c8f704b-b9a3-42ed-a8e3-b3badbcc9134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:31.664867 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1192/2389] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:27:31.675314 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69db5bb-5056-447e-b2be-a1826781789a admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:31.676730 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e69db5bb-5056-447e-b2be-a1826781789a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:31.702024 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:27:31.733192 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69db5bb-5056-447e-b2be-a1826781789a admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:31.736778 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835e05a-f4d5-43bc-ab06-1dbe736c67a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:31.737384 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835e05a-f4d5-43bc-ab06-1dbe736c67a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:31.737659 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835e05a-f4d5-43bc-ab06-1dbe736c67a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:31.737926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835e05a-f4d5-43bc-ab06-1dbe736c67a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:31.746723 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835e05a-f4d5-43bc-ab06-1dbe736c67a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:31.748157 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835e05a-f4d5-43bc-ab06-1dbe736c67a5 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:31.757547 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1198/2390] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:27:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:27:32.026367 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f704b-b9a3-42ed-a8e3-b3badbcc9134 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:32.028374 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0c8f704b-b9a3-42ed-a8e3-b3badbcc9134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:32.048967 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f704b-b9a3-42ed-a8e3-b3badbcc9134 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:32.054278 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6504c28a-eee7-4407-b439-5a421dc93f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:32.054856 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504c28a-eee7-4407-b439-5a421dc93f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:32.055314 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504c28a-eee7-4407-b439-5a421dc93f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:32.055668 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6504c28a-eee7-4407-b439-5a421dc93f49 admin admin] PATH_INFO: `/v3/projects/0fd48c872e654b82ace33b2ea0363885` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:32.056915 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504c28a-eee7-4407-b439-5a421dc93f49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fd48c872e654b82ace33b2ea0363885)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:32.058868 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6504c28a-eee7-4407-b439-5a421dc93f49 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:32.067321 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:27:32.105824 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6504c28a-eee7-4407-b439-5a421dc93f49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fd48c872e654b82ace33b2ea0363885', 'request_id': 'req-6504c28a-eee7-4407-b439-5a421dc93f49'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:32.111720 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6504c28a-eee7-4407-b439-5a421dc93f49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fd48c872e654b82ace33b2ea0363885', 'request_id': 'req-6504c28a-eee7-4407-b439-5a421dc93f49'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:32.117237 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6504c28a-eee7-4407-b439-5a421dc93f49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fd48c872e654b82ace33b2ea0363885', 'request_id': 'req-6504c28a-eee7-4407-b439-5a421dc93f49'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:32.129248 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6504c28a-eee7-4407-b439-5a421dc93f49 admin admin] The token cache is being invalidate because project 0fd48c872e654b82ace33b2ea0363885 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:27:32.129535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6504c28a-eee7-4407-b439-5a421dc93f49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:32.130149 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-6504c28a-eee7-4407-b439-5a421dc93f49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:32.131690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1193/2391] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:27:32 2022] DELETE /identity/v3/projects/0fd48c872e654b82ace33b2ea0363885 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:27:32.449253 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835e05a-f4d5-43bc-ab06-1dbe736c67a5 service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:32.450623 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d835e05a-f4d5-43bc-ab06-1dbe736c67a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:32.463396 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835e05a-f4d5-43bc-ab06-1dbe736c67a5 service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:32.520142 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eefa1b-8cbd-470e-9e6f-b1f136ee9198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:32.520781 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eefa1b-8cbd-470e-9e6f-b1f136ee9198 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:32.521061 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eefa1b-8cbd-470e-9e6f-b1f136ee9198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:32.521332 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eefa1b-8cbd-470e-9e6f-b1f136ee9198 admin admin] PATH_INFO: `/v3/users/4a5bf4c88e87446d82bec92afbf316e2` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:32.522482 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eefa1b-8cbd-470e-9e6f-b1f136ee9198 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a5bf4c88e87446d82bec92afbf316e2)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:32.524431 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eefa1b-8cbd-470e-9e6f-b1f136ee9198 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:32.569949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e7eefa1b-8cbd-470e-9e6f-b1f136ee9198 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a5bf4c88e87446d82bec92afbf316e2'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:32.570591 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e7eefa1b-8cbd-470e-9e6f-b1f136ee9198 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a5bf4c88e87446d82bec92afbf316e2'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:32.578686 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e7eefa1b-8cbd-470e-9e6f-b1f136ee9198 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a5bf4c88e87446d82bec92afbf316e2'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:32.585783 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e7eefa1b-8cbd-470e-9e6f-b1f136ee9198 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a5bf4c88e87446d82bec92afbf316e2'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:32.598093 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e7eefa1b-8cbd-470e-9e6f-b1f136ee9198 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a5bf4c88e87446d82bec92afbf316e2'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:32.603952 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1199/2392] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:27:32 2022] DELETE /identity/v3/users/4a5bf4c88e87446d82bec92afbf316e2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:27:32.608511 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c492df9-0029-4b69-92a6-16ce77990b31 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:32.608970 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c492df9-0029-4b69-92a6-16ce77990b31 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:32.609189 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c492df9-0029-4b69-92a6-16ce77990b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:32.628643 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9c492df9-0029-4b69-92a6-16ce77990b31 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:27:32.629835 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9c492df9-0029-4b69-92a6-16ce77990b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:32.687897 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1194/2393] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:27:32.697284 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eefa1b-8cbd-470e-9e6f-b1f136ee9198 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:32.699287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e7eefa1b-8cbd-470e-9e6f-b1f136ee9198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:32.744259 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:27:32.756639 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eefa1b-8cbd-470e-9e6f-b1f136ee9198 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:32.760398 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d31f5d-a92b-425f-953a-2aa943efc72a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:32.761036 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d31f5d-a92b-425f-953a-2aa943efc72a service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:32.761316 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d31f5d-a92b-425f-953a-2aa943efc72a service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:32.761589 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d31f5d-a92b-425f-953a-2aa943efc72a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:32.770412 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d31f5d-a92b-425f-953a-2aa943efc72a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:32.771827 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d31f5d-a92b-425f-953a-2aa943efc72a service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:32.781311 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1200/2394] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:27:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:27:32.955534 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c492df9-0029-4b69-92a6-16ce77990b31 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:32.957194 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9c492df9-0029-4b69-92a6-16ce77990b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:32.971859 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c492df9-0029-4b69-92a6-16ce77990b31 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:32.978006 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf8cdd9-5a71-4185-8837-dcec0ec9a9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:32.978561 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8cdd9-5a71-4185-8837-dcec0ec9a9ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:32.978842 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8cdd9-5a71-4185-8837-dcec0ec9a9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:32.979206 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf8cdd9-5a71-4185-8837-dcec0ec9a9ec admin admin] PATH_INFO: `/v3/projects/d66d2ad442af4eba961e8c975291e021` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:32.980331 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8cdd9-5a71-4185-8837-dcec0ec9a9ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=d66d2ad442af4eba961e8c975291e021)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:32.982228 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf8cdd9-5a71-4185-8837-dcec0ec9a9ec admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:33.029613 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-bcf8cdd9-5a71-4185-8837-dcec0ec9a9ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd66d2ad442af4eba961e8c975291e021', 'request_id': 'req-bcf8cdd9-5a71-4185-8837-dcec0ec9a9ec'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:33.036172 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-bcf8cdd9-5a71-4185-8837-dcec0ec9a9ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd66d2ad442af4eba961e8c975291e021', 'request_id': 'req-bcf8cdd9-5a71-4185-8837-dcec0ec9a9ec'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:33.042562 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-bcf8cdd9-5a71-4185-8837-dcec0ec9a9ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd66d2ad442af4eba961e8c975291e021', 'request_id': 'req-bcf8cdd9-5a71-4185-8837-dcec0ec9a9ec'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:33.056999 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-bcf8cdd9-5a71-4185-8837-dcec0ec9a9ec admin admin] The token cache is being invalidate because project d66d2ad442af4eba961e8c975291e021 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:27:33.057296 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-bcf8cdd9-5a71-4185-8837-dcec0ec9a9ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:33.057977 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-bcf8cdd9-5a71-4185-8837-dcec0ec9a9ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:33.059706 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1195/2395] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:27:32 2022] DELETE /identity/v3/projects/d66d2ad442af4eba961e8c975291e021 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:27:41.403128 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d31f5d-a92b-425f-953a-2aa943efc72a service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:41.404544 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-55d31f5d-a92b-425f-953a-2aa943efc72a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:41.417362 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d31f5d-a92b-425f-953a-2aa943efc72a service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:41.471323 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9e4c6-4005-4f0c-8282-132c54410f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:41.471972 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9e4c6-4005-4f0c-8282-132c54410f0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:41.472278 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9e4c6-4005-4f0c-8282-132c54410f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:41.472555 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c9e4c6-4005-4f0c-8282-132c54410f0d admin admin] PATH_INFO: `/v3/users/948250a5cfdf483c8bb7984fb7a113a1` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:41.473696 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9e4c6-4005-4f0c-8282-132c54410f0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=948250a5cfdf483c8bb7984fb7a113a1)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:41.475588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c9e4c6-4005-4f0c-8282-132c54410f0d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:41.520871 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-65c9e4c6-4005-4f0c-8282-132c54410f0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '948250a5cfdf483c8bb7984fb7a113a1'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:41.521531 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-65c9e4c6-4005-4f0c-8282-132c54410f0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '948250a5cfdf483c8bb7984fb7a113a1'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:41.528426 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-65c9e4c6-4005-4f0c-8282-132c54410f0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '948250a5cfdf483c8bb7984fb7a113a1'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:41.535302 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-65c9e4c6-4005-4f0c-8282-132c54410f0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '948250a5cfdf483c8bb7984fb7a113a1'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:41.547132 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-65c9e4c6-4005-4f0c-8282-132c54410f0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '948250a5cfdf483c8bb7984fb7a113a1'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:41.552874 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1201/2396] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:27:41 2022] DELETE /identity/v3/users/948250a5cfdf483c8bb7984fb7a113a1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:27:41.557440 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1caa4-86a9-43eb-8055-896a187b1d17 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:41.557895 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1caa4-86a9-43eb-8055-896a187b1d17 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:41.557988 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d1caa4-86a9-43eb-8055-896a187b1d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:41.577594 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-74d1caa4-86a9-43eb-8055-896a187b1d17 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:27:41.578782 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-74d1caa4-86a9-43eb-8055-896a187b1d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:41.592988 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:27:41.643900 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1196/2397] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:27:41.654076 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9e4c6-4005-4f0c-8282-132c54410f0d admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:41.655462 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-65c9e4c6-4005-4f0c-8282-132c54410f0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:41.711787 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c9e4c6-4005-4f0c-8282-132c54410f0d admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:41.715455 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e90b8c1-c9f3-4fb8-a6d0-b02c14d4d977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:41.716087 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90b8c1-c9f3-4fb8-a6d0-b02c14d4d977 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:41.716372 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90b8c1-c9f3-4fb8-a6d0-b02c14d4d977 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:41.716647 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e90b8c1-c9f3-4fb8-a6d0-b02c14d4d977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:41.725469 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e90b8c1-c9f3-4fb8-a6d0-b02c14d4d977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:41.726881 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e90b8c1-c9f3-4fb8-a6d0-b02c14d4d977 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:41.736796 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1202/2398] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:27:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 15:27:42.002100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1caa4-86a9-43eb-8055-896a187b1d17 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:42.003673 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-74d1caa4-86a9-43eb-8055-896a187b1d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:42.016077 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d1caa4-86a9-43eb-8055-896a187b1d17 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:42.020794 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67bb63-4501-4582-878c-edf9402ae18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:42.021526 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67bb63-4501-4582-878c-edf9402ae18c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:42.021900 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67bb63-4501-4582-878c-edf9402ae18c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:42.022231 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67bb63-4501-4582-878c-edf9402ae18c admin admin] PATH_INFO: `/v3/projects/4e6bdc97cdc44684a823cf49a880ae1e` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:42.023518 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d67bb63-4501-4582-878c-edf9402ae18c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e6bdc97cdc44684a823cf49a880ae1e)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:42.025685 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d67bb63-4501-4582-878c-edf9402ae18c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:42.077852 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9d67bb63-4501-4582-878c-edf9402ae18c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e6bdc97cdc44684a823cf49a880ae1e', 'request_id': 'req-9d67bb63-4501-4582-878c-edf9402ae18c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:42.083883 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9d67bb63-4501-4582-878c-edf9402ae18c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e6bdc97cdc44684a823cf49a880ae1e', 'request_id': 'req-9d67bb63-4501-4582-878c-edf9402ae18c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:42.089806 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9d67bb63-4501-4582-878c-edf9402ae18c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e6bdc97cdc44684a823cf49a880ae1e', 'request_id': 'req-9d67bb63-4501-4582-878c-edf9402ae18c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:42.101564 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9d67bb63-4501-4582-878c-edf9402ae18c admin admin] The token cache is being invalidate because project 4e6bdc97cdc44684a823cf49a880ae1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:27:42.101851 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9d67bb63-4501-4582-878c-edf9402ae18c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:42.102812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9d67bb63-4501-4582-878c-edf9402ae18c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:42.104364 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1197/2399] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:27:42 2022] DELETE /identity/v3/projects/4e6bdc97cdc44684a823cf49a880ae1e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:27:42.109774 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162ac0b-b9d7-4a02-985b-6ff1bb4bfd02 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:42.110064 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162ac0b-b9d7-4a02-985b-6ff1bb4bfd02 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:42.110345 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162ac0b-b9d7-4a02-985b-6ff1bb4bfd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:42.129306 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-b162ac0b-b9d7-4a02-985b-6ff1bb4bfd02 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:27:42.130501 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b162ac0b-b9d7-4a02-985b-6ff1bb4bfd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:42.134833 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:27:42.193095 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1203/2400] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:27:42.200898 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8e3b7-18e4-4d62-99a1-ad487baf119c None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:42.201187 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8e3b7-18e4-4d62-99a1-ad487baf119c None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:42.201463 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f8e3b7-18e4-4d62-99a1-ad487baf119c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:42.221519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b3f8e3b7-18e4-4d62-99a1-ad487baf119c None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:27:42.222704 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b3f8e3b7-18e4-4d62-99a1-ad487baf119c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:42.231140 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1198/2401] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:27:42.235186 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162ac0b-b9d7-4a02-985b-6ff1bb4bfd02 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:42.244751 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162ac0b-b9d7-4a02-985b-6ff1bb4bfd02 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:42.249351 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034a65d-2651-40e2-b2b4-3c13311d7644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:42.249943 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034a65d-2651-40e2-b2b4-3c13311d7644 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:42.250223 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034a65d-2651-40e2-b2b4-3c13311d7644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:42.250496 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034a65d-2651-40e2-b2b4-3c13311d7644 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:42.251178 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034a65d-2651-40e2-b2b4-3c13311d7644 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:27:42.251482 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034a65d-2651-40e2-b2b4-3c13311d7644 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:42.253089 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034a65d-2651-40e2-b2b4-3c13311d7644 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:42.264302 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1204/2402] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:27:42.268378 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8e3b7-18e4-4d62-99a1-ad487baf119c None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:42.278078 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f8e3b7-18e4-4d62-99a1-ad487baf119c None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:42.282741 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb9144-f9f3-4361-a436-468fac2696e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:42.283338 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb9144-f9f3-4361-a436-468fac2696e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:42.283619 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb9144-f9f3-4361-a436-468fac2696e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:42.283895 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcb9144-f9f3-4361-a436-468fac2696e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:42.284588 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb9144-f9f3-4361-a436-468fac2696e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:42.286461 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcb9144-f9f3-4361-a436-468fac2696e1 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:42.315602 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1199/2403] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:27:42 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:27:42.319881 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034a65d-2651-40e2-b2b4-3c13311d7644 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:42.329743 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034a65d-2651-40e2-b2b4-3c13311d7644 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:42.385968 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77ea0d-7f80-4160-ba18-60653f51164d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:42.386586 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77ea0d-7f80-4160-ba18-60653f51164d admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:42.386863 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77ea0d-7f80-4160-ba18-60653f51164d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:42.387137 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b77ea0d-7f80-4160-ba18-60653f51164d admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:42.387808 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77ea0d-7f80-4160-ba18-60653f51164d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:42.389775 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b77ea0d-7f80-4160-ba18-60653f51164d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:42.410399 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1205/2404] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:27:42 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:27:42.414461 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb9144-f9f3-4361-a436-468fac2696e1 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:42.425607 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcb9144-f9f3-4361-a436-468fac2696e1 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:42.430213 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5fa00-1291-4c5b-9977-3275f3b96e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:42.430832 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5fa00-1291-4c5b-9977-3275f3b96e42 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:42.431098 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5fa00-1291-4c5b-9977-3275f3b96e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:42.431372 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f5fa00-1291-4c5b-9977-3275f3b96e42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:42.432104 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5fa00-1291-4c5b-9977-3275f3b96e42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:42.433719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f5fa00-1291-4c5b-9977-3275f3b96e42 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:42.443431 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1200/2405] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:27:42.447122 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77ea0d-7f80-4160-ba18-60653f51164d admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:42.456868 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b77ea0d-7f80-4160-ba18-60653f51164d admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:42.461488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc37a315-1c24-426e-a38a-b9f977c87918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:42.462078 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37a315-1c24-426e-a38a-b9f977c87918 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:42.462359 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37a315-1c24-426e-a38a-b9f977c87918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:42.462633 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc37a315-1c24-426e-a38a-b9f977c87918 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:42.463321 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc37a315-1c24-426e-a38a-b9f977c87918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:42.465434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc37a315-1c24-426e-a38a-b9f977c87918 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:42.475671 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1206/2406] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:27:42.479600 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5fa00-1291-4c5b-9977-3275f3b96e42 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:42.490265 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f5fa00-1291-4c5b-9977-3275f3b96e42 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:42.494827 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1dfc9-56da-4e60-91cb-6dab3177b72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:42.495464 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1dfc9-56da-4e60-91cb-6dab3177b72e admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:42.495748 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1dfc9-56da-4e60-91cb-6dab3177b72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:42.496057 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1dfc9-56da-4e60-91cb-6dab3177b72e admin admin] PATH_INFO: `/v3/projects/31e51c5876a44ee08ba5e17053e89da4/users/8838498bb757413eb6bde5379d9ae44c/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:42.510089 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1dfc9-56da-4e60-91cb-6dab3177b72e admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e51c5876a44ee08ba5e17053e89da4, user_id=8838498bb757413eb6bde5379d9ae44c, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:42.513255 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f1dfc9-56da-4e60-91cb-6dab3177b72e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:42.525732 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1201/2407] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:27:42 2022] PUT /identity/v3/projects/31e51c5876a44ee08ba5e17053e89da4/users/8838498bb757413eb6bde5379d9ae44c/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:27:42.537733 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9c98a-27de-4b7b-920d-38d4768a15e2 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:42.538018 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9c98a-27de-4b7b-920d-38d4768a15e2 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:42.538291 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d9c98a-27de-4b7b-920d-38d4768a15e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:42.565457 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-d3d9c98a-27de-4b7b-920d-38d4768a15e2 None None] MFA Rules not processed for user `8838498bb757413eb6bde5379d9ae44c`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:27:42.566638 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d3d9c98a-27de-4b7b-920d-38d4768a15e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:42.629997 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1207/2408] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:27:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:27:42.641926 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1dfc9-56da-4e60-91cb-6dab3177b72e admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:42.643771 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-79f1dfc9-56da-4e60-91cb-6dab3177b72e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:42.687655 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:27:42.703668 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1dfc9-56da-4e60-91cb-6dab3177b72e admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:42.707226 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10212f03-458f-40b2-ac72-74e3ab925355 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:42.707832 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10212f03-458f-40b2-ac72-74e3ab925355 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:42.708149 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10212f03-458f-40b2-ac72-74e3ab925355 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:42.708426 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10212f03-458f-40b2-ac72-74e3ab925355 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:42.717126 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10212f03-458f-40b2-ac72-74e3ab925355 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:42.718540 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10212f03-458f-40b2-ac72-74e3ab925355 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:42.727263 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1202/2409] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:27:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:27:45.261373 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d9c98a-27de-4b7b-920d-38d4768a15e2 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:45.266569 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:27:45.323309 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d9c98a-27de-4b7b-920d-38d4768a15e2 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:45.327749 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f3eb6-5fd9-4a9e-9d7f-ba3480066476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:45.328427 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f3eb6-5fd9-4a9e-9d7f-ba3480066476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:45.328710 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f3eb6-5fd9-4a9e-9d7f-ba3480066476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:45.328984 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f3eb6-5fd9-4a9e-9d7f-ba3480066476 admin admin] PATH_INFO: `/v3/users/8838498bb757413eb6bde5379d9ae44c` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:45.330129 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f3eb6-5fd9-4a9e-9d7f-ba3480066476 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8838498bb757413eb6bde5379d9ae44c)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:45.332055 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f3eb6-5fd9-4a9e-9d7f-ba3480066476 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:45.376015 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-8a1f3eb6-5fd9-4a9e-9d7f-ba3480066476 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8838498bb757413eb6bde5379d9ae44c'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:45.376654 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-8a1f3eb6-5fd9-4a9e-9d7f-ba3480066476 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8838498bb757413eb6bde5379d9ae44c'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:45.384117 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-8a1f3eb6-5fd9-4a9e-9d7f-ba3480066476 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8838498bb757413eb6bde5379d9ae44c'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:45.391009 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-8a1f3eb6-5fd9-4a9e-9d7f-ba3480066476 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8838498bb757413eb6bde5379d9ae44c'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:45.403800 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-8a1f3eb6-5fd9-4a9e-9d7f-ba3480066476 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8838498bb757413eb6bde5379d9ae44c'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:45.409652 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1208/2410] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:27:45 2022] DELETE /identity/v3/users/8838498bb757413eb6bde5379d9ae44c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:27:45.414235 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8983e6-1d0e-48f8-b9d9-7a2077c53eca None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:45.414722 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8983e6-1d0e-48f8-b9d9-7a2077c53eca None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:45.414819 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8983e6-1d0e-48f8-b9d9-7a2077c53eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:45.433946 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-5a8983e6-1d0e-48f8-b9d9-7a2077c53eca None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:27:45.435168 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5a8983e6-1d0e-48f8-b9d9-7a2077c53eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:45.492692 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1203/2411] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:27:45.502364 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f3eb6-5fd9-4a9e-9d7f-ba3480066476 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:45.503739 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8a1f3eb6-5fd9-4a9e-9d7f-ba3480066476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:45.558995 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f3eb6-5fd9-4a9e-9d7f-ba3480066476 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:45.562538 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe11bf-a7b2-4148-81a7-da276d7c0659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:45.563139 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe11bf-a7b2-4148-81a7-da276d7c0659 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:45.563415 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe11bf-a7b2-4148-81a7-da276d7c0659 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:45.563681 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe11bf-a7b2-4148-81a7-da276d7c0659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:45.572451 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe11bf-a7b2-4148-81a7-da276d7c0659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:45.574363 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe11bf-a7b2-4148-81a7-da276d7c0659 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:45.583955 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1209/2412] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:27:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:27:45.852406 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8983e6-1d0e-48f8-b9d9-7a2077c53eca None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:45.853854 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5a8983e6-1d0e-48f8-b9d9-7a2077c53eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:45.866232 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8983e6-1d0e-48f8-b9d9-7a2077c53eca None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:45.872718 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd765ef1-3770-4c0f-b790-b969e83d0524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:45.873422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd765ef1-3770-4c0f-b790-b969e83d0524 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:45.873634 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd765ef1-3770-4c0f-b790-b969e83d0524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:45.873909 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd765ef1-3770-4c0f-b790-b969e83d0524 admin admin] PATH_INFO: `/v3/projects/31e51c5876a44ee08ba5e17053e89da4` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:45.875363 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd765ef1-3770-4c0f-b790-b969e83d0524 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31e51c5876a44ee08ba5e17053e89da4)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:45.877302 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd765ef1-3770-4c0f-b790-b969e83d0524 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:45.924048 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fd765ef1-3770-4c0f-b790-b969e83d0524 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31e51c5876a44ee08ba5e17053e89da4', 'request_id': 'req-fd765ef1-3770-4c0f-b790-b969e83d0524'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:45.930087 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fd765ef1-3770-4c0f-b790-b969e83d0524 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31e51c5876a44ee08ba5e17053e89da4', 'request_id': 'req-fd765ef1-3770-4c0f-b790-b969e83d0524'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:45.936091 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fd765ef1-3770-4c0f-b790-b969e83d0524 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31e51c5876a44ee08ba5e17053e89da4', 'request_id': 'req-fd765ef1-3770-4c0f-b790-b969e83d0524'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:45.948241 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fd765ef1-3770-4c0f-b790-b969e83d0524 admin admin] The token cache is being invalidate because project 31e51c5876a44ee08ba5e17053e89da4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:27:45.948615 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fd765ef1-3770-4c0f-b790-b969e83d0524 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:45.949793 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fd765ef1-3770-4c0f-b790-b969e83d0524 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:45.951323 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1204/2413] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:27:45 2022] DELETE /identity/v3/projects/31e51c5876a44ee08ba5e17053e89da4 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:27:45.956658 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5aed1-1050-48ab-be54-3bdf4dc7a885 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:45.957217 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5aed1-1050-48ab-be54-3bdf4dc7a885 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:45.957716 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5aed1-1050-48ab-be54-3bdf4dc7a885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:45.979145 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-9ae5aed1-1050-48ab-be54-3bdf4dc7a885 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:27:45.981389 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9ae5aed1-1050-48ab-be54-3bdf4dc7a885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:46.001969 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:27:46.042874 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1210/2414] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:27:46.050485 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6d499-b98b-40c5-beb6-c4d93b272bc8 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:46.050771 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6d499-b98b-40c5-beb6-c4d93b272bc8 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:46.051043 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce6d499-b98b-40c5-beb6-c4d93b272bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:46.070940 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-5ce6d499-b98b-40c5-beb6-c4d93b272bc8 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:27:46.072180 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5ce6d499-b98b-40c5-beb6-c4d93b272bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:46.082531 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1205/2415] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:27:46.086721 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5aed1-1050-48ab-be54-3bdf4dc7a885 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:46.096640 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5aed1-1050-48ab-be54-3bdf4dc7a885 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:46.101149 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42bc9e-2b8d-48ea-a0e4-8de00ed1d6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:46.101752 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42bc9e-2b8d-48ea-a0e4-8de00ed1d6b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:46.102033 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42bc9e-2b8d-48ea-a0e4-8de00ed1d6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:46.102304 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42bc9e-2b8d-48ea-a0e4-8de00ed1d6b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:46.102993 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef42bc9e-2b8d-48ea-a0e4-8de00ed1d6b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:27:46.103299 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef42bc9e-2b8d-48ea-a0e4-8de00ed1d6b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:46.104950 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef42bc9e-2b8d-48ea-a0e4-8de00ed1d6b8 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:46.116547 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1211/2416] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:27:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:27:46.121181 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6d499-b98b-40c5-beb6-c4d93b272bc8 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:46.130355 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce6d499-b98b-40c5-beb6-c4d93b272bc8 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:46.134961 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd381375-5fda-407d-87c9-69265c2ca82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:46.135564 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd381375-5fda-407d-87c9-69265c2ca82e admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:46.135842 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd381375-5fda-407d-87c9-69265c2ca82e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:46.136754 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd381375-5fda-407d-87c9-69265c2ca82e admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:46.137419 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd381375-5fda-407d-87c9-69265c2ca82e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:46.139322 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd381375-5fda-407d-87c9-69265c2ca82e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:46.165556 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1206/2417] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:27:46 2022] POST /identity/v3/projects => generated 389 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:27:46.170023 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42bc9e-2b8d-48ea-a0e4-8de00ed1d6b8 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:46.180099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42bc9e-2b8d-48ea-a0e4-8de00ed1d6b8 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:46.238037 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaefa41-9fa0-41ca-84f0-a4871ff7105c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:46.238648 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaefa41-9fa0-41ca-84f0-a4871ff7105c admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:46.238926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaefa41-9fa0-41ca-84f0-a4871ff7105c admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:46.239199 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaefa41-9fa0-41ca-84f0-a4871ff7105c admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:46.239854 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaefa41-9fa0-41ca-84f0-a4871ff7105c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:46.241799 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaefa41-9fa0-41ca-84f0-a4871ff7105c admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:46.262322 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1212/2418] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:27:46 2022] POST /identity/v3/users => generated 295 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:27:46.266552 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd381375-5fda-407d-87c9-69265c2ca82e admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:46.277085 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd381375-5fda-407d-87c9-69265c2ca82e admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:46.282303 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1894ea3-4cdb-4b20-a919-69129284ed53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:46.283215 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1894ea3-4cdb-4b20-a919-69129284ed53 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:46.283636 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1894ea3-4cdb-4b20-a919-69129284ed53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:46.284080 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1894ea3-4cdb-4b20-a919-69129284ed53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:46.285165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1894ea3-4cdb-4b20-a919-69129284ed53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:46.287705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1894ea3-4cdb-4b20-a919-69129284ed53 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:46.303673 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1207/2419] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:27:46.307744 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaefa41-9fa0-41ca-84f0-a4871ff7105c admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:46.318880 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaefa41-9fa0-41ca-84f0-a4871ff7105c admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:46.323740 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e903fa5-b263-4e64-a375-fac05d21b334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:46.324389 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e903fa5-b263-4e64-a375-fac05d21b334 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:46.324669 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e903fa5-b263-4e64-a375-fac05d21b334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:46.324939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e903fa5-b263-4e64-a375-fac05d21b334 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:46.325626 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e903fa5-b263-4e64-a375-fac05d21b334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:46.327220 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e903fa5-b263-4e64-a375-fac05d21b334 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:46.338411 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1213/2420] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:27:46.342700 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1894ea3-4cdb-4b20-a919-69129284ed53 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:46.352840 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1894ea3-4cdb-4b20-a919-69129284ed53 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:46.357867 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbefb4-baec-42d9-b949-6b5a52a76b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:46.358508 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbefb4-baec-42d9-b949-6b5a52a76b03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:46.358787 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbefb4-baec-42d9-b949-6b5a52a76b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:46.359082 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbefb4-baec-42d9-b949-6b5a52a76b03 admin admin] PATH_INFO: `/v3/projects/5c830c3eb0934d89b3385b094506ce58/users/091a47323a124df4bc951c8362c7fbb2/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:46.373720 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cbefb4-baec-42d9-b949-6b5a52a76b03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c830c3eb0934d89b3385b094506ce58, user_id=091a47323a124df4bc951c8362c7fbb2, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:46.376370 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cbefb4-baec-42d9-b949-6b5a52a76b03 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:46.389761 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1208/2421] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:27:46 2022] PUT /identity/v3/projects/5c830c3eb0934d89b3385b094506ce58/users/091a47323a124df4bc951c8362c7fbb2/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:27:46.399883 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22b822-aae1-43ba-bff3-c84bf0dd4df3 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:46.400232 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22b822-aae1-43ba-bff3-c84bf0dd4df3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:46.400536 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea22b822-aae1-43ba-bff3-c84bf0dd4df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:46.429319 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-ea22b822-aae1-43ba-bff3-c84bf0dd4df3 None None] MFA Rules not processed for user `091a47323a124df4bc951c8362c7fbb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:27:46.430515 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ea22b822-aae1-43ba-bff3-c84bf0dd4df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:46.494758 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1214/2422] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:27:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:27:46.505918 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbefb4-baec-42d9-b949-6b5a52a76b03 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:46.507600 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-03cbefb4-baec-42d9-b949-6b5a52a76b03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:46.512963 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:27:46.567196 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbefb4-baec-42d9-b949-6b5a52a76b03 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:46.570844 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5de7ab-9adb-4066-b971-899d388add53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:46.571455 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5de7ab-9adb-4066-b971-899d388add53 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:46.571744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5de7ab-9adb-4066-b971-899d388add53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:46.572032 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5de7ab-9adb-4066-b971-899d388add53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:46.581287 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5de7ab-9adb-4066-b971-899d388add53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:46.582812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5de7ab-9adb-4066-b971-899d388add53 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:46.593903 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1209/2423] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:27:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:27:51.662621 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72452632-9e8d-41ca-b4a4-c83407921590 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:51.663091 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72452632-9e8d-41ca-b4a4-c83407921590 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:51.663458 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72452632-9e8d-41ca-b4a4-c83407921590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:51.683537 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-72452632-9e8d-41ca-b4a4-c83407921590 None None] MFA Rules not processed for user `0b92ad58e5484bc796e1b61fa9f788dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:27:51.684838 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-72452632-9e8d-41ca-b4a4-c83407921590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:51.701120 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:27:51.739760 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1215/2424] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:27:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:27:56.590876 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=25 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:27:58.895220 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5de7ab-9adb-4066-b971-899d388add53 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:58.958400 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5de7ab-9adb-4066-b971-899d388add53 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:58.962927 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da43a7-60f8-413b-8297-4ead38ec3381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:58.963556 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da43a7-60f8-413b-8297-4ead38ec3381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:58.964396 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da43a7-60f8-413b-8297-4ead38ec3381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:58.964677 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da43a7-60f8-413b-8297-4ead38ec3381 admin admin] PATH_INFO: `/v3/users/091a47323a124df4bc951c8362c7fbb2` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:58.965836 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da43a7-60f8-413b-8297-4ead38ec3381 admin admin] RBAC: Authorizing `identity:delete_user(user_id=091a47323a124df4bc951c8362c7fbb2)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:58.967747 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da43a7-60f8-413b-8297-4ead38ec3381 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:59.013000 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-39da43a7-60f8-413b-8297-4ead38ec3381 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '091a47323a124df4bc951c8362c7fbb2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:59.013633 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-39da43a7-60f8-413b-8297-4ead38ec3381 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '091a47323a124df4bc951c8362c7fbb2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:59.020416 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-39da43a7-60f8-413b-8297-4ead38ec3381 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '091a47323a124df4bc951c8362c7fbb2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:59.021044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-39da43a7-60f8-413b-8297-4ead38ec3381 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '091a47323a124df4bc951c8362c7fbb2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:59.033252 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-39da43a7-60f8-413b-8297-4ead38ec3381 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '091a47323a124df4bc951c8362c7fbb2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:59.045886 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1210/2425] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:27:58 2022] DELETE /identity/v3/users/091a47323a124df4bc951c8362c7fbb2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:27:59.050310 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd86c7d-9d07-42c7-99bb-1dadd29bdafe None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:59.050819 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd86c7d-9d07-42c7-99bb-1dadd29bdafe None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:59.050929 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd86c7d-9d07-42c7-99bb-1dadd29bdafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:59.068995 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-8bd86c7d-9d07-42c7-99bb-1dadd29bdafe None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:27:59.070192 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8bd86c7d-9d07-42c7-99bb-1dadd29bdafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:59.127578 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1216/2426] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:27:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:27:59.137579 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da43a7-60f8-413b-8297-4ead38ec3381 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:59.138950 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-39da43a7-60f8-413b-8297-4ead38ec3381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:59.194283 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da43a7-60f8-413b-8297-4ead38ec3381 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:59.197873 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461c28b-4c43-4030-996e-e3c0e370e200 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:59.198998 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461c28b-4c43-4030-996e-e3c0e370e200 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:59.199277 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461c28b-4c43-4030-996e-e3c0e370e200 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:59.199545 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461c28b-4c43-4030-996e-e3c0e370e200 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:59.208293 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461c28b-4c43-4030-996e-e3c0e370e200 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:59.209706 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461c28b-4c43-4030-996e-e3c0e370e200 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:59.219518 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1211/2427] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:27:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:27:59.540343 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd86c7d-9d07-42c7-99bb-1dadd29bdafe None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:27:59.542549 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-8bd86c7d-9d07-42c7-99bb-1dadd29bdafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:27:59.554579 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd86c7d-9d07-42c7-99bb-1dadd29bdafe None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:27:59.569444 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440bee5-7271-45b2-8f3c-dfad29c3fc5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:27:59.570204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440bee5-7271-45b2-8f3c-dfad29c3fc5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:27:59.570528 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440bee5-7271-45b2-8f3c-dfad29c3fc5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:27:59.570869 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440bee5-7271-45b2-8f3c-dfad29c3fc5d admin admin] PATH_INFO: `/v3/projects/5c830c3eb0934d89b3385b094506ce58` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:27:59.572158 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440bee5-7271-45b2-8f3c-dfad29c3fc5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c830c3eb0934d89b3385b094506ce58)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:27:59.574992 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440bee5-7271-45b2-8f3c-dfad29c3fc5d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:27:59.637232 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-3440bee5-7271-45b2-8f3c-dfad29c3fc5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c830c3eb0934d89b3385b094506ce58', 'request_id': 'req-3440bee5-7271-45b2-8f3c-dfad29c3fc5d'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:59.643411 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-3440bee5-7271-45b2-8f3c-dfad29c3fc5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c830c3eb0934d89b3385b094506ce58', 'request_id': 'req-3440bee5-7271-45b2-8f3c-dfad29c3fc5d'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:59.648866 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-3440bee5-7271-45b2-8f3c-dfad29c3fc5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c830c3eb0934d89b3385b094506ce58', 'request_id': 'req-3440bee5-7271-45b2-8f3c-dfad29c3fc5d'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:59.661335 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-3440bee5-7271-45b2-8f3c-dfad29c3fc5d admin admin] The token cache is being invalidate because project 5c830c3eb0934d89b3385b094506ce58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:27:59.661626 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-3440bee5-7271-45b2-8f3c-dfad29c3fc5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:59.662252 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-3440bee5-7271-45b2-8f3c-dfad29c3fc5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:27:59.663818 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1217/2428] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:27:59 2022] DELETE /identity/v3/projects/5c830c3eb0934d89b3385b094506ce58 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:28:00.938864 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461c28b-4c43-4030-996e-e3c0e370e200 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:28:00.940289 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c461c28b-4c43-4030-996e-e3c0e370e200 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:28:00.967512 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:28:01.012212 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461c28b-4c43-4030-996e-e3c0e370e200 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:28:01.076265 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787c641-604b-4c27-8087-3d817f66d85e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a386d326dc634cbd943ac30f6e8d08bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:28:01.076877 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787c641-604b-4c27-8087-3d817f66d85e service placement] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:28:01.077160 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787c641-604b-4c27-8087-3d817f66d85e service placement] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:28:01.077444 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787c641-604b-4c27-8087-3d817f66d85e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:28:01.079199 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7787c641-604b-4c27-8087-3d817f66d85e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:28:01.090866 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7787c641-604b-4c27-8087-3d817f66d85e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:28:01.092470 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7787c641-604b-4c27-8087-3d817f66d85e service placement] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:28:01.102128 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1212/2429] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:28:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:28:09.658244 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=69,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:28:11.098005 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=48 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:29:17.358779 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48ef34-6ac8-42c4-8321-2bf91926e6e8 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:29:17.359287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48ef34-6ac8-42c4-8321-2bf91926e6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:29:17.359387 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb48ef34-6ac8-42c4-8321-2bf91926e6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:29:17.377821 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-eb48ef34-6ac8-42c4-8321-2bf91926e6e8 None None] MFA Rules not processed for user `d815c45c04314dd0abe18cd9b4d9b744`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:29:17.379008 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-eb48ef34-6ac8-42c4-8321-2bf91926e6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:29:17.434530 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1218/2430] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:29:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:29:27.427644 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=25 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:29:50.201237 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df6515-d646-4fff-aa5d-cd3f9108d029 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:29:50.201766 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df6515-d646-4fff-aa5d-cd3f9108d029 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:29:50.201867 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df6515-d646-4fff-aa5d-cd3f9108d029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:29:50.220084 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-50df6515-d646-4fff-aa5d-cd3f9108d029 None None] MFA Rules not processed for user `0b92ad58e5484bc796e1b61fa9f788dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:29:50.221263 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-50df6515-d646-4fff-aa5d-cd3f9108d029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:29:50.274213 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1213/2431] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:29:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:29:56.471005 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48ef34-6ac8-42c4-8321-2bf91926e6e8 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:29:56.472460 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-eb48ef34-6ac8-42c4-8321-2bf91926e6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:29:56.531837 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb48ef34-6ac8-42c4-8321-2bf91926e6e8 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:29:56.535567 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf303452-67fc-467d-b8cc-f144d6559039 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:29:56.536215 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf303452-67fc-467d-b8cc-f144d6559039 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:29:56.536500 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf303452-67fc-467d-b8cc-f144d6559039 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:29:56.536775 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf303452-67fc-467d-b8cc-f144d6559039 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:29:56.538605 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-bf303452-67fc-467d-b8cc-f144d6559039 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:29:56.614163 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf303452-67fc-467d-b8cc-f144d6559039 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:29:56.615586 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf303452-67fc-467d-b8cc-f144d6559039 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:29:56.628645 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1219/2432] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:29:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:29:57.740711 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df6515-d646-4fff-aa5d-cd3f9108d029 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:29:57.742265 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-50df6515-d646-4fff-aa5d-cd3f9108d029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:29:57.755677 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df6515-d646-4fff-aa5d-cd3f9108d029 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:29:57.760578 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a7e57-08ae-4c8a-bdaf-25ad131b8e0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:29:57.760578 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a7e57-08ae-4c8a-bdaf-25ad131b8e0b service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:29:57.760824 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a7e57-08ae-4c8a-bdaf-25ad131b8e0b service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:29:57.760910 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5a7e57-08ae-4c8a-bdaf-25ad131b8e0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:29:57.762646 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6b5a7e57-08ae-4c8a-bdaf-25ad131b8e0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:29:57.777487 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a7e57-08ae-4c8a-bdaf-25ad131b8e0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:29:57.778009 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5a7e57-08ae-4c8a-bdaf-25ad131b8e0b service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:29:57.791005 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1214/2433] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:29:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:30:06.622077 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=54 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:30:07.784952 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=31 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:30:26.253033 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf303452-67fc-467d-b8cc-f144d6559039 service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:30:26.254444 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-bf303452-67fc-467d-b8cc-f144d6559039 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:30:26.313086 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf303452-67fc-467d-b8cc-f144d6559039 service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:30:26.316630 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14590dd-940f-48a2-93ec-4e13b07c8b59 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:30:26.317237 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14590dd-940f-48a2-93ec-4e13b07c8b59 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:30:26.317514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14590dd-940f-48a2-93ec-4e13b07c8b59 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:30:26.317785 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14590dd-940f-48a2-93ec-4e13b07c8b59 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:30:26.319507 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-c14590dd-940f-48a2-93ec-4e13b07c8b59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:30:26.330357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14590dd-940f-48a2-93ec-4e13b07c8b59 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:30:26.331780 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14590dd-940f-48a2-93ec-4e13b07c8b59 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:30:26.340788 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1220/2434] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:30:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:30:36.336593 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=26 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:30:39.565012 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a7e57-08ae-4c8a-bdaf-25ad131b8e0b service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:30:39.566506 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6b5a7e57-08ae-4c8a-bdaf-25ad131b8e0b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:30:39.579772 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5a7e57-08ae-4c8a-bdaf-25ad131b8e0b service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:30:39.583620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8cf1e-7df7-401d-957c-3ac2cf9baf92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:30:39.584359 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8cf1e-7df7-401d-957c-3ac2cf9baf92 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:30:39.584638 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8cf1e-7df7-401d-957c-3ac2cf9baf92 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:30:39.584909 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8cf1e-7df7-401d-957c-3ac2cf9baf92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:30:39.586735 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-24f8cf1e-7df7-401d-957c-3ac2cf9baf92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:30:39.649695 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8cf1e-7df7-401d-957c-3ac2cf9baf92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:30:39.651856 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8cf1e-7df7-401d-957c-3ac2cf9baf92 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:30:39.662744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1215/2435] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:30:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:30:40.154219 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14590dd-940f-48a2-93ec-4e13b07c8b59 service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:30:40.156830 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-c14590dd-940f-48a2-93ec-4e13b07c8b59 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:30:40.177416 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14590dd-940f-48a2-93ec-4e13b07c8b59 service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:30:40.192374 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241982db-c6d6-4f3d-974b-8a90d1d5142d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:30:40.193015 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241982db-c6d6-4f3d-974b-8a90d1d5142d service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:30:40.193296 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241982db-c6d6-4f3d-974b-8a90d1d5142d service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:30:40.193568 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241982db-c6d6-4f3d-974b-8a90d1d5142d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:30:40.195390 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-241982db-c6d6-4f3d-974b-8a90d1d5142d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:30:40.214953 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241982db-c6d6-4f3d-974b-8a90d1d5142d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:30:40.217698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241982db-c6d6-4f3d-974b-8a90d1d5142d service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:30:40.233770 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1221/2436] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:30:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:30:47.611658 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8cf1e-7df7-401d-957c-3ac2cf9baf92 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:30:47.626809 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8cf1e-7df7-401d-957c-3ac2cf9baf92 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:30:47.630708 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d678f-03b5-4f56-af8d-7596ca823dda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:30:47.631320 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d678f-03b5-4f56-af8d-7596ca823dda service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:30:47.631788 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d678f-03b5-4f56-af8d-7596ca823dda service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:30:47.632134 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d678f-03b5-4f56-af8d-7596ca823dda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:30:47.633887 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-459d678f-03b5-4f56-af8d-7596ca823dda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:30:47.702010 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d678f-03b5-4f56-af8d-7596ca823dda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:30:47.703432 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d678f-03b5-4f56-af8d-7596ca823dda service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:30:47.714380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1216/2437] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:30:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:30:48.237353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55921eba-4449-4cb0-8690-229c2cb96991 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:30:48.237834 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55921eba-4449-4cb0-8690-229c2cb96991 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:30:48.237942 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55921eba-4449-4cb0-8690-229c2cb96991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:30:48.257431 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-55921eba-4449-4cb0-8690-229c2cb96991 None None] MFA Rules not processed for user `c77a01fed0e741288f05941fe5670a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:30:48.258633 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-55921eba-4449-4cb0-8690-229c2cb96991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:30:48.266219 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1222/2438] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:30:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:30:48.712228 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d678f-03b5-4f56-af8d-7596ca823dda service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:30:48.722881 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d678f-03b5-4f56-af8d-7596ca823dda service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:30:48.727052 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9cb7b-0bb4-4f0d-a418-e1b6855cd95d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:30:48.727839 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9cb7b-0bb4-4f0d-a418-e1b6855cd95d service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:30:48.728078 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9cb7b-0bb4-4f0d-a418-e1b6855cd95d service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:30:48.728409 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e9cb7b-0bb4-4f0d-a418-e1b6855cd95d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:30:48.730670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d0e9cb7b-0bb4-4f0d-a418-e1b6855cd95d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:30:48.742423 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9cb7b-0bb4-4f0d-a418-e1b6855cd95d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:30:48.743937 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e9cb7b-0bb4-4f0d-a418-e1b6855cd95d service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:30:48.755021 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1217/2439] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:30:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:30:49.241122 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55921eba-4449-4cb0-8690-229c2cb96991 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:30:49.242542 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-55921eba-4449-4cb0-8690-229c2cb96991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:30:49.261464 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55921eba-4449-4cb0-8690-229c2cb96991 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:30:49.267473 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e6ed6d-855b-49b7-943a-0e992257c088 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a386d326dc634cbd943ac30f6e8d08bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:30:49.268137 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6ed6d-855b-49b7-943a-0e992257c088 service placement] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:30:49.268401 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6ed6d-855b-49b7-943a-0e992257c088 service placement] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:30:49.268670 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e6ed6d-855b-49b7-943a-0e992257c088 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:30:49.270415 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f3e6ed6d-855b-49b7-943a-0e992257c088 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:30:49.283102 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6ed6d-855b-49b7-943a-0e992257c088 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:30:49.284716 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e6ed6d-855b-49b7-943a-0e992257c088 service placement] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:30:49.296102 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1223/2440] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:30:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:30:51.455647 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9cb7b-0bb4-4f0d-a418-e1b6855cd95d service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:30:51.466389 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e9cb7b-0bb4-4f0d-a418-e1b6855cd95d service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:30:51.471286 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1e40d1-4dc1-48d2-9f43-38caa9655d6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:30:51.472022 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e40d1-4dc1-48d2-9f43-38caa9655d6c service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:30:51.472569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e40d1-4dc1-48d2-9f43-38caa9655d6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:30:51.473088 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e40d1-4dc1-48d2-9f43-38caa9655d6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:30:51.475376 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0c1e40d1-4dc1-48d2-9f43-38caa9655d6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:30:51.489754 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e40d1-4dc1-48d2-9f43-38caa9655d6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:30:51.489754 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1e40d1-4dc1-48d2-9f43-38caa9655d6c service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:30:51.500180 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1218/2441] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:30:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:30:51.519738 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccd2a2-dd3d-487f-b76c-72e72f6db57b None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:30:51.520294 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccd2a2-dd3d-487f-b76c-72e72f6db57b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:30:51.520588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bccd2a2-dd3d-487f-b76c-72e72f6db57b None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:30:51.522455 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1224/2442] 10.222.0.40 () {54 vars in 921 bytes} [Wed Jul 27 15:30:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:30:51.549681 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1bbb4-1440-4f67-a4c8-1d845a1d2fce None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:30:51.550281 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1bbb4-1440-4f67-a4c8-1d845a1d2fce None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:30:51.550759 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd1bbb4-1440-4f67-a4c8-1d845a1d2fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:30:51.581791 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-fbd1bbb4-1440-4f67-a4c8-1d845a1d2fce None None] MFA Rules not processed for user `a386d326dc634cbd943ac30f6e8d08bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:30:51.583389 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-fbd1bbb4-1440-4f67-a4c8-1d845a1d2fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:30:51.595825 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1219/2443] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Jul 27 15:30:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:30:51.603216 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccd2a2-dd3d-487f-b76c-72e72f6db57b None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:30:51.607092 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-3bccd2a2-dd3d-487f-b76c-72e72f6db57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:30:51.613155 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1bbb4-1440-4f67-a4c8-1d845a1d2fce None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:30:51.629658 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd1bbb4-1440-4f67-a4c8-1d845a1d2fce None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:30:51.633021 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bccd2a2-dd3d-487f-b76c-72e72f6db57b None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:30:51.637463 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ace18-7975-493e-b1ec-150233e9ff89 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a386d326dc634cbd943ac30f6e8d08bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:30:51.638109 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ace18-7975-493e-b1ec-150233e9ff89 service placement] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:30:51.638393 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ace18-7975-493e-b1ec-150233e9ff89 service placement] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:30:51.638669 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ace18-7975-493e-b1ec-150233e9ff89 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:30:51.643319 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86efb90c-497f-4938-a99f-e6d72181dcfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:30:51.643967 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86efb90c-497f-4938-a99f-e6d72181dcfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:30:51.644268 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86efb90c-497f-4938-a99f-e6d72181dcfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:30:51.644544 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86efb90c-497f-4938-a99f-e6d72181dcfd admin admin] PATH_INFO: `/v3/users/d815c45c04314dd0abe18cd9b4d9b744` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:30:51.649019 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86efb90c-497f-4938-a99f-e6d72181dcfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d815c45c04314dd0abe18cd9b4d9b744)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:30:51.654049 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ace18-7975-493e-b1ec-150233e9ff89 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:30:51.655119 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7ace18-7975-493e-b1ec-150233e9ff89 service placement] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:30:51.655498 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86efb90c-497f-4938-a99f-e6d72181dcfd admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:30:51.668594 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1220/2444] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:30:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:30:51.730363 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-86efb90c-497f-4938-a99f-e6d72181dcfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd815c45c04314dd0abe18cd9b4d9b744'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:30:51.730953 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-86efb90c-497f-4938-a99f-e6d72181dcfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd815c45c04314dd0abe18cd9b4d9b744'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:30:51.739450 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-86efb90c-497f-4938-a99f-e6d72181dcfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd815c45c04314dd0abe18cd9b4d9b744'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:30:51.746585 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-86efb90c-497f-4938-a99f-e6d72181dcfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd815c45c04314dd0abe18cd9b4d9b744'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:30:51.758104 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-86efb90c-497f-4938-a99f-e6d72181dcfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd815c45c04314dd0abe18cd9b4d9b744'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:30:51.766496 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1225/2445] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:30:51 2022] DELETE /identity/v3/users/d815c45c04314dd0abe18cd9b4d9b744 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:30:51.955640 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ace18-7975-493e-b1ec-150233e9ff89 service placement] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:30:51.968988 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7ace18-7975-493e-b1ec-150233e9ff89 service placement] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:30:52.032139 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:30:52.046533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09be8af2-deda-443c-857d-9edc309765a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:30:52.047186 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be8af2-deda-443c-857d-9edc309765a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:30:52.047471 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be8af2-deda-443c-857d-9edc309765a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:30:52.047754 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09be8af2-deda-443c-857d-9edc309765a6 admin admin] PATH_INFO: `/v3/projects/954859b49535432490388485f316513d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:30:52.048995 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be8af2-deda-443c-857d-9edc309765a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=954859b49535432490388485f316513d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:30:52.050912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09be8af2-deda-443c-857d-9edc309765a6 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:30:52.112275 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-09be8af2-deda-443c-857d-9edc309765a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '954859b49535432490388485f316513d', 'request_id': 'req-09be8af2-deda-443c-857d-9edc309765a6'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:30:52.121381 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-09be8af2-deda-443c-857d-9edc309765a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '954859b49535432490388485f316513d', 'request_id': 'req-09be8af2-deda-443c-857d-9edc309765a6'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:30:52.127439 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-09be8af2-deda-443c-857d-9edc309765a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '954859b49535432490388485f316513d', 'request_id': 'req-09be8af2-deda-443c-857d-9edc309765a6'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:30:52.142917 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-09be8af2-deda-443c-857d-9edc309765a6 admin admin] The token cache is being invalidate because project 954859b49535432490388485f316513d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:30:52.143312 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-09be8af2-deda-443c-857d-9edc309765a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:30:52.144073 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-09be8af2-deda-443c-857d-9edc309765a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:30:52.145894 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1221/2446] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:30:51 2022] DELETE /identity/v3/projects/954859b49535432490388485f316513d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:30:52.150929 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c00df-9380-4941-ac5c-d7cffce6e6df None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:30:52.151215 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c00df-9380-4941-ac5c-d7cffce6e6df None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:30:52.151781 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c00df-9380-4941-ac5c-d7cffce6e6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:30:52.174314 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-3a6c00df-9380-4941-ac5c-d7cffce6e6df None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:30:52.175959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-3a6c00df-9380-4941-ac5c-d7cffce6e6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:30:52.249503 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa87e0-6b63-41b1-873c-ecd1d649b266 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:30:52.249812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa87e0-6b63-41b1-873c-ecd1d649b266 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:30:52.250234 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa87e0-6b63-41b1-873c-ecd1d649b266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:30:52.252172 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1226/2447] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:30:52.281931 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-2daa87e0-6b63-41b1-873c-ecd1d649b266 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:30:52.283498 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2daa87e0-6b63-41b1-873c-ecd1d649b266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:30:52.294584 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1222/2448] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:30:52.298972 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c00df-9380-4941-ac5c-d7cffce6e6df None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:30:52.313395 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c00df-9380-4941-ac5c-d7cffce6e6df None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:30:52.320566 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ec2a8-7a4e-418d-ad9e-3899ba9e0042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:30:52.321661 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ec2a8-7a4e-418d-ad9e-3899ba9e0042 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:30:52.322174 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ec2a8-7a4e-418d-ad9e-3899ba9e0042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:30:52.322473 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ec2a8-7a4e-418d-ad9e-3899ba9e0042 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:30:52.323218 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ec2a8-7a4e-418d-ad9e-3899ba9e0042 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:30:52.323694 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ec2a8-7a4e-418d-ad9e-3899ba9e0042 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:30:52.328269 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ec2a8-7a4e-418d-ad9e-3899ba9e0042 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:30:52.343500 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1227/2449] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:30:52.347875 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa87e0-6b63-41b1-873c-ecd1d649b266 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:30:52.358162 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa87e0-6b63-41b1-873c-ecd1d649b266 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:30:52.362976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fed1e-e55f-460e-973d-6ba4b6f24c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:30:52.363599 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fed1e-e55f-460e-973d-6ba4b6f24c34 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:30:52.363880 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fed1e-e55f-460e-973d-6ba4b6f24c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:30:52.364180 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fed1e-e55f-460e-973d-6ba4b6f24c34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:30:52.364847 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011fed1e-e55f-460e-973d-6ba4b6f24c34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:30:52.366754 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011fed1e-e55f-460e-973d-6ba4b6f24c34 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:30:52.400100 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1223/2450] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:30:52 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:30:52.405215 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ec2a8-7a4e-418d-ad9e-3899ba9e0042 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:30:52.417510 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ec2a8-7a4e-418d-ad9e-3899ba9e0042 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:30:52.446000 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:30:52.481495 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc451b-1949-4f0d-a642-3484640bebe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:30:52.482114 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc451b-1949-4f0d-a642-3484640bebe3 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:30:52.482391 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc451b-1949-4f0d-a642-3484640bebe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:30:52.482657 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc451b-1949-4f0d-a642-3484640bebe3 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:30:52.483322 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc451b-1949-4f0d-a642-3484640bebe3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:30:52.485375 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc451b-1949-4f0d-a642-3484640bebe3 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:30:52.506881 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1228/2451] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:30:52 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:30:52.511744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fed1e-e55f-460e-973d-6ba4b6f24c34 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:30:52.535156 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fed1e-e55f-460e-973d-6ba4b6f24c34 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:30:52.539864 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7524d-8910-404c-8f24-994e0983a9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:30:52.540512 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7524d-8910-404c-8f24-994e0983a9b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:30:52.540792 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7524d-8910-404c-8f24-994e0983a9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:30:52.541066 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e7524d-8910-404c-8f24-994e0983a9b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:30:52.542450 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7524d-8910-404c-8f24-994e0983a9b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:30:52.544095 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e7524d-8910-404c-8f24-994e0983a9b7 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:30:52.554415 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1224/2452] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 15:30:52.558729 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc451b-1949-4f0d-a642-3484640bebe3 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:30:52.569042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc451b-1949-4f0d-a642-3484640bebe3 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:30:52.574232 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3000879-dc53-4700-8f86-cda28d3dec73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:30:52.574837 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3000879-dc53-4700-8f86-cda28d3dec73 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:30:52.575119 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3000879-dc53-4700-8f86-cda28d3dec73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:30:52.575399 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3000879-dc53-4700-8f86-cda28d3dec73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:30:52.576138 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3000879-dc53-4700-8f86-cda28d3dec73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:30:52.578612 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3000879-dc53-4700-8f86-cda28d3dec73 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:30:52.590525 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1229/2453] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:30:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:30:52.594816 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7524d-8910-404c-8f24-994e0983a9b7 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:30:52.604871 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e7524d-8910-404c-8f24-994e0983a9b7 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:30:52.609475 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78c5c7-3d17-41c2-b665-6b9a5bde53f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:30:52.610227 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78c5c7-3d17-41c2-b665-6b9a5bde53f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:30:52.610504 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78c5c7-3d17-41c2-b665-6b9a5bde53f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:30:52.610952 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78c5c7-3d17-41c2-b665-6b9a5bde53f1 admin admin] PATH_INFO: `/v3/projects/a6e257753bf04fe7ab7c0a57f817dae1/users/6f2efb7dbdb3468fa083b35159324081/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:30:52.625995 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78c5c7-3d17-41c2-b665-6b9a5bde53f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6e257753bf04fe7ab7c0a57f817dae1, user_id=6f2efb7dbdb3468fa083b35159324081, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:30:52.628677 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78c5c7-3d17-41c2-b665-6b9a5bde53f1 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:30:52.642641 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1225/2454] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:30:52 2022] PUT /identity/v3/projects/a6e257753bf04fe7ab7c0a57f817dae1/users/6f2efb7dbdb3468fa083b35159324081/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:30:52.647777 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49201064-87ac-48c2-9ad2-e8f7f6b026c0 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:30:52.648158 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49201064-87ac-48c2-9ad2-e8f7f6b026c0 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:30:52.648489 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49201064-87ac-48c2-9ad2-e8f7f6b026c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:30:52.668803 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-49201064-87ac-48c2-9ad2-e8f7f6b026c0 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:30:52.670005 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-49201064-87ac-48c2-9ad2-e8f7f6b026c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:30:52.730535 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1230/2455] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:30:52.743098 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78c5c7-3d17-41c2-b665-6b9a5bde53f1 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:30:52.745061 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4c78c5c7-3d17-41c2-b665-6b9a5bde53f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:30:52.812522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78c5c7-3d17-41c2-b665-6b9a5bde53f1 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:30:52.816378 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc8e05-c048-46b1-8e8c-fec01c02cc76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:30:52.817018 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc8e05-c048-46b1-8e8c-fec01c02cc76 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:30:52.817305 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc8e05-c048-46b1-8e8c-fec01c02cc76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:30:52.817583 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc8e05-c048-46b1-8e8c-fec01c02cc76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:30:52.828340 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc8e05-c048-46b1-8e8c-fec01c02cc76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:30:52.829809 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc8e05-c048-46b1-8e8c-fec01c02cc76 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:30:52.841530 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1226/2456] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:30:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:30:57.138850 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cbba0-c211-41e7-8f6d-cd431b0d9243 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:30:57.139682 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cbba0-c211-41e7-8f6d-cd431b0d9243 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:30:57.140201 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46cbba0-c211-41e7-8f6d-cd431b0d9243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:30:57.184354 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-c46cbba0-c211-41e7-8f6d-cd431b0d9243 None None] MFA Rules not processed for user `6f2efb7dbdb3468fa083b35159324081`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:30:57.186322 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-c46cbba0-c211-41e7-8f6d-cd431b0d9243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:30:57.274399 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1231/2457] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:30:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:30:57.288482 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc8e05-c048-46b1-8e8c-fec01c02cc76 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:30:57.290485 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-cafc8e05-c048-46b1-8e8c-fec01c02cc76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:30:57.326052 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:30:57.413483 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc8e05-c048-46b1-8e8c-fec01c02cc76 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:30:57.419958 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05414f09-850d-4131-a4f4-e1742d1a684c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:30:57.420605 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05414f09-850d-4131-a4f4-e1742d1a684c service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:30:57.420891 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05414f09-850d-4131-a4f4-e1742d1a684c service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:30:57.421167 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05414f09-850d-4131-a4f4-e1742d1a684c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:30:57.430783 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05414f09-850d-4131-a4f4-e1742d1a684c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:30:57.432998 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05414f09-850d-4131-a4f4-e1742d1a684c service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:30:57.444631 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1227/2458] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:30:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:30:58.815140 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cbba0-c211-41e7-8f6d-cd431b0d9243 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:30:58.835454 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46cbba0-c211-41e7-8f6d-cd431b0d9243 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:30:58.843874 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135986d7-599b-4cf2-bab1-d8c7bc1ff80a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:30:58.845824 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135986d7-599b-4cf2-bab1-d8c7bc1ff80a service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:30:58.847327 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135986d7-599b-4cf2-bab1-d8c7bc1ff80a service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:30:58.848057 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135986d7-599b-4cf2-bab1-d8c7bc1ff80a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:30:58.851357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-135986d7-599b-4cf2-bab1-d8c7bc1ff80a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:30:58.868813 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135986d7-599b-4cf2-bab1-d8c7bc1ff80a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:30:58.872402 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135986d7-599b-4cf2-bab1-d8c7bc1ff80a service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:30:58.890539 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1232/2459] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:30:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 15:30:59.177522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58451bd-7b8d-4bb1-ac6a-14e1ccddfedb None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:30:59.178584 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58451bd-7b8d-4bb1-ac6a-14e1ccddfedb None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:30:59.179077 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58451bd-7b8d-4bb1-ac6a-14e1ccddfedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:30:59.203803 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d58451bd-7b8d-4bb1-ac6a-14e1ccddfedb None None] MFA Rules not processed for user `6f2efb7dbdb3468fa083b35159324081`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:30:59.207092 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d58451bd-7b8d-4bb1-ac6a-14e1ccddfedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:30:59.226031 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1228/2460] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:30:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:30:59.548300 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135986d7-599b-4cf2-bab1-d8c7bc1ff80a service nova] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:30:59.549735 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-135986d7-599b-4cf2-bab1-d8c7bc1ff80a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:30:59.562099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135986d7-599b-4cf2-bab1-d8c7bc1ff80a service nova] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:30:59.566390 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7443b91-b7d7-4da3-aea3-ab1ffeb5b77f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:30:59.567015 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7443b91-b7d7-4da3-aea3-ab1ffeb5b77f service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:30:59.567294 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7443b91-b7d7-4da3-aea3-ab1ffeb5b77f service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:30:59.567567 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7443b91-b7d7-4da3-aea3-ab1ffeb5b77f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:30:59.569424 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b7443b91-b7d7-4da3-aea3-ab1ffeb5b77f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:30:59.580257 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7443b91-b7d7-4da3-aea3-ab1ffeb5b77f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:30:59.582222 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7443b91-b7d7-4da3-aea3-ab1ffeb5b77f service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:30:59.598530 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1233/2461] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:30:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:31:02.843187 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58451bd-7b8d-4bb1-ac6a-14e1ccddfedb None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:31:02.845556 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d58451bd-7b8d-4bb1-ac6a-14e1ccddfedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:31:02.874950 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58451bd-7b8d-4bb1-ac6a-14e1ccddfedb None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:31:02.880924 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5993a8-2a06-446b-b8e1-df6b06e0b113 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:31:02.881493 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5993a8-2a06-446b-b8e1-df6b06e0b113 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:31:02.882044 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5993a8-2a06-446b-b8e1-df6b06e0b113 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:31:02.882492 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5993a8-2a06-446b-b8e1-df6b06e0b113 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:31:02.884452 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7e5993a8-2a06-446b-b8e1-df6b06e0b113 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:31:02.902858 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5993a8-2a06-446b-b8e1-df6b06e0b113 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:31:02.904747 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5993a8-2a06-446b-b8e1-df6b06e0b113 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:31:02.918237 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1229/2462] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:31:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:31:09.589318 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=93,keystone:INSERT=3 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:31:12.911594 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=36 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:31:25.591559 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7443b91-b7d7-4da3-aea3-ab1ffeb5b77f service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:31:25.603908 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7443b91-b7d7-4da3-aea3-ab1ffeb5b77f service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:31:25.609339 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e0f5f-35c8-49f0-b24d-3ae8ea9f5aeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:31:25.609966 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e0f5f-35c8-49f0-b24d-3ae8ea9f5aeb service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:31:25.610245 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e0f5f-35c8-49f0-b24d-3ae8ea9f5aeb service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:31:25.610514 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e0f5f-35c8-49f0-b24d-3ae8ea9f5aeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:31:25.612269 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a89e0f5f-35c8-49f0-b24d-3ae8ea9f5aeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:31:25.670553 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e0f5f-35c8-49f0-b24d-3ae8ea9f5aeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:31:25.672446 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e0f5f-35c8-49f0-b24d-3ae8ea9f5aeb service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:31:25.681994 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1234/2463] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:31:25 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:31:35.677556 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=28 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:31:37.715260 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9845e-298f-48bd-8a81-9d9960ddca79 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:31:37.715771 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9845e-298f-48bd-8a81-9d9960ddca79 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:31:37.715876 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9845e-298f-48bd-8a81-9d9960ddca79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:31:37.735004 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d5b9845e-298f-48bd-8a81-9d9960ddca79 None None] MFA Rules not processed for user `0b92ad58e5484bc796e1b61fa9f788dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:31:37.736209 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d5b9845e-298f-48bd-8a81-9d9960ddca79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:31:37.742911 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1230/2464] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:31:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:31:47.730198 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:32:39.060041 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e0f5f-35c8-49f0-b24d-3ae8ea9f5aeb service nova] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:39.069347 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e0f5f-35c8-49f0-b24d-3ae8ea9f5aeb service nova] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:39.072844 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923886a1-318a-4eac-88e6-f029f3fbb536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:39.073445 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923886a1-318a-4eac-88e6-f029f3fbb536 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:39.073717 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923886a1-318a-4eac-88e6-f029f3fbb536 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:39.073985 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923886a1-318a-4eac-88e6-f029f3fbb536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:39.075718 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-923886a1-318a-4eac-88e6-f029f3fbb536 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:32:39.087147 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923886a1-318a-4eac-88e6-f029f3fbb536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:39.088721 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923886a1-318a-4eac-88e6-f029f3fbb536 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:39.099849 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1235/2465] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:32:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:32:42.448495 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9845e-298f-48bd-8a81-9d9960ddca79 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:42.449946 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d5b9845e-298f-48bd-8a81-9d9960ddca79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:32:42.464954 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9845e-298f-48bd-8a81-9d9960ddca79 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:42.469406 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d38bf-e064-4061-a43e-9468a7a9887a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:42.470033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d38bf-e064-4061-a43e-9468a7a9887a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:42.470309 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d38bf-e064-4061-a43e-9468a7a9887a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:42.470578 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d38bf-e064-4061-a43e-9468a7a9887a admin admin] PATH_INFO: `/v3/users/c77a01fed0e741288f05941fe5670a6d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:42.471742 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d38bf-e064-4061-a43e-9468a7a9887a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c77a01fed0e741288f05941fe5670a6d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:42.473658 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d38bf-e064-4061-a43e-9468a7a9887a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:42.519099 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c55d38bf-e064-4061-a43e-9468a7a9887a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c77a01fed0e741288f05941fe5670a6d'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:42.519762 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c55d38bf-e064-4061-a43e-9468a7a9887a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c77a01fed0e741288f05941fe5670a6d'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:42.530203 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c55d38bf-e064-4061-a43e-9468a7a9887a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c77a01fed0e741288f05941fe5670a6d'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:42.530990 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c55d38bf-e064-4061-a43e-9468a7a9887a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c77a01fed0e741288f05941fe5670a6d'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:42.545572 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-c55d38bf-e064-4061-a43e-9468a7a9887a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c77a01fed0e741288f05941fe5670a6d'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:42.559342 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1231/2466] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:32:42 2022] DELETE /identity/v3/users/c77a01fed0e741288f05941fe5670a6d => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:32:42.737356 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923886a1-318a-4eac-88e6-f029f3fbb536 service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:42.749020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923886a1-318a-4eac-88e6-f029f3fbb536 service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:42.807369 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4870ee-a095-4fe7-a0e5-de5427da83fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:42.819792 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4870ee-a095-4fe7-a0e5-de5427da83fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:42.819792 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4870ee-a095-4fe7-a0e5-de5427da83fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:42.819792 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4870ee-a095-4fe7-a0e5-de5427da83fe admin admin] PATH_INFO: `/v3/projects/ea08949e8ff04f25825d7873da2a7394` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:42.819792 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4870ee-a095-4fe7-a0e5-de5427da83fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea08949e8ff04f25825d7873da2a7394)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:42.819792 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4870ee-a095-4fe7-a0e5-de5427da83fe admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:42.859758 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ae4870ee-a095-4fe7-a0e5-de5427da83fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea08949e8ff04f25825d7873da2a7394', 'request_id': 'req-ae4870ee-a095-4fe7-a0e5-de5427da83fe'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:42.866010 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ae4870ee-a095-4fe7-a0e5-de5427da83fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea08949e8ff04f25825d7873da2a7394', 'request_id': 'req-ae4870ee-a095-4fe7-a0e5-de5427da83fe'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:42.871531 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ae4870ee-a095-4fe7-a0e5-de5427da83fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea08949e8ff04f25825d7873da2a7394', 'request_id': 'req-ae4870ee-a095-4fe7-a0e5-de5427da83fe'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:42.884887 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ae4870ee-a095-4fe7-a0e5-de5427da83fe admin admin] The token cache is being invalidate because project ea08949e8ff04f25825d7873da2a7394 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:32:42.885194 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ae4870ee-a095-4fe7-a0e5-de5427da83fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:42.885840 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ae4870ee-a095-4fe7-a0e5-de5427da83fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:42.887536 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1236/2467] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:32:42 2022] DELETE /identity/v3/projects/ea08949e8ff04f25825d7873da2a7394 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:32:42.892399 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2631d-09c3-4910-aefd-71f862b53c89 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:42.892705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2631d-09c3-4910-aefd-71f862b53c89 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:42.892975 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2631d-09c3-4910-aefd-71f862b53c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:42.913357 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-3ba2631d-09c3-4910-aefd-71f862b53c89 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:32:42.914626 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3ba2631d-09c3-4910-aefd-71f862b53c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:32:42.974873 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1232/2468] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:32:42.982919 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d6ef3-b8f6-47d1-bbee-42eb0fa4c49a None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:42.983202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d6ef3-b8f6-47d1-bbee-42eb0fa4c49a None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:42.983476 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d6ef3-b8f6-47d1-bbee-42eb0fa4c49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:43.002640 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-082d6ef3-b8f6-47d1-bbee-42eb0fa4c49a None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:32:43.003822 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-082d6ef3-b8f6-47d1-bbee-42eb0fa4c49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:32:43.012155 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1237/2469] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:32:43.016396 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba2631d-09c3-4910-aefd-71f862b53c89 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:43.026990 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba2631d-09c3-4910-aefd-71f862b53c89 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:43.031552 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b6f38-4549-4638-a014-a8679a442221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:43.032195 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b6f38-4549-4638-a014-a8679a442221 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:43.032480 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b6f38-4549-4638-a014-a8679a442221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:43.032756 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b6f38-4549-4638-a014-a8679a442221 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:43.033452 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b6f38-4549-4638-a014-a8679a442221 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:32:43.033758 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b6f38-4549-4638-a014-a8679a442221 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:43.035340 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6b6f38-4549-4638-a014-a8679a442221 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:43.046977 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1233/2470] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:32:43.051216 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d6ef3-b8f6-47d1-bbee-42eb0fa4c49a None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:43.060793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d6ef3-b8f6-47d1-bbee-42eb0fa4c49a None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:43.065366 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8ea66-c066-46e6-a656-db13f7ef9f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:43.065956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8ea66-c066-46e6-a656-db13f7ef9f5c admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:43.066233 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8ea66-c066-46e6-a656-db13f7ef9f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:43.066503 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df8ea66-c066-46e6-a656-db13f7ef9f5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:43.067161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8ea66-c066-46e6-a656-db13f7ef9f5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:43.069081 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df8ea66-c066-46e6-a656-db13f7ef9f5c admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:43.096233 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1238/2471] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:32:43 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:32:43.100358 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b6f38-4549-4638-a014-a8679a442221 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:43.110207 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6b6f38-4549-4638-a014-a8679a442221 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:43.165818 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425d388-3ced-4b75-a7a9-3f0fd76b4cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:43.166676 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425d388-3ced-4b75-a7a9-3f0fd76b4cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:43.166956 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425d388-3ced-4b75-a7a9-3f0fd76b4cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:43.167227 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5425d388-3ced-4b75-a7a9-3f0fd76b4cf2 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:43.167894 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425d388-3ced-4b75-a7a9-3f0fd76b4cf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:43.169915 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5425d388-3ced-4b75-a7a9-3f0fd76b4cf2 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:43.177774 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:32:43.199625 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1234/2472] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:32:43 2022] POST /identity/v3/users => generated 284 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:32:43.203798 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8ea66-c066-46e6-a656-db13f7ef9f5c admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:43.214355 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df8ea66-c066-46e6-a656-db13f7ef9f5c admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:43.219061 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea70c6-3be0-4003-b7b6-b10120d41f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:43.219743 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea70c6-3be0-4003-b7b6-b10120d41f77 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:43.220136 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea70c6-3be0-4003-b7b6-b10120d41f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:43.220500 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ea70c6-3be0-4003-b7b6-b10120d41f77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:43.221262 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea70c6-3be0-4003-b7b6-b10120d41f77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:43.222913 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ea70c6-3be0-4003-b7b6-b10120d41f77 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:43.233455 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1239/2473] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:32:43.237352 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425d388-3ced-4b75-a7a9-3f0fd76b4cf2 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:43.247733 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5425d388-3ced-4b75-a7a9-3f0fd76b4cf2 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:43.252298 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec625d7-366e-409d-9c90-907971dc5689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:43.252897 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec625d7-366e-409d-9c90-907971dc5689 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:43.253174 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec625d7-366e-409d-9c90-907971dc5689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:43.253444 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec625d7-366e-409d-9c90-907971dc5689 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:43.254133 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec625d7-366e-409d-9c90-907971dc5689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:43.255706 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec625d7-366e-409d-9c90-907971dc5689 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:43.267094 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1235/2474] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:32:43.271142 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea70c6-3be0-4003-b7b6-b10120d41f77 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:43.281198 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ea70c6-3be0-4003-b7b6-b10120d41f77 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:43.286608 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf208a8f-1450-4e51-915e-1c86ba93fcfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:43.287281 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf208a8f-1450-4e51-915e-1c86ba93fcfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:43.287567 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf208a8f-1450-4e51-915e-1c86ba93fcfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:43.287847 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf208a8f-1450-4e51-915e-1c86ba93fcfb admin admin] PATH_INFO: `/v3/projects/efc05ba17c044b13bb73f634711e2f23/users/85338b2cc0ce452483dbed3bcda76ceb/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:43.303015 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf208a8f-1450-4e51-915e-1c86ba93fcfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=efc05ba17c044b13bb73f634711e2f23, user_id=85338b2cc0ce452483dbed3bcda76ceb, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:43.306272 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf208a8f-1450-4e51-915e-1c86ba93fcfb admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:43.328992 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1240/2475] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:32:43 2022] PUT /identity/v3/projects/efc05ba17c044b13bb73f634711e2f23/users/85338b2cc0ce452483dbed3bcda76ceb/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:32:43.340063 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99a851-4417-46d7-a2ef-192106aebc41 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:43.340425 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99a851-4417-46d7-a2ef-192106aebc41 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:43.340803 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c99a851-4417-46d7-a2ef-192106aebc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:43.368835 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4c99a851-4417-46d7-a2ef-192106aebc41 None None] MFA Rules not processed for user `85338b2cc0ce452483dbed3bcda76ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:32:43.370047 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4c99a851-4417-46d7-a2ef-192106aebc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:32:43.435805 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1236/2476] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:32:43 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:32:43.446410 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf208a8f-1450-4e51-915e-1c86ba93fcfb admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:43.448103 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-bf208a8f-1450-4e51-915e-1c86ba93fcfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:32:43.461999 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:32:43.505785 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf208a8f-1450-4e51-915e-1c86ba93fcfb admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:43.509266 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bed615-f5a3-48d6-8c81-f1eca83c5bb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:43.509874 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bed615-f5a3-48d6-8c81-f1eca83c5bb3 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:43.510148 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bed615-f5a3-48d6-8c81-f1eca83c5bb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:43.510419 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bed615-f5a3-48d6-8c81-f1eca83c5bb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:43.518872 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bed615-f5a3-48d6-8c81-f1eca83c5bb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:43.520329 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bed615-f5a3-48d6-8c81-f1eca83c5bb3 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:43.528933 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1241/2477] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:32:43 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:32:51.875398 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99a851-4417-46d7-a2ef-192106aebc41 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:51.985462 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c99a851-4417-46d7-a2ef-192106aebc41 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:51.990133 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cc595-3b93-4c00-8bed-23796b3d7729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:51.990764 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cc595-3b93-4c00-8bed-23796b3d7729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:51.991048 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cc595-3b93-4c00-8bed-23796b3d7729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:51.991326 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50cc595-3b93-4c00-8bed-23796b3d7729 admin admin] PATH_INFO: `/v3/users/85338b2cc0ce452483dbed3bcda76ceb` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:51.993150 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50cc595-3b93-4c00-8bed-23796b3d7729 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85338b2cc0ce452483dbed3bcda76ceb)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:51.995059 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50cc595-3b93-4c00-8bed-23796b3d7729 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:52.022567 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:INSERT=3,keystone:SELECT=92,keystone:DELETE=5 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:32:52.043339 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f50cc595-3b93-4c00-8bed-23796b3d7729 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85338b2cc0ce452483dbed3bcda76ceb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:52.044007 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f50cc595-3b93-4c00-8bed-23796b3d7729 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85338b2cc0ce452483dbed3bcda76ceb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:52.050838 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f50cc595-3b93-4c00-8bed-23796b3d7729 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85338b2cc0ce452483dbed3bcda76ceb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:52.051463 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f50cc595-3b93-4c00-8bed-23796b3d7729 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85338b2cc0ce452483dbed3bcda76ceb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:52.063155 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f50cc595-3b93-4c00-8bed-23796b3d7729 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85338b2cc0ce452483dbed3bcda76ceb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:52.075338 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1237/2478] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:32:51 2022] DELETE /identity/v3/users/85338b2cc0ce452483dbed3bcda76ceb => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:32:52.080491 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e73e9-0dfc-4751-80f8-106a1f8d381f None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:52.080967 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e73e9-0dfc-4751-80f8-106a1f8d381f None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:52.081063 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e73e9-0dfc-4751-80f8-106a1f8d381f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:52.129425 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-0b7e73e9-0dfc-4751-80f8-106a1f8d381f None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:32:52.130547 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-0b7e73e9-0dfc-4751-80f8-106a1f8d381f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:32:52.188380 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1242/2479] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:32:52.198116 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cc595-3b93-4c00-8bed-23796b3d7729 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:52.199537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f50cc595-3b93-4c00-8bed-23796b3d7729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:32:52.271634 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50cc595-3b93-4c00-8bed-23796b3d7729 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:52.275711 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7194a36-e86e-478f-9930-935459e4de9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:52.276347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7194a36-e86e-478f-9930-935459e4de9a service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:52.276622 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7194a36-e86e-478f-9930-935459e4de9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:52.276890 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7194a36-e86e-478f-9930-935459e4de9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:52.285688 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7194a36-e86e-478f-9930-935459e4de9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:52.287131 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7194a36-e86e-478f-9930-935459e4de9a service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:52.297228 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1238/2480] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:32:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:32:52.556696 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e73e9-0dfc-4751-80f8-106a1f8d381f None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:52.558149 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-0b7e73e9-0dfc-4751-80f8-106a1f8d381f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:32:52.570318 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e73e9-0dfc-4751-80f8-106a1f8d381f None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:52.575902 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d63233-c48c-4520-9b8b-e79255c5ead5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:52.576613 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d63233-c48c-4520-9b8b-e79255c5ead5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:52.576897 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d63233-c48c-4520-9b8b-e79255c5ead5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:52.577255 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d63233-c48c-4520-9b8b-e79255c5ead5 admin admin] PATH_INFO: `/v3/projects/efc05ba17c044b13bb73f634711e2f23` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:52.579112 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d63233-c48c-4520-9b8b-e79255c5ead5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=efc05ba17c044b13bb73f634711e2f23)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:52.585617 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d63233-c48c-4520-9b8b-e79255c5ead5 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:52.638874 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-67d63233-c48c-4520-9b8b-e79255c5ead5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efc05ba17c044b13bb73f634711e2f23', 'request_id': 'req-67d63233-c48c-4520-9b8b-e79255c5ead5'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:52.645095 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-67d63233-c48c-4520-9b8b-e79255c5ead5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efc05ba17c044b13bb73f634711e2f23', 'request_id': 'req-67d63233-c48c-4520-9b8b-e79255c5ead5'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:52.651647 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-67d63233-c48c-4520-9b8b-e79255c5ead5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efc05ba17c044b13bb73f634711e2f23', 'request_id': 'req-67d63233-c48c-4520-9b8b-e79255c5ead5'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:52.664935 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-67d63233-c48c-4520-9b8b-e79255c5ead5 admin admin] The token cache is being invalidate because project efc05ba17c044b13bb73f634711e2f23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:32:52.665232 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-67d63233-c48c-4520-9b8b-e79255c5ead5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:52.666090 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-67d63233-c48c-4520-9b8b-e79255c5ead5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:52.667613 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1243/2481] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:32:52 2022] DELETE /identity/v3/projects/efc05ba17c044b13bb73f634711e2f23 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:32:52.672468 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7e2f5-a9b6-4f5a-9256-bf055b94d61f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:52.672762 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7e2f5-a9b6-4f5a-9256-bf055b94d61f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:52.673040 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7e2f5-a9b6-4f5a-9256-bf055b94d61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:52.723915 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-67e7e2f5-a9b6-4f5a-9256-bf055b94d61f None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:32:52.725286 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-67e7e2f5-a9b6-4f5a-9256-bf055b94d61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:32:52.783254 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1239/2482] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:32:52.791483 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bf660-7327-4464-b926-f61bda243a79 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:52.791772 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bf660-7327-4464-b926-f61bda243a79 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:52.792091 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610bf660-7327-4464-b926-f61bda243a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:52.812421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-610bf660-7327-4464-b926-f61bda243a79 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:32:52.813624 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-610bf660-7327-4464-b926-f61bda243a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:32:52.822155 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1244/2483] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:32:52.826377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7e2f5-a9b6-4f5a-9256-bf055b94d61f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:52.836014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7e2f5-a9b6-4f5a-9256-bf055b94d61f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:52.840625 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df39ed-fa6e-4e5e-bceb-16bb78bb4cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:52.841222 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df39ed-fa6e-4e5e-bceb-16bb78bb4cab admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:52.841503 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df39ed-fa6e-4e5e-bceb-16bb78bb4cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:52.841776 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df39ed-fa6e-4e5e-bceb-16bb78bb4cab admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:52.842462 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df39ed-fa6e-4e5e-bceb-16bb78bb4cab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:32:52.842765 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df39ed-fa6e-4e5e-bceb-16bb78bb4cab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:52.844382 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df39ed-fa6e-4e5e-bceb-16bb78bb4cab admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:52.846702 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:32:52.857503 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1240/2484] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:32:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:32:52.861682 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bf660-7327-4464-b926-f61bda243a79 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:52.871495 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610bf660-7327-4464-b926-f61bda243a79 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:52.876185 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedcb5cf-6c29-4ab0-a751-67f175cf00e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:52.876785 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcb5cf-6c29-4ab0-a751-67f175cf00e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:52.877065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcb5cf-6c29-4ab0-a751-67f175cf00e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:52.877340 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedcb5cf-6c29-4ab0-a751-67f175cf00e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:52.878043 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedcb5cf-6c29-4ab0-a751-67f175cf00e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:52.879920 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedcb5cf-6c29-4ab0-a751-67f175cf00e7 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:52.885033 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:32:52.908710 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1245/2485] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:32:52 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:32:52.912721 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df39ed-fa6e-4e5e-bceb-16bb78bb4cab admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:52.922879 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df39ed-fa6e-4e5e-bceb-16bb78bb4cab admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:52.979181 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263834e0-63c2-436a-8a65-839701e334dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:52.979790 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263834e0-63c2-436a-8a65-839701e334dd admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:52.980130 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263834e0-63c2-436a-8a65-839701e334dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:52.980407 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263834e0-63c2-436a-8a65-839701e334dd admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:52.981072 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263834e0-63c2-436a-8a65-839701e334dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:52.982971 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263834e0-63c2-436a-8a65-839701e334dd admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:53.003384 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1241/2486] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:32:52 2022] POST /identity/v3/users => generated 303 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:32:53.007408 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedcb5cf-6c29-4ab0-a751-67f175cf00e7 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:53.018179 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedcb5cf-6c29-4ab0-a751-67f175cf00e7 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:53.022780 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54614729-2d1b-44b4-854a-1717e1e54d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:53.023377 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54614729-2d1b-44b4-854a-1717e1e54d0f admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:53.023705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54614729-2d1b-44b4-854a-1717e1e54d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:53.023978 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54614729-2d1b-44b4-854a-1717e1e54d0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:53.024690 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54614729-2d1b-44b4-854a-1717e1e54d0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:53.026294 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54614729-2d1b-44b4-854a-1717e1e54d0f admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:53.035883 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1246/2487] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:32:53.039667 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263834e0-63c2-436a-8a65-839701e334dd admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:53.049712 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263834e0-63c2-436a-8a65-839701e334dd admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:53.054315 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aaba09-00c2-49ee-ac65-434de820c5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:53.054907 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aaba09-00c2-49ee-ac65-434de820c5ee admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:53.055689 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aaba09-00c2-49ee-ac65-434de820c5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:53.055962 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aaba09-00c2-49ee-ac65-434de820c5ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:53.056677 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aaba09-00c2-49ee-ac65-434de820c5ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:53.058243 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aaba09-00c2-49ee-ac65-434de820c5ee admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:53.068567 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1242/2488] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:32:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:32:53.073030 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54614729-2d1b-44b4-854a-1717e1e54d0f admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:53.082947 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54614729-2d1b-44b4-854a-1717e1e54d0f admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:53.087605 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a5cdb-8fef-4683-80d1-56650ccdc69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:53.088290 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a5cdb-8fef-4683-80d1-56650ccdc69a admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:53.088573 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a5cdb-8fef-4683-80d1-56650ccdc69a admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:53.088846 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796a5cdb-8fef-4683-80d1-56650ccdc69a admin admin] PATH_INFO: `/v3/projects/db730d0110f24916bd5c0bd0f35a6e7c/users/5a0799e79cbf40fcbf711359901b2555/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:53.102895 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a5cdb-8fef-4683-80d1-56650ccdc69a admin admin] RBAC: Authorizing `identity:create_grant(project_id=db730d0110f24916bd5c0bd0f35a6e7c, user_id=5a0799e79cbf40fcbf711359901b2555, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:53.105555 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796a5cdb-8fef-4683-80d1-56650ccdc69a admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:53.119571 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1247/2489] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:32:53 2022] PUT /identity/v3/projects/db730d0110f24916bd5c0bd0f35a6e7c/users/5a0799e79cbf40fcbf711359901b2555/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:32:53.124595 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3cc02-6d3c-4724-a535-c65a722110bf None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:53.124883 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3cc02-6d3c-4724-a535-c65a722110bf None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:53.125155 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3cc02-6d3c-4724-a535-c65a722110bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:53.144203 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-49e3cc02-6d3c-4724-a535-c65a722110bf None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:32:53.145378 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-49e3cc02-6d3c-4724-a535-c65a722110bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:32:53.205785 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1243/2490] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:32:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:32:53.216567 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a5cdb-8fef-4683-80d1-56650ccdc69a admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:53.218323 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-796a5cdb-8fef-4683-80d1-56650ccdc69a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:32:53.277727 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796a5cdb-8fef-4683-80d1-56650ccdc69a admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:53.281733 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e264ac-7808-42b0-b86e-4842d5e0b9f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:53.282371 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e264ac-7808-42b0-b86e-4842d5e0b9f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:53.282732 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e264ac-7808-42b0-b86e-4842d5e0b9f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:53.282988 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e264ac-7808-42b0-b86e-4842d5e0b9f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:53.293562 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e264ac-7808-42b0-b86e-4842d5e0b9f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:53.295059 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e264ac-7808-42b0-b86e-4842d5e0b9f4 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:53.306021 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1248/2491] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:32:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:32:53.922764 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b8093-bb64-462d-a923-3dbe12de42b4 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:53.923293 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b8093-bb64-462d-a923-3dbe12de42b4 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:53.923424 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7b8093-bb64-462d-a923-3dbe12de42b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:53.954212 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-ae7b8093-bb64-462d-a923-3dbe12de42b4 None None] MFA Rules not processed for user `5a0799e79cbf40fcbf711359901b2555`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:32:53.955513 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ae7b8093-bb64-462d-a923-3dbe12de42b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:32:54.024713 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1244/2492] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:32:53 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:32:54.028934 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e264ac-7808-42b0-b86e-4842d5e0b9f4 service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:54.038567 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e264ac-7808-42b0-b86e-4842d5e0b9f4 service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:54.043880 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91a5f2-3db7-4a91-adb4-492de4f395c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:54.044501 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91a5f2-3db7-4a91-adb4-492de4f395c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:54.044784 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91a5f2-3db7-4a91-adb4-492de4f395c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:54.045061 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91a5f2-3db7-4a91-adb4-492de4f395c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:54.045722 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91a5f2-3db7-4a91-adb4-492de4f395c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:54.047599 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de91a5f2-3db7-4a91-adb4-492de4f395c6 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:54.075169 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1249/2493] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:32:54 2022] POST /identity/v3/projects => generated 403 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:32:54.079568 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b8093-bb64-462d-a923-3dbe12de42b4 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:54.086248 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:32:54.091732 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7b8093-bb64-462d-a923-3dbe12de42b4 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:54.151110 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1987a-6d64-4da4-b9c6-a19623da740c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:54.151742 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1987a-6d64-4da4-b9c6-a19623da740c admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:54.152050 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1987a-6d64-4da4-b9c6-a19623da740c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:54.152324 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1987a-6d64-4da4-b9c6-a19623da740c admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:54.152997 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe1987a-6d64-4da4-b9c6-a19623da740c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:54.154925 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe1987a-6d64-4da4-b9c6-a19623da740c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:54.178489 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1245/2494] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:32:54 2022] POST /identity/v3/users => generated 308 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:32:54.183267 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91a5f2-3db7-4a91-adb4-492de4f395c6 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:54.194021 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91a5f2-3db7-4a91-adb4-492de4f395c6 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:54.199063 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d666e1-9875-4402-975a-4050843a7bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:54.199757 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d666e1-9875-4402-975a-4050843a7bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:54.200149 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d666e1-9875-4402-975a-4050843a7bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:54.200484 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d666e1-9875-4402-975a-4050843a7bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:54.201255 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d666e1-9875-4402-975a-4050843a7bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:54.202930 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d666e1-9875-4402-975a-4050843a7bd2 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:54.214209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1250/2495] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:32:54.218676 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1987a-6d64-4da4-b9c6-a19623da740c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:54.229674 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1987a-6d64-4da4-b9c6-a19623da740c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:54.234477 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657cb0c4-777b-40e3-b700-b1f1757795b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:54.235254 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cb0c4-777b-40e3-b700-b1f1757795b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:54.235537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cb0c4-777b-40e3-b700-b1f1757795b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:54.235824 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cb0c4-777b-40e3-b700-b1f1757795b8 admin admin] PATH_INFO: `/v3/projects/40cd12b92fa142d4aefa583abeb1c129/users/03b9556fdb3647e880b2ed4c47119e4a/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:54.251141 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657cb0c4-777b-40e3-b700-b1f1757795b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40cd12b92fa142d4aefa583abeb1c129, user_id=03b9556fdb3647e880b2ed4c47119e4a, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:54.253813 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657cb0c4-777b-40e3-b700-b1f1757795b8 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:54.266510 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1246/2496] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:32:54 2022] PUT /identity/v3/projects/40cd12b92fa142d4aefa583abeb1c129/users/03b9556fdb3647e880b2ed4c47119e4a/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:32:54.270610 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d666e1-9875-4402-975a-4050843a7bd2 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:54.281007 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d666e1-9875-4402-975a-4050843a7bd2 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:54.336090 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef5da0-c597-4a0f-bf41-59403955bcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:54.337238 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef5da0-c597-4a0f-bf41-59403955bcb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:54.337526 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef5da0-c597-4a0f-bf41-59403955bcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:54.337801 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef5da0-c597-4a0f-bf41-59403955bcb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:54.338486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef5da0-c597-4a0f-bf41-59403955bcb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:54.340107 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef5da0-c597-4a0f-bf41-59403955bcb1 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:54.349615 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1251/2497] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 15:32:54.354313 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657cb0c4-777b-40e3-b700-b1f1757795b8 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:54.364516 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657cb0c4-777b-40e3-b700-b1f1757795b8 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:54.369391 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f122c0-05da-425d-bd9b-578aabadcd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:54.370050 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f122c0-05da-425d-bd9b-578aabadcd67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:54.370336 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f122c0-05da-425d-bd9b-578aabadcd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:54.370614 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f122c0-05da-425d-bd9b-578aabadcd67 admin admin] PATH_INFO: `/v3/projects/40cd12b92fa142d4aefa583abeb1c129/users/03b9556fdb3647e880b2ed4c47119e4a/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:54.372680 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f122c0-05da-425d-bd9b-578aabadcd67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40cd12b92fa142d4aefa583abeb1c129, user_id=03b9556fdb3647e880b2ed4c47119e4a, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:54.375337 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f122c0-05da-425d-bd9b-578aabadcd67 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:54.385547 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1247/2498] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:32:54 2022] PUT /identity/v3/projects/40cd12b92fa142d4aefa583abeb1c129/users/03b9556fdb3647e880b2ed4c47119e4a/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:32:55.046469 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a939da-a16e-4163-a6a2-ed79e4cf8753 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:55.046765 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a939da-a16e-4163-a6a2-ed79e4cf8753 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:55.047051 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a939da-a16e-4163-a6a2-ed79e4cf8753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:55.079670 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-40a939da-a16e-4163-a6a2-ed79e4cf8753 None None] MFA Rules not processed for user `03b9556fdb3647e880b2ed4c47119e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:32:55.080968 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-40a939da-a16e-4163-a6a2-ed79e4cf8753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:32:55.085139 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:32:55.167685 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1252/2499] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:32:55 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:32:55.647939 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f122c0-05da-425d-bd9b-578aabadcd67 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:55.649825 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f0f122c0-05da-425d-bd9b-578aabadcd67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:32:55.730658 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec03b9a-5b99-4968-80ea-f1e976558808 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:55.731165 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec03b9a-5b99-4968-80ea-f1e976558808 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:55.731343 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec03b9a-5b99-4968-80ea-f1e976558808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:55.763601 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-1ec03b9a-5b99-4968-80ea-f1e976558808 None None] MFA Rules not processed for user `b470b4c2ca1a4d1a8a864789bf603d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:32:55.764845 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-1ec03b9a-5b99-4968-80ea-f1e976558808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:32:55.791715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f122c0-05da-425d-bd9b-578aabadcd67 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:55.797336 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108996d6-8415-4a7b-9fac-70a532ae7fc2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a386d326dc634cbd943ac30f6e8d08bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:55.798030 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108996d6-8415-4a7b-9fac-70a532ae7fc2 service placement] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:55.798387 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108996d6-8415-4a7b-9fac-70a532ae7fc2 service placement] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:55.798729 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108996d6-8415-4a7b-9fac-70a532ae7fc2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:55.800781 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-108996d6-8415-4a7b-9fac-70a532ae7fc2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:32:55.818783 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108996d6-8415-4a7b-9fac-70a532ae7fc2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:55.821459 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108996d6-8415-4a7b-9fac-70a532ae7fc2 service placement] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:55.834963 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1248/2500] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:32:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:32:55.843702 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1253/2501] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Jul 27 15:32:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:32:55.891353 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108996d6-8415-4a7b-9fac-70a532ae7fc2 service placement] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:55.893067 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-108996d6-8415-4a7b-9fac-70a532ae7fc2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:32:55.929243 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:32:55.974435 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108996d6-8415-4a7b-9fac-70a532ae7fc2 service placement] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:55.979555 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a6012-cfcd-49db-b084-d6aeefa2e22f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68bbf8bb59a84829afacd9677c9639a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:55.980309 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a6012-cfcd-49db-b084-d6aeefa2e22f service swift] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:55.980600 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a6012-cfcd-49db-b084-d6aeefa2e22f service swift] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:55.980875 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a6012-cfcd-49db-b084-d6aeefa2e22f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:55.990191 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a6012-cfcd-49db-b084-d6aeefa2e22f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:55.992015 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a6012-cfcd-49db-b084-d6aeefa2e22f service swift] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:56.001853 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1249/2502] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Jul 27 15:32:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 15:32:56.639525 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec03b9a-5b99-4968-80ea-f1e976558808 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:56.733055 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec03b9a-5b99-4968-80ea-f1e976558808 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:56.738446 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074fb8b-8550-4b44-96fd-ff14efa37ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:56.739366 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074fb8b-8550-4b44-96fd-ff14efa37ce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:56.739795 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074fb8b-8550-4b44-96fd-ff14efa37ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:56.740105 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074fb8b-8550-4b44-96fd-ff14efa37ce9 admin admin] PATH_INFO: `/v3/users/5a0799e79cbf40fcbf711359901b2555` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:56.741377 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074fb8b-8550-4b44-96fd-ff14efa37ce9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a0799e79cbf40fcbf711359901b2555)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:56.744066 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b074fb8b-8550-4b44-96fd-ff14efa37ce9 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:56.788659 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:32:56.807158 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b074fb8b-8550-4b44-96fd-ff14efa37ce9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a0799e79cbf40fcbf711359901b2555'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:56.807876 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b074fb8b-8550-4b44-96fd-ff14efa37ce9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a0799e79cbf40fcbf711359901b2555'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:56.821496 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b074fb8b-8550-4b44-96fd-ff14efa37ce9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a0799e79cbf40fcbf711359901b2555'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:56.829160 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b074fb8b-8550-4b44-96fd-ff14efa37ce9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a0799e79cbf40fcbf711359901b2555'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:56.842375 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b074fb8b-8550-4b44-96fd-ff14efa37ce9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a0799e79cbf40fcbf711359901b2555'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:56.850181 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1254/2503] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:32:56 2022] DELETE /identity/v3/users/5a0799e79cbf40fcbf711359901b2555 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:32:57.074509 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a6012-cfcd-49db-b084-d6aeefa2e22f service swift] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:57.094734 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a6012-cfcd-49db-b084-d6aeefa2e22f service swift] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:57.179334 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0befe061-8bca-4499-9a75-82ffff38426e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:57.181257 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befe061-8bca-4499-9a75-82ffff38426e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:57.181613 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befe061-8bca-4499-9a75-82ffff38426e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:57.181884 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0befe061-8bca-4499-9a75-82ffff38426e admin admin] PATH_INFO: `/v3/projects/db730d0110f24916bd5c0bd0f35a6e7c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:57.183067 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0befe061-8bca-4499-9a75-82ffff38426e admin admin] RBAC: Authorizing `identity:delete_project(project_id=db730d0110f24916bd5c0bd0f35a6e7c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:57.185016 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0befe061-8bca-4499-9a75-82ffff38426e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:57.244550 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0befe061-8bca-4499-9a75-82ffff38426e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db730d0110f24916bd5c0bd0f35a6e7c', 'request_id': 'req-0befe061-8bca-4499-9a75-82ffff38426e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:57.251787 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0befe061-8bca-4499-9a75-82ffff38426e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db730d0110f24916bd5c0bd0f35a6e7c', 'request_id': 'req-0befe061-8bca-4499-9a75-82ffff38426e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:57.257744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0befe061-8bca-4499-9a75-82ffff38426e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db730d0110f24916bd5c0bd0f35a6e7c', 'request_id': 'req-0befe061-8bca-4499-9a75-82ffff38426e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:57.272907 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0befe061-8bca-4499-9a75-82ffff38426e admin admin] The token cache is being invalidate because project db730d0110f24916bd5c0bd0f35a6e7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:32:57.273211 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0befe061-8bca-4499-9a75-82ffff38426e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:57.274361 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0befe061-8bca-4499-9a75-82ffff38426e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:57.276034 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1250/2504] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:32:57 2022] DELETE /identity/v3/projects/db730d0110f24916bd5c0bd0f35a6e7c => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:32:57.279936 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074fb8b-8550-4b44-96fd-ff14efa37ce9 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:57.281414 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b074fb8b-8550-4b44-96fd-ff14efa37ce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:32:57.296662 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074fb8b-8550-4b44-96fd-ff14efa37ce9 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:57.361703 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8a996-f899-4db3-856c-18bb7d9f5836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:57.362366 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8a996-f899-4db3-856c-18bb7d9f5836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:57.362769 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8a996-f899-4db3-856c-18bb7d9f5836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:57.363058 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8a996-f899-4db3-856c-18bb7d9f5836 admin admin] PATH_INFO: `/v3/users/03b9556fdb3647e880b2ed4c47119e4a` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:57.364298 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8a996-f899-4db3-856c-18bb7d9f5836 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03b9556fdb3647e880b2ed4c47119e4a)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:57.366311 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8a996-f899-4db3-856c-18bb7d9f5836 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:57.426461 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-67f8a996-f899-4db3-856c-18bb7d9f5836 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03b9556fdb3647e880b2ed4c47119e4a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:57.427406 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-67f8a996-f899-4db3-856c-18bb7d9f5836 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03b9556fdb3647e880b2ed4c47119e4a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:57.440037 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-67f8a996-f899-4db3-856c-18bb7d9f5836 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03b9556fdb3647e880b2ed4c47119e4a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:57.449773 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-67f8a996-f899-4db3-856c-18bb7d9f5836 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03b9556fdb3647e880b2ed4c47119e4a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:57.468183 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-67f8a996-f899-4db3-856c-18bb7d9f5836 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03b9556fdb3647e880b2ed4c47119e4a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:57.477016 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1255/2505] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:32:57 2022] DELETE /identity/v3/users/03b9556fdb3647e880b2ed4c47119e4a => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:32:57.834224 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0befe061-8bca-4499-9a75-82ffff38426e admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:57.835815 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0befe061-8bca-4499-9a75-82ffff38426e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:32:57.871144 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0befe061-8bca-4499-9a75-82ffff38426e admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:57.957672 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:32:57.977285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e495c-a260-49b7-b466-6d6dc7673c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:57.978244 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e495c-a260-49b7-b466-6d6dc7673c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:57.978874 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e495c-a260-49b7-b466-6d6dc7673c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:57.979469 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e495c-a260-49b7-b466-6d6dc7673c57 admin admin] PATH_INFO: `/v3/projects/40cd12b92fa142d4aefa583abeb1c129` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:57.981092 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e495c-a260-49b7-b466-6d6dc7673c57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40cd12b92fa142d4aefa583abeb1c129)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:57.984311 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e495c-a260-49b7-b466-6d6dc7673c57 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:58.081587 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1a7e495c-a260-49b7-b466-6d6dc7673c57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40cd12b92fa142d4aefa583abeb1c129', 'request_id': 'req-1a7e495c-a260-49b7-b466-6d6dc7673c57'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:58.089957 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1a7e495c-a260-49b7-b466-6d6dc7673c57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40cd12b92fa142d4aefa583abeb1c129', 'request_id': 'req-1a7e495c-a260-49b7-b466-6d6dc7673c57'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:58.097621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1a7e495c-a260-49b7-b466-6d6dc7673c57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40cd12b92fa142d4aefa583abeb1c129', 'request_id': 'req-1a7e495c-a260-49b7-b466-6d6dc7673c57'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:58.120311 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1a7e495c-a260-49b7-b466-6d6dc7673c57 admin admin] The token cache is being invalidate because project 40cd12b92fa142d4aefa583abeb1c129 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:32:58.120594 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1a7e495c-a260-49b7-b466-6d6dc7673c57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:58.121245 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-1a7e495c-a260-49b7-b466-6d6dc7673c57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:32:58.122769 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1251/2506] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:32:57 2022] DELETE /identity/v3/projects/40cd12b92fa142d4aefa583abeb1c129 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:32:58.127676 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0fd51-6222-42aa-886b-dbe495a9de03 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:58.137509 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0fd51-6222-42aa-886b-dbe495a9de03 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:58.138051 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a0fd51-6222-42aa-886b-dbe495a9de03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:58.166971 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-74a0fd51-6222-42aa-886b-dbe495a9de03 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:32:58.173905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-74a0fd51-6222-42aa-886b-dbe495a9de03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:32:58.239161 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:32:58.288104 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1256/2507] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:32:58.296048 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56972bb4-e042-4f45-85d7-704ba1284445 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:58.296340 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56972bb4-e042-4f45-85d7-704ba1284445 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:58.296697 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56972bb4-e042-4f45-85d7-704ba1284445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:58.319006 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-56972bb4-e042-4f45-85d7-704ba1284445 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:32:58.320275 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-56972bb4-e042-4f45-85d7-704ba1284445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:32:58.330002 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1252/2508] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:32:58.334220 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0fd51-6222-42aa-886b-dbe495a9de03 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:58.346608 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a0fd51-6222-42aa-886b-dbe495a9de03 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:58.351944 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d43fed-2d89-4938-a5cc-b627df2a35d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:58.352689 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d43fed-2d89-4938-a5cc-b627df2a35d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:58.353146 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d43fed-2d89-4938-a5cc-b627df2a35d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:58.353308 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d43fed-2d89-4938-a5cc-b627df2a35d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:58.354402 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d43fed-2d89-4938-a5cc-b627df2a35d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:32:58.354899 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d43fed-2d89-4938-a5cc-b627df2a35d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:58.357174 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d43fed-2d89-4938-a5cc-b627df2a35d2 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:58.372045 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1257/2509] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:32:58.374856 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56972bb4-e042-4f45-85d7-704ba1284445 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:58.385440 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56972bb4-e042-4f45-85d7-704ba1284445 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:58.390232 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db745b-b69d-4564-ac8d-feb87eefec37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:58.390851 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db745b-b69d-4564-ac8d-feb87eefec37 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:58.391249 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db745b-b69d-4564-ac8d-feb87eefec37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:58.391530 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db745b-b69d-4564-ac8d-feb87eefec37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:58.392245 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db745b-b69d-4564-ac8d-feb87eefec37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:58.394273 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db745b-b69d-4564-ac8d-feb87eefec37 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:58.452636 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1253/2510] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:32:58 2022] POST /identity/v3/projects => generated 379 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:32:58.457910 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d43fed-2d89-4938-a5cc-b627df2a35d2 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:58.475666 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d43fed-2d89-4938-a5cc-b627df2a35d2 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:58.559617 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbebc4-eaa2-4a24-b1df-fabc68baa9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:58.560393 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbebc4-eaa2-4a24-b1df-fabc68baa9e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:58.560598 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbebc4-eaa2-4a24-b1df-fabc68baa9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:58.560837 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fbebc4-eaa2-4a24-b1df-fabc68baa9e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:58.561590 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fbebc4-eaa2-4a24-b1df-fabc68baa9e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:58.563513 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fbebc4-eaa2-4a24-b1df-fabc68baa9e2 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:58.585422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1258/2511] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:32:58 2022] POST /identity/v3/users => generated 290 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:32:58.589519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db745b-b69d-4564-ac8d-feb87eefec37 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:58.600292 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db745b-b69d-4564-ac8d-feb87eefec37 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:58.606876 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45cd81-7025-4e24-a615-fd74a5726e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:58.608726 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45cd81-7025-4e24-a615-fd74a5726e2a admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:58.608842 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45cd81-7025-4e24-a615-fd74a5726e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:58.609696 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd45cd81-7025-4e24-a615-fd74a5726e2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:58.610401 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45cd81-7025-4e24-a615-fd74a5726e2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:58.612041 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd45cd81-7025-4e24-a615-fd74a5726e2a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:58.623943 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1254/2512] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:32:58.628070 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbebc4-eaa2-4a24-b1df-fabc68baa9e2 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:58.639463 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fbebc4-eaa2-4a24-b1df-fabc68baa9e2 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:58.644972 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39ef4e1-147f-4a02-8e69-3d1b9fa432d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:58.645694 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ef4e1-147f-4a02-8e69-3d1b9fa432d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:58.646271 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ef4e1-147f-4a02-8e69-3d1b9fa432d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:58.646271 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39ef4e1-147f-4a02-8e69-3d1b9fa432d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:58.646986 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ef4e1-147f-4a02-8e69-3d1b9fa432d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:58.648753 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39ef4e1-147f-4a02-8e69-3d1b9fa432d3 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:58.659655 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1259/2513] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:32:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:32:58.667618 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45cd81-7025-4e24-a615-fd74a5726e2a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:58.685294 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd45cd81-7025-4e24-a615-fd74a5726e2a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:58.693619 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d7cf7-ac7d-4157-8c0d-810d6d154c84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:58.694829 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d7cf7-ac7d-4157-8c0d-810d6d154c84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:58.695365 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d7cf7-ac7d-4157-8c0d-810d6d154c84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:58.695881 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d7cf7-ac7d-4157-8c0d-810d6d154c84 admin admin] PATH_INFO: `/v3/projects/cb4ac2c232824574a89f6547a600c4eb/users/622f80c2f8114876ab47c6074842cf32/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:58.720868 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d7cf7-ac7d-4157-8c0d-810d6d154c84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb4ac2c232824574a89f6547a600c4eb, user_id=622f80c2f8114876ab47c6074842cf32, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:58.723730 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d7cf7-ac7d-4157-8c0d-810d6d154c84 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:58.743018 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1255/2514] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:32:58 2022] PUT /identity/v3/projects/cb4ac2c232824574a89f6547a600c4eb/users/622f80c2f8114876ab47c6074842cf32/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:32:58.754318 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad190a1f-4fb7-4f71-b833-21a994c12278 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:58.754673 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad190a1f-4fb7-4f71-b833-21a994c12278 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:58.755185 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad190a1f-4fb7-4f71-b833-21a994c12278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:58.792030 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-ad190a1f-4fb7-4f71-b833-21a994c12278 None None] MFA Rules not processed for user `622f80c2f8114876ab47c6074842cf32`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:32:58.793907 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ad190a1f-4fb7-4f71-b833-21a994c12278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:32:58.920224 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1260/2515] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:32:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:32:58.924747 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d7cf7-ac7d-4157-8c0d-810d6d154c84 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:59.009841 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d7cf7-ac7d-4157-8c0d-810d6d154c84 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:59.017780 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dccc99-a9be-44ab-b138-5cc77d431ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:59.018508 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dccc99-a9be-44ab-b138-5cc77d431ab1 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:59.018861 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dccc99-a9be-44ab-b138-5cc77d431ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:59.019206 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dccc99-a9be-44ab-b138-5cc77d431ab1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:59.019946 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dccc99-a9be-44ab-b138-5cc77d431ab1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:59.021995 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dccc99-a9be-44ab-b138-5cc77d431ab1 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:59.045441 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:32:59.061665 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1256/2516] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:32:58 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:32:59.063203 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad190a1f-4fb7-4f71-b833-21a994c12278 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:59.077368 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad190a1f-4fb7-4f71-b833-21a994c12278 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:59.100815 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:32:59.157168 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958295a-36b7-4102-ad10-1b672c0e8df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:59.158021 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958295a-36b7-4102-ad10-1b672c0e8df0 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:59.158021 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958295a-36b7-4102-ad10-1b672c0e8df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:59.158215 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f958295a-36b7-4102-ad10-1b672c0e8df0 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:59.158861 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f958295a-36b7-4102-ad10-1b672c0e8df0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:59.160826 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f958295a-36b7-4102-ad10-1b672c0e8df0 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:59.184144 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1261/2517] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:32:59 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:32:59.187977 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dccc99-a9be-44ab-b138-5cc77d431ab1 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:59.200339 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dccc99-a9be-44ab-b138-5cc77d431ab1 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:59.205855 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7247e7-7370-40b7-afdf-b0cef7af67f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:59.206489 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7247e7-7370-40b7-afdf-b0cef7af67f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:59.206763 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7247e7-7370-40b7-afdf-b0cef7af67f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:59.207040 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7247e7-7370-40b7-afdf-b0cef7af67f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:59.207736 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7247e7-7370-40b7-afdf-b0cef7af67f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:59.209652 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7247e7-7370-40b7-afdf-b0cef7af67f9 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:59.225502 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1257/2518] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:32:59.229813 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958295a-36b7-4102-ad10-1b672c0e8df0 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:59.244905 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f958295a-36b7-4102-ad10-1b672c0e8df0 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:59.251815 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb08742f-fd8a-42b0-b1cf-9f6ba3b4629c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:59.253199 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08742f-fd8a-42b0-b1cf-9f6ba3b4629c admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:59.253643 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08742f-fd8a-42b0-b1cf-9f6ba3b4629c admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:59.254596 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb08742f-fd8a-42b0-b1cf-9f6ba3b4629c admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:59.255744 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb08742f-fd8a-42b0-b1cf-9f6ba3b4629c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:59.257904 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb08742f-fd8a-42b0-b1cf-9f6ba3b4629c admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:59.274208 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1262/2519] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:32:59.275337 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7247e7-7370-40b7-afdf-b0cef7af67f9 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:59.290470 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7247e7-7370-40b7-afdf-b0cef7af67f9 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:59.297405 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3212d-bd5f-4442-bf79-e90f66476bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:59.297405 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3212d-bd5f-4442-bf79-e90f66476bfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:59.297405 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3212d-bd5f-4442-bf79-e90f66476bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:59.297405 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae3212d-bd5f-4442-bf79-e90f66476bfb admin admin] PATH_INFO: `/v3/projects/ad2f01eea224453ea15f9f784f4e1d61/users/27dbc37fb90c4efa970eeaf43589d47e/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:59.316043 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3212d-bd5f-4442-bf79-e90f66476bfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad2f01eea224453ea15f9f784f4e1d61, user_id=27dbc37fb90c4efa970eeaf43589d47e, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:59.319625 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae3212d-bd5f-4442-bf79-e90f66476bfb admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:59.335493 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1258/2520] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:32:59 2022] PUT /identity/v3/projects/ad2f01eea224453ea15f9f784f4e1d61/users/27dbc37fb90c4efa970eeaf43589d47e/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:32:59.347081 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0679b4-5f92-4cfd-bed8-836e22a1e771 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:59.347426 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0679b4-5f92-4cfd-bed8-836e22a1e771 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:59.347722 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0679b4-5f92-4cfd-bed8-836e22a1e771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:59.385098 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-ea0679b4-5f92-4cfd-bed8-836e22a1e771 None None] MFA Rules not processed for user `27dbc37fb90c4efa970eeaf43589d47e`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:32:59.386391 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ea0679b4-5f92-4cfd-bed8-836e22a1e771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:32:59.461285 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1263/2521] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:32:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:32:59.465652 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3212d-bd5f-4442-bf79-e90f66476bfb admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:59.541078 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae3212d-bd5f-4442-bf79-e90f66476bfb admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:59.546435 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548f7d8-7b8a-482f-94b9-f97a25e2f7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:59.547270 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548f7d8-7b8a-482f-94b9-f97a25e2f7ea admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:59.547557 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548f7d8-7b8a-482f-94b9-f97a25e2f7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:59.547837 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a548f7d8-7b8a-482f-94b9-f97a25e2f7ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:59.548557 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a548f7d8-7b8a-482f-94b9-f97a25e2f7ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:59.550480 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a548f7d8-7b8a-482f-94b9-f97a25e2f7ea admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:59.586803 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1259/2522] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:32:59 2022] POST /identity/v3/projects => generated 375 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:32:59.593939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0679b4-5f92-4cfd-bed8-836e22a1e771 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:59.609307 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0679b4-5f92-4cfd-bed8-836e22a1e771 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:59.677587 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4167c68-8644-41be-86ac-6a5fd47e5cd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:59.678335 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4167c68-8644-41be-86ac-6a5fd47e5cd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:59.678623 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4167c68-8644-41be-86ac-6a5fd47e5cd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:59.678937 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4167c68-8644-41be-86ac-6a5fd47e5cd3 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:59.679622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4167c68-8644-41be-86ac-6a5fd47e5cd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:59.681838 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4167c68-8644-41be-86ac-6a5fd47e5cd3 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:59.704362 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1264/2523] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:32:59 2022] POST /identity/v3/users => generated 294 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:32:59.708592 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548f7d8-7b8a-482f-94b9-f97a25e2f7ea admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:59.719975 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a548f7d8-7b8a-482f-94b9-f97a25e2f7ea admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:59.724642 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0fa98-6e32-4711-9653-b9c77371c1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:59.725264 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0fa98-6e32-4711-9653-b9c77371c1df admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:59.725546 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0fa98-6e32-4711-9653-b9c77371c1df admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:59.725823 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d0fa98-6e32-4711-9653-b9c77371c1df admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:59.727198 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0fa98-6e32-4711-9653-b9c77371c1df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:59.728856 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d0fa98-6e32-4711-9653-b9c77371c1df admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:59.740890 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1260/2524] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:32:59.745193 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4167c68-8644-41be-86ac-6a5fd47e5cd3 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:59.755722 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4167c68-8644-41be-86ac-6a5fd47e5cd3 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:59.760478 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb325277-3824-4af7-8a7b-e03be41d92b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:59.761215 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb325277-3824-4af7-8a7b-e03be41d92b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:59.761496 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb325277-3824-4af7-8a7b-e03be41d92b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:59.761768 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb325277-3824-4af7-8a7b-e03be41d92b2 admin admin] PATH_INFO: `/v3/projects/d8fd8d3bfdb74c4db4639cc62f7fef46/users/63d267e5d3a24ae6911e52e4aae80b7a/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:59.778245 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb325277-3824-4af7-8a7b-e03be41d92b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8fd8d3bfdb74c4db4639cc62f7fef46, user_id=63d267e5d3a24ae6911e52e4aae80b7a, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:59.780879 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb325277-3824-4af7-8a7b-e03be41d92b2 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:59.791441 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:32:59.798196 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1265/2525] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:32:59 2022] PUT /identity/v3/projects/d8fd8d3bfdb74c4db4639cc62f7fef46/users/63d267e5d3a24ae6911e52e4aae80b7a/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:32:59.805438 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0fa98-6e32-4711-9653-b9c77371c1df admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:59.816816 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d0fa98-6e32-4711-9653-b9c77371c1df admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:59.875707 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395224c0-3059-4a85-8846-ec3083827639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:59.876360 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395224c0-3059-4a85-8846-ec3083827639 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:59.876637 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395224c0-3059-4a85-8846-ec3083827639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:59.876908 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395224c0-3059-4a85-8846-ec3083827639 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:59.877601 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395224c0-3059-4a85-8846-ec3083827639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:59.879394 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395224c0-3059-4a85-8846-ec3083827639 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:59.892358 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1261/2526] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:32:59.896302 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb325277-3824-4af7-8a7b-e03be41d92b2 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:32:59.907308 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb325277-3824-4af7-8a7b-e03be41d92b2 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:32:59.912567 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a75c40-46ca-4583-841b-df04aafd2765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:32:59.913374 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a75c40-46ca-4583-841b-df04aafd2765 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:59.913772 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a75c40-46ca-4583-841b-df04aafd2765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:59.914715 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a75c40-46ca-4583-841b-df04aafd2765 admin admin] PATH_INFO: `/v3/projects/d8fd8d3bfdb74c4db4639cc62f7fef46/users/63d267e5d3a24ae6911e52e4aae80b7a/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:59.917392 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a75c40-46ca-4583-841b-df04aafd2765 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8fd8d3bfdb74c4db4639cc62f7fef46, user_id=63d267e5d3a24ae6911e52e4aae80b7a, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:32:59.923386 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a75c40-46ca-4583-841b-df04aafd2765 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:32:59.932339 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1266/2527] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:32:59 2022] PUT /identity/v3/projects/d8fd8d3bfdb74c4db4639cc62f7fef46/users/63d267e5d3a24ae6911e52e4aae80b7a/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:32:59.942960 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e12db-e359-4a30-bd66-f696967607bc None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:32:59.944159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e12db-e359-4a30-bd66-f696967607bc None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:32:59.944624 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e12db-e359-4a30-bd66-f696967607bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:32:59.982897 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4b2e12db-e359-4a30-bd66-f696967607bc None None] MFA Rules not processed for user `63d267e5d3a24ae6911e52e4aae80b7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:32:59.985092 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4b2e12db-e359-4a30-bd66-f696967607bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:00.013394 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:00.080145 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1262/2528] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:32:59 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:00.091708 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a75c40-46ca-4583-841b-df04aafd2765 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:00.093766 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-76a75c40-46ca-4583-841b-df04aafd2765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:00.165158 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a75c40-46ca-4583-841b-df04aafd2765 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:00.169180 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66179262-7cf0-46f1-a450-592907e22eff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:00.169809 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66179262-7cf0-46f1-a450-592907e22eff service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:00.170202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66179262-7cf0-46f1-a450-592907e22eff service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:00.170380 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66179262-7cf0-46f1-a450-592907e22eff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:00.185197 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66179262-7cf0-46f1-a450-592907e22eff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:00.186807 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66179262-7cf0-46f1-a450-592907e22eff service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:00.212401 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1267/2529] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:33:00 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:33:00.258979 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e12db-e359-4a30-bd66-f696967607bc None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:00.260920 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4b2e12db-e359-4a30-bd66-f696967607bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:00.274538 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e12db-e359-4a30-bd66-f696967607bc None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:00.278259 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439a2ec8-e4df-4ed4-9b24-b2ad98d7879a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:00.278890 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a2ec8-e4df-4ed4-9b24-b2ad98d7879a service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:00.279160 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a2ec8-e4df-4ed4-9b24-b2ad98d7879a service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:00.279435 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439a2ec8-e4df-4ed4-9b24-b2ad98d7879a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:00.343389 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a2ec8-e4df-4ed4-9b24-b2ad98d7879a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:00.344856 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439a2ec8-e4df-4ed4-9b24-b2ad98d7879a service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:00.354440 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1263/2530] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:33:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:33:03.422492 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66179262-7cf0-46f1-a450-592907e22eff service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:03.504264 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66179262-7cf0-46f1-a450-592907e22eff service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:03.512743 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14ebc5-ca92-49ac-b24b-6c9a94a808a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:03.513674 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14ebc5-ca92-49ac-b24b-6c9a94a808a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:03.514155 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14ebc5-ca92-49ac-b24b-6c9a94a808a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:03.514625 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14ebc5-ca92-49ac-b24b-6c9a94a808a9 admin admin] PATH_INFO: `/v3/users/622f80c2f8114876ab47c6074842cf32` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:03.515927 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14ebc5-ca92-49ac-b24b-6c9a94a808a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=622f80c2f8114876ab47c6074842cf32)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:03.518601 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14ebc5-ca92-49ac-b24b-6c9a94a808a9 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:03.605447 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ff14ebc5-ca92-49ac-b24b-6c9a94a808a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '622f80c2f8114876ab47c6074842cf32'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:03.606122 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ff14ebc5-ca92-49ac-b24b-6c9a94a808a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '622f80c2f8114876ab47c6074842cf32'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:03.615453 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ff14ebc5-ca92-49ac-b24b-6c9a94a808a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '622f80c2f8114876ab47c6074842cf32'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:03.623462 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ff14ebc5-ca92-49ac-b24b-6c9a94a808a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '622f80c2f8114876ab47c6074842cf32'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:03.640303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ff14ebc5-ca92-49ac-b24b-6c9a94a808a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '622f80c2f8114876ab47c6074842cf32'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:03.646807 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1268/2531] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:33:03 2022] DELETE /identity/v3/users/622f80c2f8114876ab47c6074842cf32 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:03.652326 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b61fe-5a2d-4058-b00a-7f85d37590f7 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:03.652846 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b61fe-5a2d-4058-b00a-7f85d37590f7 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:03.653031 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b61fe-5a2d-4058-b00a-7f85d37590f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:03.680457 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-1b3b61fe-5a2d-4058-b00a-7f85d37590f7 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:03.682659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1b3b61fe-5a2d-4058-b00a-7f85d37590f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:03.765978 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1264/2532] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:03.772859 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14ebc5-ca92-49ac-b24b-6c9a94a808a9 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:03.775046 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ff14ebc5-ca92-49ac-b24b-6c9a94a808a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:03.798223 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:03.862629 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14ebc5-ca92-49ac-b24b-6c9a94a808a9 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:03.870553 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac3cab-8c07-4708-9bde-1a3bbb6eb8fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:03.871787 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac3cab-8c07-4708-9bde-1a3bbb6eb8fa service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:03.872370 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac3cab-8c07-4708-9bde-1a3bbb6eb8fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:03.872731 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bac3cab-8c07-4708-9bde-1a3bbb6eb8fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:03.885999 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac3cab-8c07-4708-9bde-1a3bbb6eb8fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:03.887563 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bac3cab-8c07-4708-9bde-1a3bbb6eb8fa service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:03.910436 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1269/2533] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:33:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 15:33:04.261816 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b61fe-5a2d-4058-b00a-7f85d37590f7 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:04.263379 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1b3b61fe-5a2d-4058-b00a-7f85d37590f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:04.290629 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b61fe-5a2d-4058-b00a-7f85d37590f7 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:04.297849 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0b71f-8f88-4f1f-b6b2-d58f0e0f2e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:04.298598 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0b71f-8f88-4f1f-b6b2-d58f0e0f2e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:04.298898 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0b71f-8f88-4f1f-b6b2-d58f0e0f2e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:04.299458 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0b71f-8f88-4f1f-b6b2-d58f0e0f2e9f admin admin] PATH_INFO: `/v3/projects/cb4ac2c232824574a89f6547a600c4eb` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:04.300391 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad0b71f-8f88-4f1f-b6b2-d58f0e0f2e9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb4ac2c232824574a89f6547a600c4eb)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:04.302814 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad0b71f-8f88-4f1f-b6b2-d58f0e0f2e9f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:04.361070 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2ad0b71f-8f88-4f1f-b6b2-d58f0e0f2e9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb4ac2c232824574a89f6547a600c4eb', 'request_id': 'req-2ad0b71f-8f88-4f1f-b6b2-d58f0e0f2e9f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:04.363288 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:04.371593 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2ad0b71f-8f88-4f1f-b6b2-d58f0e0f2e9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb4ac2c232824574a89f6547a600c4eb', 'request_id': 'req-2ad0b71f-8f88-4f1f-b6b2-d58f0e0f2e9f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:04.377970 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2ad0b71f-8f88-4f1f-b6b2-d58f0e0f2e9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb4ac2c232824574a89f6547a600c4eb', 'request_id': 'req-2ad0b71f-8f88-4f1f-b6b2-d58f0e0f2e9f'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:04.394994 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2ad0b71f-8f88-4f1f-b6b2-d58f0e0f2e9f admin admin] The token cache is being invalidate because project cb4ac2c232824574a89f6547a600c4eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:33:04.395415 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2ad0b71f-8f88-4f1f-b6b2-d58f0e0f2e9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:04.396137 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2ad0b71f-8f88-4f1f-b6b2-d58f0e0f2e9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:04.397935 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1265/2534] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:33:04 2022] DELETE /identity/v3/projects/cb4ac2c232824574a89f6547a600c4eb => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:04.401891 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac3cab-8c07-4708-9bde-1a3bbb6eb8fa service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:04.416549 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bac3cab-8c07-4708-9bde-1a3bbb6eb8fa service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:04.480025 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3316aab-2938-442a-a83e-06968cbcd3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:04.483216 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3316aab-2938-442a-a83e-06968cbcd3bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:04.483413 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3316aab-2938-442a-a83e-06968cbcd3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:04.483737 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3316aab-2938-442a-a83e-06968cbcd3bb admin admin] PATH_INFO: `/v3/users/27dbc37fb90c4efa970eeaf43589d47e` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:04.484961 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3316aab-2938-442a-a83e-06968cbcd3bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=27dbc37fb90c4efa970eeaf43589d47e)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:04.486972 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3316aab-2938-442a-a83e-06968cbcd3bb admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:04.544725 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f3316aab-2938-442a-a83e-06968cbcd3bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27dbc37fb90c4efa970eeaf43589d47e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:04.545541 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f3316aab-2938-442a-a83e-06968cbcd3bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27dbc37fb90c4efa970eeaf43589d47e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:04.555847 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f3316aab-2938-442a-a83e-06968cbcd3bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27dbc37fb90c4efa970eeaf43589d47e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:04.565937 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f3316aab-2938-442a-a83e-06968cbcd3bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27dbc37fb90c4efa970eeaf43589d47e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:04.583782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f3316aab-2938-442a-a83e-06968cbcd3bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27dbc37fb90c4efa970eeaf43589d47e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:04.602404 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1270/2535] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:33:04 2022] DELETE /identity/v3/users/27dbc37fb90c4efa970eeaf43589d47e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:04.925290 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0b71f-8f88-4f1f-b6b2-d58f0e0f2e9f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:04.926760 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2ad0b71f-8f88-4f1f-b6b2-d58f0e0f2e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:04.945064 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0b71f-8f88-4f1f-b6b2-d58f0e0f2e9f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:05.021540 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a556f33-7a19-45d0-b9b8-bcd051efbb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:05.022377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a556f33-7a19-45d0-b9b8-bcd051efbb13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:05.022662 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a556f33-7a19-45d0-b9b8-bcd051efbb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:05.022949 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a556f33-7a19-45d0-b9b8-bcd051efbb13 admin admin] PATH_INFO: `/v3/projects/ad2f01eea224453ea15f9f784f4e1d61` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:05.025166 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a556f33-7a19-45d0-b9b8-bcd051efbb13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad2f01eea224453ea15f9f784f4e1d61)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:05.027179 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a556f33-7a19-45d0-b9b8-bcd051efbb13 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:05.090085 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2a556f33-7a19-45d0-b9b8-bcd051efbb13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad2f01eea224453ea15f9f784f4e1d61', 'request_id': 'req-2a556f33-7a19-45d0-b9b8-bcd051efbb13'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:05.097851 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2a556f33-7a19-45d0-b9b8-bcd051efbb13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad2f01eea224453ea15f9f784f4e1d61', 'request_id': 'req-2a556f33-7a19-45d0-b9b8-bcd051efbb13'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:05.106176 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2a556f33-7a19-45d0-b9b8-bcd051efbb13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad2f01eea224453ea15f9f784f4e1d61', 'request_id': 'req-2a556f33-7a19-45d0-b9b8-bcd051efbb13'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:05.128026 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2a556f33-7a19-45d0-b9b8-bcd051efbb13 admin admin] The token cache is being invalidate because project ad2f01eea224453ea15f9f784f4e1d61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:33:05.128026 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2a556f33-7a19-45d0-b9b8-bcd051efbb13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:05.128026 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-2a556f33-7a19-45d0-b9b8-bcd051efbb13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:05.132037 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1266/2536] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:33:04 2022] DELETE /identity/v3/projects/ad2f01eea224453ea15f9f784f4e1d61 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:05.134256 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3316aab-2938-442a-a83e-06968cbcd3bb admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:05.135947 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f3316aab-2938-442a-a83e-06968cbcd3bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:05.154193 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3316aab-2938-442a-a83e-06968cbcd3bb admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:05.201994 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:05.236869 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0870d4-330c-4d18-ad26-c82f7277f651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:05.237413 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0870d4-330c-4d18-ad26-c82f7277f651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:05.237774 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0870d4-330c-4d18-ad26-c82f7277f651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:05.238054 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0870d4-330c-4d18-ad26-c82f7277f651 admin admin] PATH_INFO: `/v3/users/63d267e5d3a24ae6911e52e4aae80b7a` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:05.239217 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0870d4-330c-4d18-ad26-c82f7277f651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63d267e5d3a24ae6911e52e4aae80b7a)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:05.241972 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0870d4-330c-4d18-ad26-c82f7277f651 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:05.296984 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6c0870d4-330c-4d18-ad26-c82f7277f651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63d267e5d3a24ae6911e52e4aae80b7a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:05.297845 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6c0870d4-330c-4d18-ad26-c82f7277f651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63d267e5d3a24ae6911e52e4aae80b7a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:05.308271 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6c0870d4-330c-4d18-ad26-c82f7277f651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63d267e5d3a24ae6911e52e4aae80b7a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:05.316582 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6c0870d4-330c-4d18-ad26-c82f7277f651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63d267e5d3a24ae6911e52e4aae80b7a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:05.331535 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6c0870d4-330c-4d18-ad26-c82f7277f651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63d267e5d3a24ae6911e52e4aae80b7a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:05.342214 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1271/2537] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:33:05 2022] DELETE /identity/v3/users/63d267e5d3a24ae6911e52e4aae80b7a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:05.663192 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a556f33-7a19-45d0-b9b8-bcd051efbb13 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:05.664959 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2a556f33-7a19-45d0-b9b8-bcd051efbb13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:05.701711 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a556f33-7a19-45d0-b9b8-bcd051efbb13 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:05.768319 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a0227-43dc-4a43-b482-f3c0f86e22ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:05.768874 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a0227-43dc-4a43-b482-f3c0f86e22ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:05.769156 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a0227-43dc-4a43-b482-f3c0f86e22ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:05.769430 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a0227-43dc-4a43-b482-f3c0f86e22ac admin admin] PATH_INFO: `/v3/projects/d8fd8d3bfdb74c4db4639cc62f7fef46` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:05.770714 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a0227-43dc-4a43-b482-f3c0f86e22ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8fd8d3bfdb74c4db4639cc62f7fef46)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:05.772771 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a0227-43dc-4a43-b482-f3c0f86e22ac admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:05.785224 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:05.827311 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-234a0227-43dc-4a43-b482-f3c0f86e22ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8fd8d3bfdb74c4db4639cc62f7fef46', 'request_id': 'req-234a0227-43dc-4a43-b482-f3c0f86e22ac'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:05.833643 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-234a0227-43dc-4a43-b482-f3c0f86e22ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8fd8d3bfdb74c4db4639cc62f7fef46', 'request_id': 'req-234a0227-43dc-4a43-b482-f3c0f86e22ac'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:05.839448 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-234a0227-43dc-4a43-b482-f3c0f86e22ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8fd8d3bfdb74c4db4639cc62f7fef46', 'request_id': 'req-234a0227-43dc-4a43-b482-f3c0f86e22ac'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:05.854517 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-234a0227-43dc-4a43-b482-f3c0f86e22ac admin admin] The token cache is being invalidate because project d8fd8d3bfdb74c4db4639cc62f7fef46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:33:05.854822 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-234a0227-43dc-4a43-b482-f3c0f86e22ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:05.855598 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-234a0227-43dc-4a43-b482-f3c0f86e22ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:05.857608 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1267/2538] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:33:05 2022] DELETE /identity/v3/projects/d8fd8d3bfdb74c4db4639cc62f7fef46 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:05.863579 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4a25a-62a9-43b2-a2dd-bcf787b37bae None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:05.864152 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4a25a-62a9-43b2-a2dd-bcf787b37bae None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:05.864152 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c4a25a-62a9-43b2-a2dd-bcf787b37bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:05.885582 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-07c4a25a-62a9-43b2-a2dd-bcf787b37bae None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:05.887301 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-07c4a25a-62a9-43b2-a2dd-bcf787b37bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:05.953154 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1272/2539] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:33:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:05.962601 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e70674-71f8-4f65-a3a0-30af18fba39d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:05.963097 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e70674-71f8-4f65-a3a0-30af18fba39d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:05.963207 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e70674-71f8-4f65-a3a0-30af18fba39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:05.983600 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-e3e70674-71f8-4f65-a3a0-30af18fba39d None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:05.984863 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e3e70674-71f8-4f65-a3a0-30af18fba39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:05.993466 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1268/2540] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:33:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:05.997941 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4a25a-62a9-43b2-a2dd-bcf787b37bae None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:06.008277 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c4a25a-62a9-43b2-a2dd-bcf787b37bae None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:06.013070 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec3ee2-b372-4354-bf40-e4c16c7f5a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:06.013680 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec3ee2-b372-4354-bf40-e4c16c7f5a66 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:06.013960 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec3ee2-b372-4354-bf40-e4c16c7f5a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:06.014238 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aec3ee2-b372-4354-bf40-e4c16c7f5a66 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:06.014959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec3ee2-b372-4354-bf40-e4c16c7f5a66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:33:06.015408 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec3ee2-b372-4354-bf40-e4c16c7f5a66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:06.017029 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aec3ee2-b372-4354-bf40-e4c16c7f5a66 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:06.029141 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1273/2541] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:33:06.033774 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e70674-71f8-4f65-a3a0-30af18fba39d None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:06.045194 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e70674-71f8-4f65-a3a0-30af18fba39d None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:06.049961 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82585797-4a1a-4313-ae5c-12186240b9c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:06.050570 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82585797-4a1a-4313-ae5c-12186240b9c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:06.050851 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82585797-4a1a-4313-ae5c-12186240b9c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:06.051122 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82585797-4a1a-4313-ae5c-12186240b9c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:06.051793 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82585797-4a1a-4313-ae5c-12186240b9c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:06.053696 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82585797-4a1a-4313-ae5c-12186240b9c7 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:06.080861 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1269/2542] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:33:06 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:33:06.085146 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec3ee2-b372-4354-bf40-e4c16c7f5a66 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:06.095101 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aec3ee2-b372-4354-bf40-e4c16c7f5a66 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:06.127323 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:06.154014 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408d14a-d35f-4968-8b33-43f9583a0992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:06.154622 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408d14a-d35f-4968-8b33-43f9583a0992 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:06.154902 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408d14a-d35f-4968-8b33-43f9583a0992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:06.155178 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4408d14a-d35f-4968-8b33-43f9583a0992 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:06.155867 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4408d14a-d35f-4968-8b33-43f9583a0992 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:06.157814 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4408d14a-d35f-4968-8b33-43f9583a0992 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:06.178309 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1274/2543] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:33:06 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:33:06.183038 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82585797-4a1a-4313-ae5c-12186240b9c7 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:06.193156 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82585797-4a1a-4313-ae5c-12186240b9c7 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:06.197687 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92bc989-c951-4671-9eba-a75cda2cdaf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:06.198284 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bc989-c951-4671-9eba-a75cda2cdaf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:06.198563 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bc989-c951-4671-9eba-a75cda2cdaf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:06.198834 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92bc989-c951-4671-9eba-a75cda2cdaf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:06.199516 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92bc989-c951-4671-9eba-a75cda2cdaf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:06.201112 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92bc989-c951-4671-9eba-a75cda2cdaf0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:06.210705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1270/2544] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:33:06.214675 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408d14a-d35f-4968-8b33-43f9583a0992 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:06.227242 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4408d14a-d35f-4968-8b33-43f9583a0992 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:06.232635 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515f16f4-7d57-4276-8e47-1165b8e05dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:06.233259 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f16f4-7d57-4276-8e47-1165b8e05dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:06.233558 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f16f4-7d57-4276-8e47-1165b8e05dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:06.233820 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515f16f4-7d57-4276-8e47-1165b8e05dd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:06.234527 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f16f4-7d57-4276-8e47-1165b8e05dd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:06.236439 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515f16f4-7d57-4276-8e47-1165b8e05dd8 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:06.247593 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1275/2545] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:33:06.251903 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92bc989-c951-4671-9eba-a75cda2cdaf0 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:06.262067 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92bc989-c951-4671-9eba-a75cda2cdaf0 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:06.266725 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51617810-e695-4fcd-9b18-364f49470559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:06.267378 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51617810-e695-4fcd-9b18-364f49470559 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:06.267661 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51617810-e695-4fcd-9b18-364f49470559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:06.267935 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51617810-e695-4fcd-9b18-364f49470559 admin admin] PATH_INFO: `/v3/projects/e3fbf993028e4f05b40415fccbbabc33/users/bb493ff5920647f584d1285de667ba2c/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:06.286505 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51617810-e695-4fcd-9b18-364f49470559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3fbf993028e4f05b40415fccbbabc33, user_id=bb493ff5920647f584d1285de667ba2c, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:06.289843 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51617810-e695-4fcd-9b18-364f49470559 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:06.304298 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1271/2546] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:33:06 2022] PUT /identity/v3/projects/e3fbf993028e4f05b40415fccbbabc33/users/bb493ff5920647f584d1285de667ba2c/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:06.316226 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5d94d-02c4-48fb-8774-1c5cdd79647d None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:06.317057 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5d94d-02c4-48fb-8774-1c5cdd79647d None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:06.317609 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5d94d-02c4-48fb-8774-1c5cdd79647d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:06.347640 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-5ae5d94d-02c4-48fb-8774-1c5cdd79647d None None] MFA Rules not processed for user `bb493ff5920647f584d1285de667ba2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:06.348872 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5ae5d94d-02c4-48fb-8774-1c5cdd79647d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:06.413111 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1276/2547] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:33:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:06.418495 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51617810-e695-4fcd-9b18-364f49470559 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:06.479125 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51617810-e695-4fcd-9b18-364f49470559 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:06.483783 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db70d1-893a-4e72-9ab1-93177e6092f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:06.484421 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db70d1-893a-4e72-9ab1-93177e6092f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:06.484705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db70d1-893a-4e72-9ab1-93177e6092f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:06.484983 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db70d1-893a-4e72-9ab1-93177e6092f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:06.485650 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db70d1-893a-4e72-9ab1-93177e6092f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:06.487539 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db70d1-893a-4e72-9ab1-93177e6092f8 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:06.514194 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1272/2548] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:33:06 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:33:06.518432 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5d94d-02c4-48fb-8774-1c5cdd79647d None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:06.530197 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5d94d-02c4-48fb-8774-1c5cdd79647d None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:06.584621 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4193ca-88ed-4847-a1a0-6fe7b24ef72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:06.585232 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4193ca-88ed-4847-a1a0-6fe7b24ef72e admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:06.585512 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4193ca-88ed-4847-a1a0-6fe7b24ef72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:06.587115 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4193ca-88ed-4847-a1a0-6fe7b24ef72e admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:06.587888 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4193ca-88ed-4847-a1a0-6fe7b24ef72e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:06.589822 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4193ca-88ed-4847-a1a0-6fe7b24ef72e admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:06.615096 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1277/2549] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:33:06 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:33:06.616347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db70d1-893a-4e72-9ab1-93177e6092f8 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:06.628592 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db70d1-893a-4e72-9ab1-93177e6092f8 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:06.633733 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e83e18-0644-4f3b-8b31-e9c2766b19ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:06.634353 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e83e18-0644-4f3b-8b31-e9c2766b19ab admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:06.634638 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e83e18-0644-4f3b-8b31-e9c2766b19ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:06.634943 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e83e18-0644-4f3b-8b31-e9c2766b19ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:06.635634 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e83e18-0644-4f3b-8b31-e9c2766b19ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:06.637272 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e83e18-0644-4f3b-8b31-e9c2766b19ab admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:06.648003 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1273/2550] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:33:06.653356 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4193ca-88ed-4847-a1a0-6fe7b24ef72e admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:06.663450 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4193ca-88ed-4847-a1a0-6fe7b24ef72e admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:06.668300 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bece2-0336-405d-a4a6-092ae1ffcebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:06.668947 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bece2-0336-405d-a4a6-092ae1ffcebb admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:06.669226 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bece2-0336-405d-a4a6-092ae1ffcebb admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:06.669499 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590bece2-0336-405d-a4a6-092ae1ffcebb admin admin] PATH_INFO: `/v3/projects/c9cb9c61e14f4624b2fb317500e89a22/users/6f12ff6b93724ab292a913434acec120/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:06.684708 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590bece2-0336-405d-a4a6-092ae1ffcebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9cb9c61e14f4624b2fb317500e89a22, user_id=6f12ff6b93724ab292a913434acec120, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:06.687355 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590bece2-0336-405d-a4a6-092ae1ffcebb admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:06.701245 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1278/2551] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:33:06 2022] PUT /identity/v3/projects/c9cb9c61e14f4624b2fb317500e89a22/users/6f12ff6b93724ab292a913434acec120/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:06.705258 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e83e18-0644-4f3b-8b31-e9c2766b19ab admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:06.716220 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e83e18-0644-4f3b-8b31-e9c2766b19ab admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:06.727534 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:06.779593 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec18c51-9ab1-4b62-b3b6-09b929fb8198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:06.780247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec18c51-9ab1-4b62-b3b6-09b929fb8198 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:06.780536 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec18c51-9ab1-4b62-b3b6-09b929fb8198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:06.780812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec18c51-9ab1-4b62-b3b6-09b929fb8198 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:06.781504 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec18c51-9ab1-4b62-b3b6-09b929fb8198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:06.783087 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec18c51-9ab1-4b62-b3b6-09b929fb8198 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:06.792927 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1274/2552] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:33:06.797202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bece2-0336-405d-a4a6-092ae1ffcebb admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:06.807541 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590bece2-0336-405d-a4a6-092ae1ffcebb admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:06.812164 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d31f3-854f-4064-b3cd-dd4e67473615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:06.812815 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d31f3-854f-4064-b3cd-dd4e67473615 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:06.813100 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d31f3-854f-4064-b3cd-dd4e67473615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:06.813379 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d31f3-854f-4064-b3cd-dd4e67473615 admin admin] PATH_INFO: `/v3/projects/c9cb9c61e14f4624b2fb317500e89a22/users/6f12ff6b93724ab292a913434acec120/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:06.815326 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d31f3-854f-4064-b3cd-dd4e67473615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9cb9c61e14f4624b2fb317500e89a22, user_id=6f12ff6b93724ab292a913434acec120, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:06.817993 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d31f3-854f-4064-b3cd-dd4e67473615 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:06.821817 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:06.831045 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1279/2553] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:33:06 2022] PUT /identity/v3/projects/c9cb9c61e14f4624b2fb317500e89a22/users/6f12ff6b93724ab292a913434acec120/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:06.841887 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac880ca-3d86-4815-a758-83bc13dc4723 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:06.842136 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac880ca-3d86-4815-a758-83bc13dc4723 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:06.842410 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac880ca-3d86-4815-a758-83bc13dc4723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:06.869269 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-bac880ca-3d86-4815-a758-83bc13dc4723 None None] MFA Rules not processed for user `6f12ff6b93724ab292a913434acec120`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:06.870470 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bac880ca-3d86-4815-a758-83bc13dc4723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:06.963513 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1275/2554] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:33:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:06.974526 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d31f3-854f-4064-b3cd-dd4e67473615 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:06.976369 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-235d31f3-854f-4064-b3cd-dd4e67473615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:07.036146 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d31f3-854f-4064-b3cd-dd4e67473615 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:07.039833 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d33256-9084-4cc6-aa32-4e038a022c17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:07.040491 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d33256-9084-4cc6-aa32-4e038a022c17 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:07.041018 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d33256-9084-4cc6-aa32-4e038a022c17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:07.041300 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d33256-9084-4cc6-aa32-4e038a022c17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:07.050688 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d33256-9084-4cc6-aa32-4e038a022c17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:07.052159 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d33256-9084-4cc6-aa32-4e038a022c17 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:07.062431 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1280/2555] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:33:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:33:07.638187 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac880ca-3d86-4815-a758-83bc13dc4723 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:07.710126 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac880ca-3d86-4815-a758-83bc13dc4723 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:07.715532 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6db1d-eb33-42d7-996a-45381de38d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:07.720435 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6db1d-eb33-42d7-996a-45381de38d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:07.720909 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6db1d-eb33-42d7-996a-45381de38d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:07.721328 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c6db1d-eb33-42d7-996a-45381de38d70 admin admin] PATH_INFO: `/v3/users/bb493ff5920647f584d1285de667ba2c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:07.722753 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c6db1d-eb33-42d7-996a-45381de38d70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb493ff5920647f584d1285de667ba2c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:07.724805 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c6db1d-eb33-42d7-996a-45381de38d70 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:07.767587 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:07.778382 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-76c6db1d-eb33-42d7-996a-45381de38d70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb493ff5920647f584d1285de667ba2c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:07.779407 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-76c6db1d-eb33-42d7-996a-45381de38d70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb493ff5920647f584d1285de667ba2c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:07.788704 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-76c6db1d-eb33-42d7-996a-45381de38d70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb493ff5920647f584d1285de667ba2c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:07.789382 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-76c6db1d-eb33-42d7-996a-45381de38d70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb493ff5920647f584d1285de667ba2c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:07.801196 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-76c6db1d-eb33-42d7-996a-45381de38d70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb493ff5920647f584d1285de667ba2c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:07.814521 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1276/2556] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:33:07 2022] DELETE /identity/v3/users/bb493ff5920647f584d1285de667ba2c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:07.819184 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a99cc-8ebd-47e5-a75e-dddd359c00dd None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:07.819468 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a99cc-8ebd-47e5-a75e-dddd359c00dd None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:07.819742 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891a99cc-8ebd-47e5-a75e-dddd359c00dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:07.839346 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-891a99cc-8ebd-47e5-a75e-dddd359c00dd None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:07.840551 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-891a99cc-8ebd-47e5-a75e-dddd359c00dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:07.898930 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1281/2557] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:33:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:33:07.908538 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6db1d-eb33-42d7-996a-45381de38d70 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:07.909943 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-76c6db1d-eb33-42d7-996a-45381de38d70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:07.968969 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c6db1d-eb33-42d7-996a-45381de38d70 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:07.972651 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe2005-39f5-4789-a740-728a9019a8df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:07.973260 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe2005-39f5-4789-a740-728a9019a8df service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:07.973542 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe2005-39f5-4789-a740-728a9019a8df service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:07.973817 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe2005-39f5-4789-a740-728a9019a8df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:07.983275 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe2005-39f5-4789-a740-728a9019a8df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:07.984732 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe2005-39f5-4789-a740-728a9019a8df service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:07.994039 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1277/2558] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:33:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:33:08.257367 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a99cc-8ebd-47e5-a75e-dddd359c00dd None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:08.259327 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-891a99cc-8ebd-47e5-a75e-dddd359c00dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:08.271335 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891a99cc-8ebd-47e5-a75e-dddd359c00dd None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:08.276584 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04eb99-0d13-4918-95df-470a6128b8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:08.277225 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04eb99-0d13-4918-95df-470a6128b8ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:08.277678 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04eb99-0d13-4918-95df-470a6128b8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:08.277957 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af04eb99-0d13-4918-95df-470a6128b8ca admin admin] PATH_INFO: `/v3/projects/e3fbf993028e4f05b40415fccbbabc33` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:08.279113 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04eb99-0d13-4918-95df-470a6128b8ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3fbf993028e4f05b40415fccbbabc33)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:08.281158 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af04eb99-0d13-4918-95df-470a6128b8ca admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:08.327631 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-af04eb99-0d13-4918-95df-470a6128b8ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3fbf993028e4f05b40415fccbbabc33', 'request_id': 'req-af04eb99-0d13-4918-95df-470a6128b8ca'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:08.333692 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-af04eb99-0d13-4918-95df-470a6128b8ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3fbf993028e4f05b40415fccbbabc33', 'request_id': 'req-af04eb99-0d13-4918-95df-470a6128b8ca'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:08.339799 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-af04eb99-0d13-4918-95df-470a6128b8ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3fbf993028e4f05b40415fccbbabc33', 'request_id': 'req-af04eb99-0d13-4918-95df-470a6128b8ca'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:08.351337 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-af04eb99-0d13-4918-95df-470a6128b8ca admin admin] The token cache is being invalidate because project e3fbf993028e4f05b40415fccbbabc33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:33:08.351625 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-af04eb99-0d13-4918-95df-470a6128b8ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:08.352258 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-af04eb99-0d13-4918-95df-470a6128b8ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:08.353769 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1282/2559] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:33:08 2022] DELETE /identity/v3/projects/e3fbf993028e4f05b40415fccbbabc33 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:08.357743 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe2005-39f5-4789-a740-728a9019a8df service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:08.368879 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe2005-39f5-4789-a740-728a9019a8df service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:08.426513 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c165ab-f314-4439-9f21-738bbf8212ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:08.427151 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c165ab-f314-4439-9f21-738bbf8212ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:08.427433 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c165ab-f314-4439-9f21-738bbf8212ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:08.427708 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c165ab-f314-4439-9f21-738bbf8212ce admin admin] PATH_INFO: `/v3/users/6f12ff6b93724ab292a913434acec120` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:08.428925 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c165ab-f314-4439-9f21-738bbf8212ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f12ff6b93724ab292a913434acec120)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:08.430904 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c165ab-f314-4439-9f21-738bbf8212ce admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:08.476056 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-b4c165ab-f314-4439-9f21-738bbf8212ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f12ff6b93724ab292a913434acec120'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:08.476636 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-b4c165ab-f314-4439-9f21-738bbf8212ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f12ff6b93724ab292a913434acec120'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:08.483585 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-b4c165ab-f314-4439-9f21-738bbf8212ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f12ff6b93724ab292a913434acec120'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:08.484254 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-b4c165ab-f314-4439-9f21-738bbf8212ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f12ff6b93724ab292a913434acec120'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:08.489174 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:08.499189 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-b4c165ab-f314-4439-9f21-738bbf8212ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f12ff6b93724ab292a913434acec120'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:08.511648 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1278/2560] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:33:08 2022] DELETE /identity/v3/users/6f12ff6b93724ab292a913434acec120 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:08.792624 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04eb99-0d13-4918-95df-470a6128b8ca admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:08.793878 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-af04eb99-0d13-4918-95df-470a6128b8ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:08.806871 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af04eb99-0d13-4918-95df-470a6128b8ca admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:08.827148 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:08.877348 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9dd1d8-ba23-4397-98f1-7b6785fac277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:08.878013 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9dd1d8-ba23-4397-98f1-7b6785fac277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:08.878286 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9dd1d8-ba23-4397-98f1-7b6785fac277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:08.878563 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9dd1d8-ba23-4397-98f1-7b6785fac277 admin admin] PATH_INFO: `/v3/projects/c9cb9c61e14f4624b2fb317500e89a22` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:08.879793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9dd1d8-ba23-4397-98f1-7b6785fac277 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9cb9c61e14f4624b2fb317500e89a22)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:08.881787 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9dd1d8-ba23-4397-98f1-7b6785fac277 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:08.931395 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-bd9dd1d8-ba23-4397-98f1-7b6785fac277 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9cb9c61e14f4624b2fb317500e89a22', 'request_id': 'req-bd9dd1d8-ba23-4397-98f1-7b6785fac277'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:08.937689 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-bd9dd1d8-ba23-4397-98f1-7b6785fac277 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9cb9c61e14f4624b2fb317500e89a22', 'request_id': 'req-bd9dd1d8-ba23-4397-98f1-7b6785fac277'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:08.943283 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-bd9dd1d8-ba23-4397-98f1-7b6785fac277 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9cb9c61e14f4624b2fb317500e89a22', 'request_id': 'req-bd9dd1d8-ba23-4397-98f1-7b6785fac277'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:08.956616 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-bd9dd1d8-ba23-4397-98f1-7b6785fac277 admin admin] The token cache is being invalidate because project c9cb9c61e14f4624b2fb317500e89a22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:33:08.956847 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-bd9dd1d8-ba23-4397-98f1-7b6785fac277 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:08.957481 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-bd9dd1d8-ba23-4397-98f1-7b6785fac277 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:08.959021 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1283/2561] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:33:08 2022] DELETE /identity/v3/projects/c9cb9c61e14f4624b2fb317500e89a22 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:08.964529 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0991c-cf27-4228-875e-2e937f829c56 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:08.964816 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0991c-cf27-4228-875e-2e937f829c56 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:08.965094 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c0991c-cf27-4228-875e-2e937f829c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:08.984921 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-c9c0991c-cf27-4228-875e-2e937f829c56 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:08.986214 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-c9c0991c-cf27-4228-875e-2e937f829c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:09.049306 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1279/2562] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:33:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:09.057879 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc4465-7dfa-4165-aac6-712e179da846 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:09.058168 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc4465-7dfa-4165-aac6-712e179da846 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:09.058454 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc4465-7dfa-4165-aac6-712e179da846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:09.078790 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-23fc4465-7dfa-4165-aac6-712e179da846 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:09.080060 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-23fc4465-7dfa-4165-aac6-712e179da846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:09.088673 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1284/2563] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:33:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:09.093076 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0991c-cf27-4228-875e-2e937f829c56 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:09.103271 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c0991c-cf27-4228-875e-2e937f829c56 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:09.107923 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5aa674-4e6d-4168-bb36-83c94c2b7887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:09.108574 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5aa674-4e6d-4168-bb36-83c94c2b7887 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:09.108857 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5aa674-4e6d-4168-bb36-83c94c2b7887 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:09.109131 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5aa674-4e6d-4168-bb36-83c94c2b7887 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:09.109832 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5aa674-4e6d-4168-bb36-83c94c2b7887 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:33:09.110137 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5aa674-4e6d-4168-bb36-83c94c2b7887 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:09.111826 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5aa674-4e6d-4168-bb36-83c94c2b7887 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:09.124610 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1280/2564] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:33:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:33:09.129174 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc4465-7dfa-4165-aac6-712e179da846 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:09.140214 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc4465-7dfa-4165-aac6-712e179da846 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:09.145155 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5d9f5-c6bc-4833-9b96-4d32e8f164c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:09.145796 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5d9f5-c6bc-4833-9b96-4d32e8f164c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:09.146076 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5d9f5-c6bc-4833-9b96-4d32e8f164c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:09.146347 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5d9f5-c6bc-4833-9b96-4d32e8f164c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:09.147009 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5d9f5-c6bc-4833-9b96-4d32e8f164c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:09.149615 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5d9f5-c6bc-4833-9b96-4d32e8f164c4 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:09.162292 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5aa674-4e6d-4168-bb36-83c94c2b7887 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:09.166793 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-de5aa674-4e6d-4168-bb36-83c94c2b7887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:09.189907 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1285/2565] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:33:09 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:33:09.193866 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5d9f5-c6bc-4833-9b96-4d32e8f164c4 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:09.266166 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5aa674-4e6d-4168-bb36-83c94c2b7887 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:09.280565 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5d9f5-c6bc-4833-9b96-4d32e8f164c4 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:09.285662 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fcf90-2a8e-436f-91b9-3dbc117cb186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:09.286611 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fcf90-2a8e-436f-91b9-3dbc117cb186 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:09.286898 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fcf90-2a8e-436f-91b9-3dbc117cb186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:09.287181 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51fcf90-2a8e-436f-91b9-3dbc117cb186 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:09.287855 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51fcf90-2a8e-436f-91b9-3dbc117cb186 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:09.291203 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51fcf90-2a8e-436f-91b9-3dbc117cb186 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:09.317249 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1286/2566] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:33:09 2022] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:33:09.321653 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fcf90-2a8e-436f-91b9-3dbc117cb186 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:09.336732 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51fcf90-2a8e-436f-91b9-3dbc117cb186 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:09.338871 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5034d6-103c-488c-a8ae-7be24352a806 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a386d326dc634cbd943ac30f6e8d08bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:09.339567 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5034d6-103c-488c-a8ae-7be24352a806 service placement] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:09.339774 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5034d6-103c-488c-a8ae-7be24352a806 service placement] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:09.340086 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5034d6-103c-488c-a8ae-7be24352a806 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:09.341899 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-de5034d6-103c-488c-a8ae-7be24352a806 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:09.342362 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2778c-ffca-4e05-84cb-20f9704d9ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:09.343103 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2778c-ffca-4e05-84cb-20f9704d9ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:09.343389 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2778c-ffca-4e05-84cb-20f9704d9ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:09.343668 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2778c-ffca-4e05-84cb-20f9704d9ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:09.344465 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2778c-ffca-4e05-84cb-20f9704d9ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:09.347182 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2778c-ffca-4e05-84cb-20f9704d9ef0 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:09.350800 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:09.355314 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5034d6-103c-488c-a8ae-7be24352a806 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:09.357096 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5034d6-103c-488c-a8ae-7be24352a806 service placement] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:09.365290 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1287/2567] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:33:09.370680 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2778c-ffca-4e05-84cb-20f9704d9ef0 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:09.371496 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1281/2568] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:33:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:33:09.378085 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:09.383815 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2778c-ffca-4e05-84cb-20f9704d9ef0 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:09.391459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc8f20c-a0cd-4ebe-983f-a86f2b5466d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:09.392532 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8f20c-a0cd-4ebe-983f-a86f2b5466d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:09.393157 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8f20c-a0cd-4ebe-983f-a86f2b5466d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:09.393996 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc8f20c-a0cd-4ebe-983f-a86f2b5466d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:09.394890 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8f20c-a0cd-4ebe-983f-a86f2b5466d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:09.397037 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc8f20c-a0cd-4ebe-983f-a86f2b5466d5 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:09.408895 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1288/2569] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:33:09.413429 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5034d6-103c-488c-a8ae-7be24352a806 service placement] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:09.426171 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5034d6-103c-488c-a8ae-7be24352a806 service placement] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:09.430997 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57aa5b-7523-480b-bf9c-7c7885f7643e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:09.431663 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57aa5b-7523-480b-bf9c-7c7885f7643e admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:09.431947 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57aa5b-7523-480b-bf9c-7c7885f7643e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:09.432258 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c57aa5b-7523-480b-bf9c-7c7885f7643e admin admin] PATH_INFO: `/v3/projects/d24b7614e9a64f89aa6260ff106690e9/users/ace2276831e8408caa3103db8997840c/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:09.448518 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57aa5b-7523-480b-bf9c-7c7885f7643e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d24b7614e9a64f89aa6260ff106690e9, user_id=ace2276831e8408caa3103db8997840c, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:09.451188 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c57aa5b-7523-480b-bf9c-7c7885f7643e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:09.466425 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1282/2570] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:33:09 2022] PUT /identity/v3/projects/d24b7614e9a64f89aa6260ff106690e9/users/ace2276831e8408caa3103db8997840c/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:09.471497 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9b1d9-daeb-471b-be3e-ef5f9e53ae41 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:09.471781 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9b1d9-daeb-471b-be3e-ef5f9e53ae41 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:09.472078 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e9b1d9-daeb-471b-be3e-ef5f9e53ae41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:09.491083 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-82e9b1d9-daeb-471b-be3e-ef5f9e53ae41 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:09.492372 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-82e9b1d9-daeb-471b-be3e-ef5f9e53ae41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:09.556969 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1289/2571] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:33:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:09.566663 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57aa5b-7523-480b-bf9c-7c7885f7643e admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:09.568478 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6c57aa5b-7523-480b-bf9c-7c7885f7643e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:09.646757 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c57aa5b-7523-480b-bf9c-7c7885f7643e admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:09.651132 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2df1c-9162-4b84-9610-dc75f93d271c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:09.651744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2df1c-9162-4b84-9610-dc75f93d271c service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:09.652062 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2df1c-9162-4b84-9610-dc75f93d271c service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:09.652339 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2df1c-9162-4b84-9610-dc75f93d271c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:09.661281 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a2df1c-9162-4b84-9610-dc75f93d271c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:09.662716 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a2df1c-9162-4b84-9610-dc75f93d271c service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:09.675709 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1283/2572] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:33:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:33:10.352471 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b33fc-534b-4340-9993-64a3cb5dd146 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:10.353031 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b33fc-534b-4340-9993-64a3cb5dd146 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:10.353296 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7b33fc-534b-4340-9993-64a3cb5dd146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:10.393907 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-ad7b33fc-534b-4340-9993-64a3cb5dd146 None None] MFA Rules not processed for user `ace2276831e8408caa3103db8997840c`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:10.395851 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ad7b33fc-534b-4340-9993-64a3cb5dd146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:10.470938 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1290/2573] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:33:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:10.475462 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2df1c-9162-4b84-9610-dc75f93d271c service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:10.486270 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2df1c-9162-4b84-9610-dc75f93d271c service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:10.491608 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51de42-c81c-4b6a-8ede-738eff7f8ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:10.492794 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51de42-c81c-4b6a-8ede-738eff7f8ae0 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:10.493081 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51de42-c81c-4b6a-8ede-738eff7f8ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:10.493352 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51de42-c81c-4b6a-8ede-738eff7f8ae0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:10.494053 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd51de42-c81c-4b6a-8ede-738eff7f8ae0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:10.495923 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd51de42-c81c-4b6a-8ede-738eff7f8ae0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:10.527045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1284/2574] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:33:10 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:33:10.530976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b33fc-534b-4340-9993-64a3cb5dd146 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:10.543461 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7b33fc-534b-4340-9993-64a3cb5dd146 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:10.615800 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b447297-d310-442d-955f-2276f955b2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:10.616616 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b447297-d310-442d-955f-2276f955b2e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:10.617003 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b447297-d310-442d-955f-2276f955b2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:10.617284 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b447297-d310-442d-955f-2276f955b2e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:10.617956 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b447297-d310-442d-955f-2276f955b2e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:10.623503 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b447297-d310-442d-955f-2276f955b2e3 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:10.651520 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1291/2575] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:33:10 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:33:10.652419 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51de42-c81c-4b6a-8ede-738eff7f8ae0 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:10.666469 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51de42-c81c-4b6a-8ede-738eff7f8ae0 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:10.677154 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5b83e-e499-4758-9c8d-4658ffb2275f None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:10.677446 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5b83e-e499-4758-9c8d-4658ffb2275f None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:10.677723 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c5b83e-e499-4758-9c8d-4658ffb2275f None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:10.678451 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4255e-a194-4c40-879d-f22bb702ed94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:10.679198 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1292/2576] 10.222.0.40 () {54 vars in 921 bytes} [Wed Jul 27 15:33:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:33:10.679338 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4255e-a194-4c40-879d-f22bb702ed94 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:10.679438 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4255e-a194-4c40-879d-f22bb702ed94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:10.679663 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4255e-a194-4c40-879d-f22bb702ed94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:10.680408 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4255e-a194-4c40-879d-f22bb702ed94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:10.684165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4255e-a194-4c40-879d-f22bb702ed94 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:10.699261 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1285/2577] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 15:33:10.700387 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff0977-33f6-4185-a2d6-11baba858ff1 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:10.700684 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff0977-33f6-4185-a2d6-11baba858ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:10.700962 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ff0977-33f6-4185-a2d6-11baba858ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:10.704225 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4255e-a194-4c40-879d-f22bb702ed94 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:10.715977 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4255e-a194-4c40-879d-f22bb702ed94 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:10.720751 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a554a-53de-44c5-b269-ff315e48629c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:10.721958 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a554a-53de-44c5-b269-ff315e48629c admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:10.721958 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a554a-53de-44c5-b269-ff315e48629c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:10.722354 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a554a-53de-44c5-b269-ff315e48629c admin admin] PATH_INFO: `/v3/projects/2e0c3c2f4f78482c95cbaf13d46d2632/users/adbfca20639744a5870ce333421cffa4/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:10.726340 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:10.738682 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a554a-53de-44c5-b269-ff315e48629c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e0c3c2f4f78482c95cbaf13d46d2632, user_id=adbfca20639744a5870ce333421cffa4, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:10.741563 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a554a-53de-44c5-b269-ff315e48629c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:10.758697 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1286/2578] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:33:10 2022] PUT /identity/v3/projects/2e0c3c2f4f78482c95cbaf13d46d2632/users/adbfca20639744a5870ce333421cffa4/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:33:10.759496 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-59ff0977-33f6-4185-a2d6-11baba858ff1 None None] MFA Rules not processed for user `d3e01aa0ef1340cbba7170bac4a82783`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:10.760753 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-59ff0977-33f6-4185-a2d6-11baba858ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:10.762360 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a554a-53de-44c5-b269-ff315e48629c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:10.831160 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:10.838662 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a554a-53de-44c5-b269-ff315e48629c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:10.843685 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfb4c4-f2fd-4a53-b174-e9f6668bfe11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:10.844489 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfb4c4-f2fd-4a53-b174-e9f6668bfe11 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:10.844773 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfb4c4-f2fd-4a53-b174-e9f6668bfe11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:10.845046 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cfb4c4-f2fd-4a53-b174-e9f6668bfe11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:10.845739 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cfb4c4-f2fd-4a53-b174-e9f6668bfe11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:10.847354 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cfb4c4-f2fd-4a53-b174-e9f6668bfe11 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:10.857424 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1293/2579] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Jul 27 15:33:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:10.857608 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1287/2580] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 15:33:10.862576 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff0977-33f6-4185-a2d6-11baba858ff1 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:10.869696 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfb4c4-f2fd-4a53-b174-e9f6668bfe11 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:10.871471 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f3cfb4c4-f2fd-4a53-b174-e9f6668bfe11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:10.873560 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ff0977-33f6-4185-a2d6-11baba858ff1 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:10.878313 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd1a52a-0a19-4a1a-a4f7-9ef14c55ae96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:10.878978 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1a52a-0a19-4a1a-a4f7-9ef14c55ae96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:10.879259 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1a52a-0a19-4a1a-a4f7-9ef14c55ae96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:10.879536 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd1a52a-0a19-4a1a-a4f7-9ef14c55ae96 admin admin] PATH_INFO: `/v3/projects/2e0c3c2f4f78482c95cbaf13d46d2632/users/adbfca20639744a5870ce333421cffa4/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:10.881698 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd1a52a-0a19-4a1a-a4f7-9ef14c55ae96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e0c3c2f4f78482c95cbaf13d46d2632, user_id=adbfca20639744a5870ce333421cffa4, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:10.885128 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd1a52a-0a19-4a1a-a4f7-9ef14c55ae96 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:10.895922 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1294/2581] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:33:10 2022] PUT /identity/v3/projects/2e0c3c2f4f78482c95cbaf13d46d2632/users/adbfca20639744a5870ce333421cffa4/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:33:10.939089 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cfb4c4-f2fd-4a53-b174-e9f6668bfe11 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:10.991177 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b42b01-42a2-46f3-b7cd-6313e8ad22e1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f71721ca75a461d92044091564de424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:10.992417 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b42b01-42a2-46f3-b7cd-6313e8ad22e1 service glance] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:10.992712 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b42b01-42a2-46f3-b7cd-6313e8ad22e1 service glance] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:10.993091 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b42b01-42a2-46f3-b7cd-6313e8ad22e1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:11.063854 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b42b01-42a2-46f3-b7cd-6313e8ad22e1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:11.065298 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b42b01-42a2-46f3-b7cd-6313e8ad22e1 service glance] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:11.078811 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1288/2582] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:33:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 15:33:11.149341 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24ae76-a0e2-4082-86c3-071281adc2ec None None] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:11.149625 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24ae76-a0e2-4082-86c3-071281adc2ec None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:11.149904 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24ae76-a0e2-4082-86c3-071281adc2ec None None] PATH_INFO: `/` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:11.151265 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1295/2583] 10.222.0.40 () {54 vars in 921 bytes} [Wed Jul 27 15:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 15:33:11.156189 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb4485-925b-4c37-8514-b0aa559fcce4 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:11.156578 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb4485-925b-4c37-8514-b0aa559fcce4 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:11.157374 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb4485-925b-4c37-8514-b0aa559fcce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:11.177568 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-01eb4485-925b-4c37-8514-b0aa559fcce4 None None] MFA Rules not processed for user `227dac1eaefc4d0a8d3cc8a6dee2ecba`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:11.178773 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-01eb4485-925b-4c37-8514-b0aa559fcce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:11.236403 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:11.246588 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1289/2584] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Jul 27 15:33:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:11.258352 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24ae76-a0e2-4082-86c3-071281adc2ec None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:11.260179 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-0d24ae76-a0e2-4082-86c3-071281adc2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:11.273259 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24ae76-a0e2-4082-86c3-071281adc2ec None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:11.277216 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb0227d-6a90-49be-9f0b-80c0b1dd836f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:11.277920 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0227d-6a90-49be-9f0b-80c0b1dd836f service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:11.278248 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0227d-6a90-49be-9f0b-80c0b1dd836f service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:11.278587 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb0227d-6a90-49be-9f0b-80c0b1dd836f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:11.288220 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb0227d-6a90-49be-9f0b-80c0b1dd836f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:11.300709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb0227d-6a90-49be-9f0b-80c0b1dd836f service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:11.323290 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1296/2585] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:33:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:33:11.450274 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f5e65-e26f-414e-b1da-3c1f7cd1949f None None] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:11.450576 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f5e65-e26f-414e-b1da-3c1f7cd1949f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:11.450861 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f5e65-e26f-414e-b1da-3c1f7cd1949f None None] PATH_INFO: `/` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:11.452835 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1290/2586] 10.222.0.40 () {54 vars in 921 bytes} [Wed Jul 27 15:33:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 15:33:11.475436 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaddd62-ad88-4b26-bcc1-ab2ccf9e1a19 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:11.476876 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaddd62-ad88-4b26-bcc1-ab2ccf9e1a19 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:11.477460 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaddd62-ad88-4b26-bcc1-ab2ccf9e1a19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:11.507657 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-aaaddd62-ad88-4b26-bcc1-ab2ccf9e1a19 None None] MFA Rules not processed for user `d3e01aa0ef1340cbba7170bac4a82783`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:11.508882 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-aaaddd62-ad88-4b26-bcc1-ab2ccf9e1a19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:11.518800 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1297/2587] 10.222.0.40 () {58 vars in 1018 bytes} [Wed Jul 27 15:33:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:11.532942 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f5e65-e26f-414e-b1da-3c1f7cd1949f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:11.546870 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f5e65-e26f-414e-b1da-3c1f7cd1949f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:11.550866 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23113087-ea07-4221-9dc6-043669f125c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:11.551484 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23113087-ea07-4221-9dc6-043669f125c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:11.551768 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23113087-ea07-4221-9dc6-043669f125c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:11.552063 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23113087-ea07-4221-9dc6-043669f125c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:11.569939 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23113087-ea07-4221-9dc6-043669f125c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:11.571477 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23113087-ea07-4221-9dc6-043669f125c6 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:11.588078 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1291/2588] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:33:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:33:11.645314 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4666d-6b81-42d0-8e04-cc0242c402b3 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:11.645599 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4666d-6b81-42d0-8e04-cc0242c402b3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:11.645877 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e4666d-6b81-42d0-8e04-cc0242c402b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:11.689667 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-b2e4666d-6b81-42d0-8e04-cc0242c402b3 None None] MFA Rules not processed for user `adbfca20639744a5870ce333421cffa4`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:11.691326 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b2e4666d-6b81-42d0-8e04-cc0242c402b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:11.778402 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1298/2589] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:33:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:11.852378 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd26db2-3dbd-476a-bf2b-61bf5bb8d1e3 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:11.853963 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd26db2-3dbd-476a-bf2b-61bf5bb8d1e3 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:11.854422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd26db2-3dbd-476a-bf2b-61bf5bb8d1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:11.894736 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-6fd26db2-3dbd-476a-bf2b-61bf5bb8d1e3 None None] MFA Rules not processed for user `ace2276831e8408caa3103db8997840c`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:11.897305 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6fd26db2-3dbd-476a-bf2b-61bf5bb8d1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:11.981502 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1292/2590] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:33:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:11.992983 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4666d-6b81-42d0-8e04-cc0242c402b3 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:11.994439 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b2e4666d-6b81-42d0-8e04-cc0242c402b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:12.011311 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e4666d-6b81-42d0-8e04-cc0242c402b3 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:12.021426 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd218aac-db88-4a6f-9645-5fbfdd334d07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:12.022138 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd218aac-db88-4a6f-9645-5fbfdd334d07 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:12.022491 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd218aac-db88-4a6f-9645-5fbfdd334d07 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:12.022836 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd218aac-db88-4a6f-9645-5fbfdd334d07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:12.032336 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd218aac-db88-4a6f-9645-5fbfdd334d07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:12.034035 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd218aac-db88-4a6f-9645-5fbfdd334d07 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:12.045133 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1299/2591] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:33:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:33:16.418481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eea2d5-712c-4d38-bb9f-425717ab2b70 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:16.419420 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eea2d5-712c-4d38-bb9f-425717ab2b70 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:16.419730 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eea2d5-712c-4d38-bb9f-425717ab2b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:16.442776 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-39eea2d5-712c-4d38-bb9f-425717ab2b70 None None] MFA Rules not processed for user `b470b4c2ca1a4d1a8a864789bf603d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:16.444035 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-39eea2d5-712c-4d38-bb9f-425717ab2b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:16.508054 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1293/2592] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Jul 27 15:33:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:16.521172 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd218aac-db88-4a6f-9645-5fbfdd334d07 service nova] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:16.522688 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-cd218aac-db88-4a6f-9645-5fbfdd334d07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:16.550264 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:16.596058 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd218aac-db88-4a6f-9645-5fbfdd334d07 service nova] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:16.602933 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3615e1-88b6-4250-80d3-45bf5b472550 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68bbf8bb59a84829afacd9677c9639a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:16.604386 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3615e1-88b6-4250-80d3-45bf5b472550 service swift] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:16.604775 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3615e1-88b6-4250-80d3-45bf5b472550 service swift] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:16.605148 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3615e1-88b6-4250-80d3-45bf5b472550 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:16.614089 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3615e1-88b6-4250-80d3-45bf5b472550 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:16.615677 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3615e1-88b6-4250-80d3-45bf5b472550 service swift] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:16.624843 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1300/2593] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Jul 27 15:33:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 15:33:26.501171 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=57 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:26.621162 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=22 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:34.990931 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eea2d5-712c-4d38-bb9f-425717ab2b70 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:35.000925 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eea2d5-712c-4d38-bb9f-425717ab2b70 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:35.004445 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89618bd2-5851-4638-afbc-3bc6e3ce874c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:35.005045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89618bd2-5851-4638-afbc-3bc6e3ce874c service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:35.005321 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89618bd2-5851-4638-afbc-3bc6e3ce874c service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:35.005592 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89618bd2-5851-4638-afbc-3bc6e3ce874c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:35.007299 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-89618bd2-5851-4638-afbc-3bc6e3ce874c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:35.071534 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89618bd2-5851-4638-afbc-3bc6e3ce874c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:35.072996 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89618bd2-5851-4638-afbc-3bc6e3ce874c service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:35.084165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1294/2594] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:33:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:33:36.370920 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72c33a-accf-45ea-92fd-290a003c29e9 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:36.371466 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72c33a-accf-45ea-92fd-290a003c29e9 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:36.371466 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c72c33a-accf-45ea-92fd-290a003c29e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:36.393919 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-6c72c33a-accf-45ea-92fd-290a003c29e9 None None] MFA Rules not processed for user `b470b4c2ca1a4d1a8a864789bf603d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:36.395660 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6c72c33a-accf-45ea-92fd-290a003c29e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:36.404436 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1301/2595] 10.222.0.40 () {58 vars in 967 bytes} [Wed Jul 27 15:33:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:36.418637 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89618bd2-5851-4638-afbc-3bc6e3ce874c service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:36.433743 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89618bd2-5851-4638-afbc-3bc6e3ce874c service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:36.439461 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7d1e1-3e68-42d9-a069-c648094c25d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68bbf8bb59a84829afacd9677c9639a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:36.440498 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7d1e1-3e68-42d9-a069-c648094c25d1 service swift] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:36.440794 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7d1e1-3e68-42d9-a069-c648094c25d1 service swift] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:36.441283 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d7d1e1-3e68-42d9-a069-c648094c25d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:36.451489 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d7d1e1-3e68-42d9-a069-c648094c25d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:36.453421 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d7d1e1-3e68-42d9-a069-c648094c25d1 service swift] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:36.463127 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1295/2596] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Jul 27 15:33:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 15:33:38.517041 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72c33a-accf-45ea-92fd-290a003c29e9 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:38.518589 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6c72c33a-accf-45ea-92fd-290a003c29e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:38.533133 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c72c33a-accf-45ea-92fd-290a003c29e9 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:38.537630 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3448ef-d8b1-4866-9012-2f089a037351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:38.538262 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3448ef-d8b1-4866-9012-2f089a037351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:38.538538 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3448ef-d8b1-4866-9012-2f089a037351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:38.538837 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3448ef-d8b1-4866-9012-2f089a037351 admin admin] PATH_INFO: `/v3/users/0b92ad58e5484bc796e1b61fa9f788dd` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:38.540039 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3448ef-d8b1-4866-9012-2f089a037351 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b92ad58e5484bc796e1b61fa9f788dd)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:38.542188 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3448ef-d8b1-4866-9012-2f089a037351 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:38.592251 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4b3448ef-d8b1-4866-9012-2f089a037351 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b92ad58e5484bc796e1b61fa9f788dd'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:38.592938 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4b3448ef-d8b1-4866-9012-2f089a037351 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b92ad58e5484bc796e1b61fa9f788dd'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:38.600378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4b3448ef-d8b1-4866-9012-2f089a037351 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b92ad58e5484bc796e1b61fa9f788dd'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:38.607453 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4b3448ef-d8b1-4866-9012-2f089a037351 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b92ad58e5484bc796e1b61fa9f788dd'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:38.619852 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-4b3448ef-d8b1-4866-9012-2f089a037351 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b92ad58e5484bc796e1b61fa9f788dd'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:38.625689 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1302/2597] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:33:38 2022] DELETE /identity/v3/users/0b92ad58e5484bc796e1b61fa9f788dd => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:38.796487 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7d1e1-3e68-42d9-a069-c648094c25d1 service swift] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:38.807947 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d7d1e1-3e68-42d9-a069-c648094c25d1 service swift] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:38.864169 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f176d-b6dc-4e76-bc21-e66b0c43e83a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:38.864811 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f176d-b6dc-4e76-bc21-e66b0c43e83a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:38.865095 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f176d-b6dc-4e76-bc21-e66b0c43e83a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:38.865372 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f176d-b6dc-4e76-bc21-e66b0c43e83a admin admin] PATH_INFO: `/v3/projects/8d7c82e18db745e78b8b5f22d6080294` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:38.866521 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f176d-b6dc-4e76-bc21-e66b0c43e83a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d7c82e18db745e78b8b5f22d6080294)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:38.869138 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f176d-b6dc-4e76-bc21-e66b0c43e83a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:38.920020 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e51f176d-b6dc-4e76-bc21-e66b0c43e83a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d7c82e18db745e78b8b5f22d6080294', 'request_id': 'req-e51f176d-b6dc-4e76-bc21-e66b0c43e83a'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:38.926360 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e51f176d-b6dc-4e76-bc21-e66b0c43e83a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d7c82e18db745e78b8b5f22d6080294', 'request_id': 'req-e51f176d-b6dc-4e76-bc21-e66b0c43e83a'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:38.932566 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e51f176d-b6dc-4e76-bc21-e66b0c43e83a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d7c82e18db745e78b8b5f22d6080294', 'request_id': 'req-e51f176d-b6dc-4e76-bc21-e66b0c43e83a'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:38.945194 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e51f176d-b6dc-4e76-bc21-e66b0c43e83a admin admin] The token cache is being invalidate because project 8d7c82e18db745e78b8b5f22d6080294 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:33:38.945564 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e51f176d-b6dc-4e76-bc21-e66b0c43e83a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:38.946206 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e51f176d-b6dc-4e76-bc21-e66b0c43e83a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:38.947928 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1296/2598] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:33:38 2022] DELETE /identity/v3/projects/8d7c82e18db745e78b8b5f22d6080294 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:38.952686 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ccafa-b988-4337-8421-4e1e9d806064 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:38.953007 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ccafa-b988-4337-8421-4e1e9d806064 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:38.953472 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4ccafa-b988-4337-8421-4e1e9d806064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:38.972982 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-cc4ccafa-b988-4337-8421-4e1e9d806064 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:38.974199 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-cc4ccafa-b988-4337-8421-4e1e9d806064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:39.040222 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1303/2599] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:33:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:39.049138 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da579f-f3ad-492d-bf61-9dc65eb9b7fb None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:39.049435 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da579f-f3ad-492d-bf61-9dc65eb9b7fb None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:39.049714 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da579f-f3ad-492d-bf61-9dc65eb9b7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:39.071506 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-74da579f-f3ad-492d-bf61-9dc65eb9b7fb None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:39.072717 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-74da579f-f3ad-492d-bf61-9dc65eb9b7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:39.081008 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1297/2600] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:33:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:39.085042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ccafa-b988-4337-8421-4e1e9d806064 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:39.095261 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4ccafa-b988-4337-8421-4e1e9d806064 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:39.099834 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062092d-4ae3-4dea-840a-fee714c7365c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:39.100475 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062092d-4ae3-4dea-840a-fee714c7365c admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:39.100758 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062092d-4ae3-4dea-840a-fee714c7365c admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:39.101543 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c062092d-4ae3-4dea-840a-fee714c7365c admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:39.102240 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062092d-4ae3-4dea-840a-fee714c7365c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:33:39.102547 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062092d-4ae3-4dea-840a-fee714c7365c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:39.104163 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c062092d-4ae3-4dea-840a-fee714c7365c admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:39.119357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1304/2601] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:33:39.120883 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da579f-f3ad-492d-bf61-9dc65eb9b7fb None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:39.126984 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:39.131527 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da579f-f3ad-492d-bf61-9dc65eb9b7fb None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:39.138028 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b7b70-2da3-4a19-80b4-f26dd580aec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:39.138799 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b7b70-2da3-4a19-80b4-f26dd580aec0 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:39.139244 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b7b70-2da3-4a19-80b4-f26dd580aec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:39.139627 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880b7b70-2da3-4a19-80b4-f26dd580aec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:39.140514 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b7b70-2da3-4a19-80b4-f26dd580aec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:39.142491 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880b7b70-2da3-4a19-80b4-f26dd580aec0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:39.174061 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1298/2602] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:33:39 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:33:39.175150 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062092d-4ae3-4dea-840a-fee714c7365c admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:39.185967 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c062092d-4ae3-4dea-840a-fee714c7365c admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:39.233860 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:39.244584 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66d474-5a96-4afc-882a-f292bdd43b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:39.245351 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66d474-5a96-4afc-882a-f292bdd43b0b admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:39.245790 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66d474-5a96-4afc-882a-f292bdd43b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:39.246275 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66d474-5a96-4afc-882a-f292bdd43b0b admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:39.246943 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66d474-5a96-4afc-882a-f292bdd43b0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:39.248922 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66d474-5a96-4afc-882a-f292bdd43b0b admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:39.270439 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1305/2603] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:33:39 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:33:39.276073 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b7b70-2da3-4a19-80b4-f26dd580aec0 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:39.287118 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880b7b70-2da3-4a19-80b4-f26dd580aec0 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:39.292205 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b8598-bedc-4ee2-9ffc-9c39155e8a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:39.292811 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b8598-bedc-4ee2-9ffc-9c39155e8a59 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:39.293096 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b8598-bedc-4ee2-9ffc-9c39155e8a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:39.293667 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b8598-bedc-4ee2-9ffc-9c39155e8a59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:39.294077 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b8598-bedc-4ee2-9ffc-9c39155e8a59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:39.295831 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b8598-bedc-4ee2-9ffc-9c39155e8a59 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:39.307355 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1299/2604] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:33:39.311376 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66d474-5a96-4afc-882a-f292bdd43b0b admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:39.322715 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66d474-5a96-4afc-882a-f292bdd43b0b admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:39.327612 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e33c85-ef16-41f3-b04a-7c6e98f45b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:39.328354 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e33c85-ef16-41f3-b04a-7c6e98f45b0a admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:39.328675 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e33c85-ef16-41f3-b04a-7c6e98f45b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:39.328958 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e33c85-ef16-41f3-b04a-7c6e98f45b0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:39.329650 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e33c85-ef16-41f3-b04a-7c6e98f45b0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:39.331389 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e33c85-ef16-41f3-b04a-7c6e98f45b0a admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:39.342277 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1306/2605] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:33:39.346538 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b8598-bedc-4ee2-9ffc-9c39155e8a59 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:39.356928 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b8598-bedc-4ee2-9ffc-9c39155e8a59 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:39.361964 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b4e15-6be2-4d1c-9aeb-b08c364647e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:39.362621 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b4e15-6be2-4d1c-9aeb-b08c364647e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:39.362902 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b4e15-6be2-4d1c-9aeb-b08c364647e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:39.363175 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b4e15-6be2-4d1c-9aeb-b08c364647e1 admin admin] PATH_INFO: `/v3/projects/6f4719c03f944ddf96046eae258fef2a/users/7a1497a034844d1a8f3127e4eda6b2eb/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:39.379524 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b4e15-6be2-4d1c-9aeb-b08c364647e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f4719c03f944ddf96046eae258fef2a, user_id=7a1497a034844d1a8f3127e4eda6b2eb, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:39.382380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8b4e15-6be2-4d1c-9aeb-b08c364647e1 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:39.399604 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1300/2606] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:33:39 2022] PUT /identity/v3/projects/6f4719c03f944ddf96046eae258fef2a/users/7a1497a034844d1a8f3127e4eda6b2eb/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:39.409879 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c92b94-e343-4409-8692-eea77b5116cc None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:39.410413 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c92b94-e343-4409-8692-eea77b5116cc None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:39.410588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c92b94-e343-4409-8692-eea77b5116cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:39.453536 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-b4c92b94-e343-4409-8692-eea77b5116cc None None] MFA Rules not processed for user `7a1497a034844d1a8f3127e4eda6b2eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:39.454782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b4c92b94-e343-4409-8692-eea77b5116cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:39.523274 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1307/2607] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:33:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:39.527739 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b4e15-6be2-4d1c-9aeb-b08c364647e1 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:39.589262 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b4e15-6be2-4d1c-9aeb-b08c364647e1 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:39.594529 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16422818-cadc-43e8-b625-31903f1b5bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:39.595139 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16422818-cadc-43e8-b625-31903f1b5bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:39.595422 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16422818-cadc-43e8-b625-31903f1b5bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:39.595694 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16422818-cadc-43e8-b625-31903f1b5bb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:39.596415 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16422818-cadc-43e8-b625-31903f1b5bb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:39.598320 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16422818-cadc-43e8-b625-31903f1b5bb0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:39.624798 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1301/2608] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:33:39 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:33:39.628896 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c92b94-e343-4409-8692-eea77b5116cc None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:39.639397 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c92b94-e343-4409-8692-eea77b5116cc None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:39.694983 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5332d-5535-4a11-87ef-eb1e0447a71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:39.695517 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5332d-5535-4a11-87ef-eb1e0447a71e admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:39.695795 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5332d-5535-4a11-87ef-eb1e0447a71e admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:39.696100 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5332d-5535-4a11-87ef-eb1e0447a71e admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:39.696762 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5332d-5535-4a11-87ef-eb1e0447a71e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:39.698680 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b5332d-5535-4a11-87ef-eb1e0447a71e admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:39.718826 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1308/2609] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:33:39 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:33:39.722812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16422818-cadc-43e8-b625-31903f1b5bb0 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:39.733558 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16422818-cadc-43e8-b625-31903f1b5bb0 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:39.738187 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb580e6d-f015-4aab-80ed-c52786611617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:39.738790 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb580e6d-f015-4aab-80ed-c52786611617 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:39.739067 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb580e6d-f015-4aab-80ed-c52786611617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:39.739333 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb580e6d-f015-4aab-80ed-c52786611617 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:39.740043 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb580e6d-f015-4aab-80ed-c52786611617 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:39.741601 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb580e6d-f015-4aab-80ed-c52786611617 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:39.752616 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1302/2610] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:33:39.756471 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5332d-5535-4a11-87ef-eb1e0447a71e admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:39.766431 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b5332d-5535-4a11-87ef-eb1e0447a71e admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:39.771034 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22350fb-0d23-4db5-a22e-e43208002567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:39.771670 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22350fb-0d23-4db5-a22e-e43208002567 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:39.771947 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22350fb-0d23-4db5-a22e-e43208002567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:39.772248 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22350fb-0d23-4db5-a22e-e43208002567 admin admin] PATH_INFO: `/v3/projects/3f3ef6bb2ed74cff93327721ed420ffd/users/b1015080afd6444ca4b458941d5dd9a1/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:39.786352 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22350fb-0d23-4db5-a22e-e43208002567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f3ef6bb2ed74cff93327721ed420ffd, user_id=b1015080afd6444ca4b458941d5dd9a1, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:39.789498 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22350fb-0d23-4db5-a22e-e43208002567 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:39.802385 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1309/2611] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:33:39 2022] PUT /identity/v3/projects/3f3ef6bb2ed74cff93327721ed420ffd/users/b1015080afd6444ca4b458941d5dd9a1/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:39.806942 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb580e6d-f015-4aab-80ed-c52786611617 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:39.817502 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb580e6d-f015-4aab-80ed-c52786611617 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:39.874951 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b7254-6e9c-42eb-ae5d-bff55e4b3b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:39.875645 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b7254-6e9c-42eb-ae5d-bff55e4b3b82 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:39.875951 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b7254-6e9c-42eb-ae5d-bff55e4b3b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:39.876243 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b7254-6e9c-42eb-ae5d-bff55e4b3b82 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:39.876964 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b7254-6e9c-42eb-ae5d-bff55e4b3b82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:39.878634 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b7254-6e9c-42eb-ae5d-bff55e4b3b82 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:39.888644 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1303/2612] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:33:39 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:33:39.893090 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22350fb-0d23-4db5-a22e-e43208002567 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:39.903108 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22350fb-0d23-4db5-a22e-e43208002567 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:39.907713 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b74379-4738-4f9d-968b-158eb409906a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:39.908466 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b74379-4738-4f9d-968b-158eb409906a admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:39.908743 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b74379-4738-4f9d-968b-158eb409906a admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:39.909014 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b74379-4738-4f9d-968b-158eb409906a admin admin] PATH_INFO: `/v3/projects/3f3ef6bb2ed74cff93327721ed420ffd/users/b1015080afd6444ca4b458941d5dd9a1/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:39.910952 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b74379-4738-4f9d-968b-158eb409906a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f3ef6bb2ed74cff93327721ed420ffd, user_id=b1015080afd6444ca4b458941d5dd9a1, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:39.914209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b74379-4738-4f9d-968b-158eb409906a admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:39.924596 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1310/2613] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:33:39 2022] PUT /identity/v3/projects/3f3ef6bb2ed74cff93327721ed420ffd/users/b1015080afd6444ca4b458941d5dd9a1/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:33:39.936785 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560333a-f849-4103-909a-34b0f887c9a6 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:39.937081 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560333a-f849-4103-909a-34b0f887c9a6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:39.937356 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560333a-f849-4103-909a-34b0f887c9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:39.964272 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-3560333a-f849-4103-909a-34b0f887c9a6 None None] MFA Rules not processed for user `b1015080afd6444ca4b458941d5dd9a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:39.965500 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3560333a-f849-4103-909a-34b0f887c9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:39.970539 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:40.034868 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1304/2614] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:33:39 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:40.048642 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b74379-4738-4f9d-968b-158eb409906a admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:40.050453 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-51b74379-4738-4f9d-968b-158eb409906a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:40.069654 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:40.131565 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b74379-4738-4f9d-968b-158eb409906a admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:40.135383 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e1e58-ed62-49d3-b688-f2fe2888a6f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:40.136011 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e1e58-ed62-49d3-b688-f2fe2888a6f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:40.136304 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e1e58-ed62-49d3-b688-f2fe2888a6f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:40.136580 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e1e58-ed62-49d3-b688-f2fe2888a6f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:40.145673 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e1e58-ed62-49d3-b688-f2fe2888a6f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:40.147093 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e1e58-ed62-49d3-b688-f2fe2888a6f1 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:40.157389 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1311/2615] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:33:40 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:33:40.548632 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560333a-f849-4103-909a-34b0f887c9a6 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:40.612993 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560333a-f849-4103-909a-34b0f887c9a6 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:40.617639 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a26460-08b7-4a11-b983-cd9f1469a301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:40.618290 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a26460-08b7-4a11-b983-cd9f1469a301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:40.618546 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a26460-08b7-4a11-b983-cd9f1469a301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:40.618841 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a26460-08b7-4a11-b983-cd9f1469a301 admin admin] PATH_INFO: `/v3/users/7a1497a034844d1a8f3127e4eda6b2eb` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:40.619954 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a26460-08b7-4a11-b983-cd9f1469a301 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a1497a034844d1a8f3127e4eda6b2eb)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:40.621902 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a26460-08b7-4a11-b983-cd9f1469a301 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:40.670360 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-19a26460-08b7-4a11-b983-cd9f1469a301 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a1497a034844d1a8f3127e4eda6b2eb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:40.670998 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-19a26460-08b7-4a11-b983-cd9f1469a301 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a1497a034844d1a8f3127e4eda6b2eb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:40.678218 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-19a26460-08b7-4a11-b983-cd9f1469a301 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a1497a034844d1a8f3127e4eda6b2eb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:40.678873 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-19a26460-08b7-4a11-b983-cd9f1469a301 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a1497a034844d1a8f3127e4eda6b2eb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:40.693152 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-19a26460-08b7-4a11-b983-cd9f1469a301 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a1497a034844d1a8f3127e4eda6b2eb'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:40.708241 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1305/2616] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:33:40 2022] DELETE /identity/v3/users/7a1497a034844d1a8f3127e4eda6b2eb => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:40.713612 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c0566-f707-4ce8-aebf-b37d33ab3f83 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:40.718446 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c0566-f707-4ce8-aebf-b37d33ab3f83 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:40.718755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c0566-f707-4ce8-aebf-b37d33ab3f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:40.737996 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-cb9c0566-f707-4ce8-aebf-b37d33ab3f83 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:40.739192 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-cb9c0566-f707-4ce8-aebf-b37d33ab3f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:40.791820 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a26460-08b7-4a11-b983-cd9f1469a301 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:40.793348 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-19a26460-08b7-4a11-b983-cd9f1469a301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:40.799646 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1312/2617] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:33:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:40.809848 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c0566-f707-4ce8-aebf-b37d33ab3f83 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:40.811174 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-cb9c0566-f707-4ce8-aebf-b37d33ab3f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:40.821881 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:40.856480 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a26460-08b7-4a11-b983-cd9f1469a301 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:40.860526 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745e1f5-2a94-4702-bbd0-0cfa8187bbde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:40.861158 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745e1f5-2a94-4702-bbd0-0cfa8187bbde service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:40.861442 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745e1f5-2a94-4702-bbd0-0cfa8187bbde service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:40.861716 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745e1f5-2a94-4702-bbd0-0cfa8187bbde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:40.863460 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4745e1f5-2a94-4702-bbd0-0cfa8187bbde service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:40.868838 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c0566-f707-4ce8-aebf-b37d33ab3f83 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:40.872457 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84090e-4aab-4e5b-b24c-c54ffa2da6a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:40.873067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84090e-4aab-4e5b-b24c-c54ffa2da6a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:40.873344 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84090e-4aab-4e5b-b24c-c54ffa2da6a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:40.873620 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac84090e-4aab-4e5b-b24c-c54ffa2da6a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:40.883339 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac84090e-4aab-4e5b-b24c-c54ffa2da6a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:40.884795 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac84090e-4aab-4e5b-b24c-c54ffa2da6a8 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:40.894869 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1313/2618] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:33:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 15:33:40.928295 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745e1f5-2a94-4702-bbd0-0cfa8187bbde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:40.930486 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4745e1f5-2a94-4702-bbd0-0cfa8187bbde service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:40.952240 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1306/2619] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:33:40 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:33:41.184585 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84090e-4aab-4e5b-b24c-c54ffa2da6a8 service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:41.186035 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ac84090e-4aab-4e5b-b24c-c54ffa2da6a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:41.199067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac84090e-4aab-4e5b-b24c-c54ffa2da6a8 service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:41.204233 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70474750-73e9-4486-8716-542f05565a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:41.204867 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70474750-73e9-4486-8716-542f05565a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:41.205145 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70474750-73e9-4486-8716-542f05565a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:41.205411 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70474750-73e9-4486-8716-542f05565a1d admin admin] PATH_INFO: `/v3/projects/6f4719c03f944ddf96046eae258fef2a` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:41.206550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70474750-73e9-4486-8716-542f05565a1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f4719c03f944ddf96046eae258fef2a)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:41.208456 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70474750-73e9-4486-8716-542f05565a1d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:41.254305 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:41.265846 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-70474750-73e9-4486-8716-542f05565a1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f4719c03f944ddf96046eae258fef2a', 'request_id': 'req-70474750-73e9-4486-8716-542f05565a1d'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:41.272393 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-70474750-73e9-4486-8716-542f05565a1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f4719c03f944ddf96046eae258fef2a', 'request_id': 'req-70474750-73e9-4486-8716-542f05565a1d'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:41.277912 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-70474750-73e9-4486-8716-542f05565a1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f4719c03f944ddf96046eae258fef2a', 'request_id': 'req-70474750-73e9-4486-8716-542f05565a1d'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:41.291143 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-70474750-73e9-4486-8716-542f05565a1d admin admin] The token cache is being invalidate because project 6f4719c03f944ddf96046eae258fef2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:33:41.291437 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-70474750-73e9-4486-8716-542f05565a1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:41.292067 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-70474750-73e9-4486-8716-542f05565a1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:41.293896 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1314/2620] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:33:41 2022] DELETE /identity/v3/projects/6f4719c03f944ddf96046eae258fef2a => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:41.297844 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745e1f5-2a94-4702-bbd0-0cfa8187bbde service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:41.310173 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745e1f5-2a94-4702-bbd0-0cfa8187bbde service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:41.368771 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f6fae-77f4-4762-ae33-c632cd05e345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:41.369533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f6fae-77f4-4762-ae33-c632cd05e345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:41.369821 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f6fae-77f4-4762-ae33-c632cd05e345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:41.370099 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f6fae-77f4-4762-ae33-c632cd05e345 admin admin] PATH_INFO: `/v3/users/b1015080afd6444ca4b458941d5dd9a1` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:41.371258 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f6fae-77f4-4762-ae33-c632cd05e345 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1015080afd6444ca4b458941d5dd9a1)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:41.373198 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f6fae-77f4-4762-ae33-c632cd05e345 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:41.423187 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f08f6fae-77f4-4762-ae33-c632cd05e345 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1015080afd6444ca4b458941d5dd9a1'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:41.423866 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f08f6fae-77f4-4762-ae33-c632cd05e345 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1015080afd6444ca4b458941d5dd9a1'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:41.431751 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f08f6fae-77f4-4762-ae33-c632cd05e345 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1015080afd6444ca4b458941d5dd9a1'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:41.432418 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f08f6fae-77f4-4762-ae33-c632cd05e345 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1015080afd6444ca4b458941d5dd9a1'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:41.444497 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-f08f6fae-77f4-4762-ae33-c632cd05e345 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1015080afd6444ca4b458941d5dd9a1'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:41.446569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:41.458850 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1307/2621] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:33:41 2022] DELETE /identity/v3/users/b1015080afd6444ca4b458941d5dd9a1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:33:41.782517 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70474750-73e9-4486-8716-542f05565a1d admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:41.784021 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-70474750-73e9-4486-8716-542f05565a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:41.796961 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70474750-73e9-4486-8716-542f05565a1d admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:41.857955 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987d3058-94dc-48ce-9583-bbbe5e9232d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:41.858590 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d3058-94dc-48ce-9583-bbbe5e9232d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:41.858868 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d3058-94dc-48ce-9583-bbbe5e9232d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:41.859140 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987d3058-94dc-48ce-9583-bbbe5e9232d1 admin admin] PATH_INFO: `/v3/projects/3f3ef6bb2ed74cff93327721ed420ffd` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:41.860368 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d3058-94dc-48ce-9583-bbbe5e9232d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f3ef6bb2ed74cff93327721ed420ffd)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:41.862233 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987d3058-94dc-48ce-9583-bbbe5e9232d1 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:41.907691 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-987d3058-94dc-48ce-9583-bbbe5e9232d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f3ef6bb2ed74cff93327721ed420ffd', 'request_id': 'req-987d3058-94dc-48ce-9583-bbbe5e9232d1'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:41.916324 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-987d3058-94dc-48ce-9583-bbbe5e9232d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f3ef6bb2ed74cff93327721ed420ffd', 'request_id': 'req-987d3058-94dc-48ce-9583-bbbe5e9232d1'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:41.923355 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-987d3058-94dc-48ce-9583-bbbe5e9232d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f3ef6bb2ed74cff93327721ed420ffd', 'request_id': 'req-987d3058-94dc-48ce-9583-bbbe5e9232d1'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:41.936549 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-987d3058-94dc-48ce-9583-bbbe5e9232d1 admin admin] The token cache is being invalidate because project 3f3ef6bb2ed74cff93327721ed420ffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:33:41.936837 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-987d3058-94dc-48ce-9583-bbbe5e9232d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:41.937450 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-987d3058-94dc-48ce-9583-bbbe5e9232d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:41.938971 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1315/2622] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:33:41 2022] DELETE /identity/v3/projects/3f3ef6bb2ed74cff93327721ed420ffd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:41.943949 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f81ab3-7cf0-4950-b599-54e013140713 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:41.944427 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f81ab3-7cf0-4950-b599-54e013140713 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:41.944520 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f81ab3-7cf0-4950-b599-54e013140713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:41.964309 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-83f81ab3-7cf0-4950-b599-54e013140713 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:41.965484 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-83f81ab3-7cf0-4950-b599-54e013140713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:42.025081 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1308/2623] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:33:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:42.032700 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9accca-35a6-4190-b32d-788fc8ade189 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:42.032990 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9accca-35a6-4190-b32d-788fc8ade189 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:42.033268 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9accca-35a6-4190-b32d-788fc8ade189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:42.054088 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-ed9accca-35a6-4190-b32d-788fc8ade189 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:42.055287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ed9accca-35a6-4190-b32d-788fc8ade189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:42.063232 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1316/2624] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:33:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:42.067346 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f81ab3-7cf0-4950-b599-54e013140713 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:42.077548 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f81ab3-7cf0-4950-b599-54e013140713 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:42.082188 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53aebb8-32c8-43bc-927a-1d991505e82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:42.082789 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53aebb8-32c8-43bc-927a-1d991505e82f admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:42.083073 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53aebb8-32c8-43bc-927a-1d991505e82f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:42.083352 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53aebb8-32c8-43bc-927a-1d991505e82f admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:42.084081 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53aebb8-32c8-43bc-927a-1d991505e82f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:33:42.084393 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53aebb8-32c8-43bc-927a-1d991505e82f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:42.086686 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53aebb8-32c8-43bc-927a-1d991505e82f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:42.098190 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1309/2625] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:33:42.102444 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9accca-35a6-4190-b32d-788fc8ade189 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:42.111486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9accca-35a6-4190-b32d-788fc8ade189 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:42.116185 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e82870-e55c-41f4-8bca-f07021508b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:42.116782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e82870-e55c-41f4-8bca-f07021508b3e admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:42.117061 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e82870-e55c-41f4-8bca-f07021508b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:42.117335 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e82870-e55c-41f4-8bca-f07021508b3e admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:42.117985 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e82870-e55c-41f4-8bca-f07021508b3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:42.119843 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e82870-e55c-41f4-8bca-f07021508b3e admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:42.146934 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1317/2626] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:33:42 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:33:42.151410 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53aebb8-32c8-43bc-927a-1d991505e82f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:42.161447 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53aebb8-32c8-43bc-927a-1d991505e82f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:42.217521 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fae307-8594-43a2-aa87-833e20d2c4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:42.218126 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fae307-8594-43a2-aa87-833e20d2c4fa admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:42.218411 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fae307-8594-43a2-aa87-833e20d2c4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:42.218690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fae307-8594-43a2-aa87-833e20d2c4fa admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:42.219359 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fae307-8594-43a2-aa87-833e20d2c4fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:42.221321 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fae307-8594-43a2-aa87-833e20d2c4fa admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:42.242330 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1310/2627] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:33:42 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:33:42.246505 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e82870-e55c-41f4-8bca-f07021508b3e admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:42.256785 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e82870-e55c-41f4-8bca-f07021508b3e admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:42.262246 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385bac0-ca23-4d14-9c9e-baeff978ff9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:42.262855 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385bac0-ca23-4d14-9c9e-baeff978ff9b admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:42.263163 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385bac0-ca23-4d14-9c9e-baeff978ff9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:42.263440 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385bac0-ca23-4d14-9c9e-baeff978ff9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:42.264177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385bac0-ca23-4d14-9c9e-baeff978ff9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:42.265965 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7385bac0-ca23-4d14-9c9e-baeff978ff9b admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:42.276714 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1318/2628] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:33:42.280376 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fae307-8594-43a2-aa87-833e20d2c4fa admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:42.290352 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fae307-8594-43a2-aa87-833e20d2c4fa admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:42.296656 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03177f28-c941-4032-98d6-fd4b78aa57de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:42.297481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03177f28-c941-4032-98d6-fd4b78aa57de admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:42.297764 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03177f28-c941-4032-98d6-fd4b78aa57de admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:42.298039 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03177f28-c941-4032-98d6-fd4b78aa57de admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:42.298735 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03177f28-c941-4032-98d6-fd4b78aa57de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:42.300336 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03177f28-c941-4032-98d6-fd4b78aa57de admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:42.311534 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1311/2629] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:33:42.315578 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385bac0-ca23-4d14-9c9e-baeff978ff9b admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:42.326833 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7385bac0-ca23-4d14-9c9e-baeff978ff9b admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:42.332050 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af27d4-e49e-4f2c-ba93-5372781b852f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:42.332707 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af27d4-e49e-4f2c-ba93-5372781b852f admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:42.332984 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af27d4-e49e-4f2c-ba93-5372781b852f admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:42.333256 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2af27d4-e49e-4f2c-ba93-5372781b852f admin admin] PATH_INFO: `/v3/projects/6caba90b682c4da781d1c12a3a21492a/users/2b99d4624c3044ffaedd85d1ce50e01d/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:42.344474 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:42.349030 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af27d4-e49e-4f2c-ba93-5372781b852f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6caba90b682c4da781d1c12a3a21492a, user_id=2b99d4624c3044ffaedd85d1ce50e01d, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:42.352146 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2af27d4-e49e-4f2c-ba93-5372781b852f admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:42.364897 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1319/2630] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:33:42 2022] PUT /identity/v3/projects/6caba90b682c4da781d1c12a3a21492a/users/2b99d4624c3044ffaedd85d1ce50e01d/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:33:42.375913 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58fa90-229b-49bb-88d2-ef64bdf74dd4 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:42.376237 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58fa90-229b-49bb-88d2-ef64bdf74dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:42.376518 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58fa90-229b-49bb-88d2-ef64bdf74dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:42.403541 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-3e58fa90-229b-49bb-88d2-ef64bdf74dd4 None None] MFA Rules not processed for user `2b99d4624c3044ffaedd85d1ce50e01d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:42.404790 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-3e58fa90-229b-49bb-88d2-ef64bdf74dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:42.448906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:42.469322 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1312/2631] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:33:42 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:42.473767 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af27d4-e49e-4f2c-ba93-5372781b852f admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:42.534357 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2af27d4-e49e-4f2c-ba93-5372781b852f admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:42.539033 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c2476-0328-4fcc-91dc-6c587d4eac4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:42.539668 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c2476-0328-4fcc-91dc-6c587d4eac4e admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:42.539950 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c2476-0328-4fcc-91dc-6c587d4eac4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:42.540274 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c2476-0328-4fcc-91dc-6c587d4eac4e admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:42.541200 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c2476-0328-4fcc-91dc-6c587d4eac4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:42.543118 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c2476-0328-4fcc-91dc-6c587d4eac4e admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:42.569035 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1320/2632] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:33:42 2022] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:33:42.573776 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58fa90-229b-49bb-88d2-ef64bdf74dd4 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:42.584593 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58fa90-229b-49bb-88d2-ef64bdf74dd4 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:42.641204 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f78dc8-e3ac-4b15-8d15-ee1da0b099da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:42.641820 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f78dc8-e3ac-4b15-8d15-ee1da0b099da admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:42.642103 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f78dc8-e3ac-4b15-8d15-ee1da0b099da admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:42.642377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f78dc8-e3ac-4b15-8d15-ee1da0b099da admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:42.643031 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f78dc8-e3ac-4b15-8d15-ee1da0b099da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:42.644968 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f78dc8-e3ac-4b15-8d15-ee1da0b099da admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:42.666140 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1313/2633] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:33:42 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:33:42.670405 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c2476-0328-4fcc-91dc-6c587d4eac4e admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:42.681186 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c2476-0328-4fcc-91dc-6c587d4eac4e admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:42.685753 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055445b9-0c9a-4785-b5a2-26d59115f01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:42.686351 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055445b9-0c9a-4785-b5a2-26d59115f01d admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:42.686631 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055445b9-0c9a-4785-b5a2-26d59115f01d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:42.686901 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055445b9-0c9a-4785-b5a2-26d59115f01d admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:42.687586 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055445b9-0c9a-4785-b5a2-26d59115f01d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:42.689198 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055445b9-0c9a-4785-b5a2-26d59115f01d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:42.699568 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1321/2634] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:33:42.703421 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f78dc8-e3ac-4b15-8d15-ee1da0b099da admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:42.713205 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f78dc8-e3ac-4b15-8d15-ee1da0b099da admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:42.717823 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d710a-0bcb-4403-b59a-7b8cd0408877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:42.718469 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d710a-0bcb-4403-b59a-7b8cd0408877 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:42.718751 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d710a-0bcb-4403-b59a-7b8cd0408877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:42.719026 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d710a-0bcb-4403-b59a-7b8cd0408877 admin admin] PATH_INFO: `/v3/projects/a6b926077316426b99e9843f1d01accd/users/8f35c915ef534832a64d11600e9f2e78/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:42.734033 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d710a-0bcb-4403-b59a-7b8cd0408877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6b926077316426b99e9843f1d01accd, user_id=8f35c915ef534832a64d11600e9f2e78, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:42.736703 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d710a-0bcb-4403-b59a-7b8cd0408877 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:42.750154 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1314/2635] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:33:42 2022] PUT /identity/v3/projects/a6b926077316426b99e9843f1d01accd/users/8f35c915ef534832a64d11600e9f2e78/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:42.754019 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055445b9-0c9a-4785-b5a2-26d59115f01d admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:42.763858 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055445b9-0c9a-4785-b5a2-26d59115f01d admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:42.819291 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524237d1-ec6a-465a-a9fe-9be0d42d940e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:42.819977 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524237d1-ec6a-465a-a9fe-9be0d42d940e admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:42.820215 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524237d1-ec6a-465a-a9fe-9be0d42d940e admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:42.820492 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524237d1-ec6a-465a-a9fe-9be0d42d940e admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:42.821174 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524237d1-ec6a-465a-a9fe-9be0d42d940e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:42.822742 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524237d1-ec6a-465a-a9fe-9be0d42d940e admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:42.832281 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1322/2636] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:33:42 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:33:42.836434 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d710a-0bcb-4403-b59a-7b8cd0408877 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:42.846522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d710a-0bcb-4403-b59a-7b8cd0408877 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:42.851586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204a171-5f4a-4a9d-9be7-1a6dfc1f65e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:42.852264 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204a171-5f4a-4a9d-9be7-1a6dfc1f65e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:42.852544 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204a171-5f4a-4a9d-9be7-1a6dfc1f65e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:42.852818 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204a171-5f4a-4a9d-9be7-1a6dfc1f65e0 admin admin] PATH_INFO: `/v3/projects/a6b926077316426b99e9843f1d01accd/users/8f35c915ef534832a64d11600e9f2e78/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:42.854733 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204a171-5f4a-4a9d-9be7-1a6dfc1f65e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6b926077316426b99e9843f1d01accd, user_id=8f35c915ef534832a64d11600e9f2e78, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:42.857373 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204a171-5f4a-4a9d-9be7-1a6dfc1f65e0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:42.868407 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1315/2637] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:33:42 2022] PUT /identity/v3/projects/a6b926077316426b99e9843f1d01accd/users/8f35c915ef534832a64d11600e9f2e78/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:42.880224 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95692a01-3906-4d02-90ba-bf954c4f3cac None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:42.880587 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95692a01-3906-4d02-90ba-bf954c4f3cac None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:42.880943 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95692a01-3906-4d02-90ba-bf954c4f3cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:42.910653 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-95692a01-3906-4d02-90ba-bf954c4f3cac None None] MFA Rules not processed for user `8f35c915ef534832a64d11600e9f2e78`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:42.911915 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-95692a01-3906-4d02-90ba-bf954c4f3cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:42.958742 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:42.984369 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1323/2638] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:33:42 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:42.996604 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204a171-5f4a-4a9d-9be7-1a6dfc1f65e0 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:42.998399 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2204a171-5f4a-4a9d-9be7-1a6dfc1f65e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:43.061886 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204a171-5f4a-4a9d-9be7-1a6dfc1f65e0 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:43.065893 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcd095-59ae-4408-917a-bd93945865c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:43.066684 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcd095-59ae-4408-917a-bd93945865c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:43.066971 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcd095-59ae-4408-917a-bd93945865c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:43.067245 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfcd095-59ae-4408-917a-bd93945865c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:43.077352 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfcd095-59ae-4408-917a-bd93945865c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:43.078716 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfcd095-59ae-4408-917a-bd93945865c1 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:43.088314 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1316/2639] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:33:42 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:33:43.161972 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95692a01-3906-4d02-90ba-bf954c4f3cac None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:43.172269 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95692a01-3906-4d02-90ba-bf954c4f3cac None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:43.175940 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feac523-d8ba-4624-930f-8dbd19bad073 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:43.176581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feac523-d8ba-4624-930f-8dbd19bad073 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:43.176881 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feac523-d8ba-4624-930f-8dbd19bad073 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:43.177141 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feac523-d8ba-4624-930f-8dbd19bad073 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:43.232855 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feac523-d8ba-4624-930f-8dbd19bad073 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:43.234281 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feac523-d8ba-4624-930f-8dbd19bad073 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:43.243820 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1324/2640] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:33:43 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:33:50.195363 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcd095-59ae-4408-917a-bd93945865c1 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:50.241640 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:50.269690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfcd095-59ae-4408-917a-bd93945865c1 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:50.275906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545e60a-68e4-4adb-a783-c14719e9c6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:50.276700 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545e60a-68e4-4adb-a783-c14719e9c6ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:50.276982 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545e60a-68e4-4adb-a783-c14719e9c6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:50.277274 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545e60a-68e4-4adb-a783-c14719e9c6ff admin admin] PATH_INFO: `/v3/users/2b99d4624c3044ffaedd85d1ce50e01d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:50.278441 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d545e60a-68e4-4adb-a783-c14719e9c6ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b99d4624c3044ffaedd85d1ce50e01d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:50.280390 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d545e60a-68e4-4adb-a783-c14719e9c6ff admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:50.468175 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d545e60a-68e4-4adb-a783-c14719e9c6ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b99d4624c3044ffaedd85d1ce50e01d'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:50.468830 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d545e60a-68e4-4adb-a783-c14719e9c6ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b99d4624c3044ffaedd85d1ce50e01d'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:50.477082 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d545e60a-68e4-4adb-a783-c14719e9c6ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b99d4624c3044ffaedd85d1ce50e01d'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:50.477702 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d545e60a-68e4-4adb-a783-c14719e9c6ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b99d4624c3044ffaedd85d1ce50e01d'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:50.491318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d545e60a-68e4-4adb-a783-c14719e9c6ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b99d4624c3044ffaedd85d1ce50e01d'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:50.505195 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1317/2641] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:33:50 2022] DELETE /identity/v3/users/2b99d4624c3044ffaedd85d1ce50e01d => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:50.510245 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742db77-1aae-493a-a3dd-54edaa680251 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:50.510712 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742db77-1aae-493a-a3dd-54edaa680251 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:50.510826 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6742db77-1aae-493a-a3dd-54edaa680251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:50.531736 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-6742db77-1aae-493a-a3dd-54edaa680251 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:50.533208 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6742db77-1aae-493a-a3dd-54edaa680251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:50.629165 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1325/2642] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:33:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:33:50.632740 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545e60a-68e4-4adb-a783-c14719e9c6ff admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:50.634861 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d545e60a-68e4-4adb-a783-c14719e9c6ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:50.693327 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545e60a-68e4-4adb-a783-c14719e9c6ff admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:50.698387 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b628b-0cae-4679-984c-78fa7da0cd1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:50.699012 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b628b-0cae-4679-984c-78fa7da0cd1f service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:50.699289 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b628b-0cae-4679-984c-78fa7da0cd1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:50.699558 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b628b-0cae-4679-984c-78fa7da0cd1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:50.709174 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b628b-0cae-4679-984c-78fa7da0cd1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:50.710583 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b628b-0cae-4679-984c-78fa7da0cd1f service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:50.719915 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1318/2643] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:33:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:33:50.982948 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742db77-1aae-493a-a3dd-54edaa680251 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:50.984530 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6742db77-1aae-493a-a3dd-54edaa680251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:50.998951 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6742db77-1aae-493a-a3dd-54edaa680251 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:51.003707 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478d642-61aa-4380-a9e1-c91b0f1d69a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:51.004487 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478d642-61aa-4380-a9e1-c91b0f1d69a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:51.004836 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478d642-61aa-4380-a9e1-c91b0f1d69a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:51.005312 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478d642-61aa-4380-a9e1-c91b0f1d69a2 admin admin] PATH_INFO: `/v3/projects/6caba90b682c4da781d1c12a3a21492a` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:51.006557 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478d642-61aa-4380-a9e1-c91b0f1d69a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6caba90b682c4da781d1c12a3a21492a)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:51.009183 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3478d642-61aa-4380-a9e1-c91b0f1d69a2 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:51.057269 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-3478d642-61aa-4380-a9e1-c91b0f1d69a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6caba90b682c4da781d1c12a3a21492a', 'request_id': 'req-3478d642-61aa-4380-a9e1-c91b0f1d69a2'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:51.063453 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-3478d642-61aa-4380-a9e1-c91b0f1d69a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6caba90b682c4da781d1c12a3a21492a', 'request_id': 'req-3478d642-61aa-4380-a9e1-c91b0f1d69a2'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:51.069196 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-3478d642-61aa-4380-a9e1-c91b0f1d69a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6caba90b682c4da781d1c12a3a21492a', 'request_id': 'req-3478d642-61aa-4380-a9e1-c91b0f1d69a2'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:51.082155 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-3478d642-61aa-4380-a9e1-c91b0f1d69a2 admin admin] The token cache is being invalidate because project 6caba90b682c4da781d1c12a3a21492a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:33:51.082459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-3478d642-61aa-4380-a9e1-c91b0f1d69a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:51.083087 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-3478d642-61aa-4380-a9e1-c91b0f1d69a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:51.084687 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1326/2644] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:33:50 2022] DELETE /identity/v3/projects/6caba90b682c4da781d1c12a3a21492a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:51.088679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b628b-0cae-4679-984c-78fa7da0cd1f service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:51.098119 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b628b-0cae-4679-984c-78fa7da0cd1f service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:51.154436 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0822ef89-02ee-4729-b937-db9278f03420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:51.154982 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822ef89-02ee-4729-b937-db9278f03420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:51.155264 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822ef89-02ee-4729-b937-db9278f03420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:51.155537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0822ef89-02ee-4729-b937-db9278f03420 admin admin] PATH_INFO: `/v3/users/8f35c915ef534832a64d11600e9f2e78` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:51.156813 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0822ef89-02ee-4729-b937-db9278f03420 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f35c915ef534832a64d11600e9f2e78)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:51.158704 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0822ef89-02ee-4729-b937-db9278f03420 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:51.163166 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:51.206594 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0822ef89-02ee-4729-b937-db9278f03420 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f35c915ef534832a64d11600e9f2e78'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:51.207233 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0822ef89-02ee-4729-b937-db9278f03420 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f35c915ef534832a64d11600e9f2e78'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:51.214491 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0822ef89-02ee-4729-b937-db9278f03420 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f35c915ef534832a64d11600e9f2e78'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:51.215112 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0822ef89-02ee-4729-b937-db9278f03420 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f35c915ef534832a64d11600e9f2e78'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:51.226566 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-0822ef89-02ee-4729-b937-db9278f03420 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f35c915ef534832a64d11600e9f2e78'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:51.238994 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1319/2645] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:33:51 2022] DELETE /identity/v3/users/8f35c915ef534832a64d11600e9f2e78 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:51.508285 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478d642-61aa-4380-a9e1-c91b0f1d69a2 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:51.509746 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-3478d642-61aa-4380-a9e1-c91b0f1d69a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:51.522820 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478d642-61aa-4380-a9e1-c91b0f1d69a2 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:51.530538 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:51.587506 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a0e53-eb9f-44e1-b24d-7863bf17bb4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:51.588237 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a0e53-eb9f-44e1-b24d-7863bf17bb4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:51.588517 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a0e53-eb9f-44e1-b24d-7863bf17bb4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:51.588797 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a0e53-eb9f-44e1-b24d-7863bf17bb4b admin admin] PATH_INFO: `/v3/projects/a6b926077316426b99e9843f1d01accd` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:51.589974 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a0e53-eb9f-44e1-b24d-7863bf17bb4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6b926077316426b99e9843f1d01accd)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:51.591857 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a0e53-eb9f-44e1-b24d-7863bf17bb4b admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:51.638142 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ea8a0e53-eb9f-44e1-b24d-7863bf17bb4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6b926077316426b99e9843f1d01accd', 'request_id': 'req-ea8a0e53-eb9f-44e1-b24d-7863bf17bb4b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:51.644338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ea8a0e53-eb9f-44e1-b24d-7863bf17bb4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6b926077316426b99e9843f1d01accd', 'request_id': 'req-ea8a0e53-eb9f-44e1-b24d-7863bf17bb4b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:51.650317 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ea8a0e53-eb9f-44e1-b24d-7863bf17bb4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6b926077316426b99e9843f1d01accd', 'request_id': 'req-ea8a0e53-eb9f-44e1-b24d-7863bf17bb4b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:51.662779 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ea8a0e53-eb9f-44e1-b24d-7863bf17bb4b admin admin] The token cache is being invalidate because project a6b926077316426b99e9843f1d01accd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:33:51.663065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ea8a0e53-eb9f-44e1-b24d-7863bf17bb4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:51.663798 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-ea8a0e53-eb9f-44e1-b24d-7863bf17bb4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:51.665334 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1327/2646] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:33:51 2022] DELETE /identity/v3/projects/a6b926077316426b99e9843f1d01accd => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:51.670412 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c46201-516b-4c70-af06-9330946aa71f None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:51.670695 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c46201-516b-4c70-af06-9330946aa71f None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:51.670984 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c46201-516b-4c70-af06-9330946aa71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:51.697038 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-44c46201-516b-4c70-af06-9330946aa71f None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:51.698216 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-44c46201-516b-4c70-af06-9330946aa71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:51.758783 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1320/2647] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:33:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:51.766441 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab00145-e83b-4225-9313-99b6641614bc None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:51.766723 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab00145-e83b-4225-9313-99b6641614bc None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:51.767012 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab00145-e83b-4225-9313-99b6641614bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:51.787116 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-5ab00145-e83b-4225-9313-99b6641614bc None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:51.788416 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5ab00145-e83b-4225-9313-99b6641614bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:51.796878 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1328/2648] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:33:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:51.800956 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c46201-516b-4c70-af06-9330946aa71f None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:51.810612 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c46201-516b-4c70-af06-9330946aa71f None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:51.815167 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ab901-d3f4-4990-8fb4-0974e235ceb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:51.815781 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ab901-d3f4-4990-8fb4-0974e235ceb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:51.816097 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ab901-d3f4-4990-8fb4-0974e235ceb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:51.816372 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ab901-d3f4-4990-8fb4-0974e235ceb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:51.817064 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0ab901-d3f4-4990-8fb4-0974e235ceb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:33:51.817366 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0ab901-d3f4-4990-8fb4-0974e235ceb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:51.818941 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0ab901-d3f4-4990-8fb4-0974e235ceb1 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:51.831159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1321/2649] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:33:51.835715 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab00145-e83b-4225-9313-99b6641614bc None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:51.845731 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab00145-e83b-4225-9313-99b6641614bc None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:51.850499 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0700e7-2375-4c63-b810-3a9a76be9800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:51.851105 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0700e7-2375-4c63-b810-3a9a76be9800 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:51.851391 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0700e7-2375-4c63-b810-3a9a76be9800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:51.851703 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0700e7-2375-4c63-b810-3a9a76be9800 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:51.852400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0700e7-2375-4c63-b810-3a9a76be9800 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:51.854314 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0700e7-2375-4c63-b810-3a9a76be9800 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:51.884079 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1329/2650] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:33:51 2022] POST /identity/v3/projects => generated 389 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:33:51.888477 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ab901-d3f4-4990-8fb4-0974e235ceb1 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:51.905630 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ab901-d3f4-4990-8fb4-0974e235ceb1 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:51.971441 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9e9cc-547f-431c-88ce-38f5f868db8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:51.971973 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9e9cc-547f-431c-88ce-38f5f868db8f admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:51.972283 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9e9cc-547f-431c-88ce-38f5f868db8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:51.972559 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9e9cc-547f-431c-88ce-38f5f868db8f admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:51.973221 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced9e9cc-547f-431c-88ce-38f5f868db8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:51.975109 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced9e9cc-547f-431c-88ce-38f5f868db8f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:51.991851 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:51.998155 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1322/2651] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:33:51 2022] POST /identity/v3/users => generated 295 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:33:52.002460 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0700e7-2375-4c63-b810-3a9a76be9800 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:52.014171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0700e7-2375-4c63-b810-3a9a76be9800 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:52.018907 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff344c81-9142-4800-9797-668cf2440dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:52.019541 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff344c81-9142-4800-9797-668cf2440dee admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:52.019836 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff344c81-9142-4800-9797-668cf2440dee admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:52.020164 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff344c81-9142-4800-9797-668cf2440dee admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:52.020836 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff344c81-9142-4800-9797-668cf2440dee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:52.022550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff344c81-9142-4800-9797-668cf2440dee admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:52.034202 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1330/2652] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:33:52.038128 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9e9cc-547f-431c-88ce-38f5f868db8f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:52.048585 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9e9cc-547f-431c-88ce-38f5f868db8f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:52.053230 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a255f8b1-42e7-4fb2-96fe-7f2d70e0bd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:52.053819 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255f8b1-42e7-4fb2-96fe-7f2d70e0bd47 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:52.054102 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255f8b1-42e7-4fb2-96fe-7f2d70e0bd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:52.054376 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a255f8b1-42e7-4fb2-96fe-7f2d70e0bd47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:52.055565 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255f8b1-42e7-4fb2-96fe-7f2d70e0bd47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:52.057156 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a255f8b1-42e7-4fb2-96fe-7f2d70e0bd47 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:52.066895 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1323/2653] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 15:33:52.071442 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff344c81-9142-4800-9797-668cf2440dee admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:52.081792 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff344c81-9142-4800-9797-668cf2440dee admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:52.086439 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ed668-7624-4a46-90ba-713675cbc319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:52.087093 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ed668-7624-4a46-90ba-713675cbc319 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:52.087375 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ed668-7624-4a46-90ba-713675cbc319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:52.087650 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695ed668-7624-4a46-90ba-713675cbc319 admin admin] PATH_INFO: `/v3/projects/d0d209f284d7453b9c52b1202cf143ba/users/5811abaf7b6f4c4481c439ffe888ff7d/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:52.102724 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ed668-7624-4a46-90ba-713675cbc319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0d209f284d7453b9c52b1202cf143ba, user_id=5811abaf7b6f4c4481c439ffe888ff7d, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:52.105848 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695ed668-7624-4a46-90ba-713675cbc319 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:52.119575 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1331/2654] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:33:52 2022] PUT /identity/v3/projects/d0d209f284d7453b9c52b1202cf143ba/users/5811abaf7b6f4c4481c439ffe888ff7d/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:52.130036 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f740f-34e2-4102-b72a-90d2512037b2 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:52.130322 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f740f-34e2-4102-b72a-90d2512037b2 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:52.130617 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f740f-34e2-4102-b72a-90d2512037b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:52.158252 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-656f740f-34e2-4102-b72a-90d2512037b2 None None] MFA Rules not processed for user `5811abaf7b6f4c4481c439ffe888ff7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:52.159472 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-656f740f-34e2-4102-b72a-90d2512037b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:52.222629 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1324/2655] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:33:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:52.227002 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ed668-7624-4a46-90ba-713675cbc319 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:52.260929 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:52.288520 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695ed668-7624-4a46-90ba-713675cbc319 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:52.293378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0189fa-fb07-408f-ad34-431ec0d0e2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:52.293979 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0189fa-fb07-408f-ad34-431ec0d0e2b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:52.294261 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0189fa-fb07-408f-ad34-431ec0d0e2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:52.294532 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0189fa-fb07-408f-ad34-431ec0d0e2b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:52.295181 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0189fa-fb07-408f-ad34-431ec0d0e2b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:52.297098 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0189fa-fb07-408f-ad34-431ec0d0e2b8 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:52.323120 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1332/2656] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:33:52 2022] POST /identity/v3/projects => generated 389 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:33:52.327267 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f740f-34e2-4102-b72a-90d2512037b2 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:52.337874 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f740f-34e2-4102-b72a-90d2512037b2 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:52.396186 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761e561-c463-4c7c-9f43-47f7bf53a059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:52.396796 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761e561-c463-4c7c-9f43-47f7bf53a059 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:52.397095 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761e561-c463-4c7c-9f43-47f7bf53a059 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:52.397365 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761e561-c463-4c7c-9f43-47f7bf53a059 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:52.398025 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761e561-c463-4c7c-9f43-47f7bf53a059 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:52.399925 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e761e561-c463-4c7c-9f43-47f7bf53a059 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:52.421843 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1325/2657] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:33:52 2022] POST /identity/v3/users => generated 301 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:33:52.425850 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0189fa-fb07-408f-ad34-431ec0d0e2b8 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:52.436866 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0189fa-fb07-408f-ad34-431ec0d0e2b8 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:52.441467 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09d864-a031-48b2-9ec6-81bee8c9cc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:52.442069 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09d864-a031-48b2-9ec6-81bee8c9cc0d admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:52.442352 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09d864-a031-48b2-9ec6-81bee8c9cc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:52.442626 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09d864-a031-48b2-9ec6-81bee8c9cc0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:52.443316 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09d864-a031-48b2-9ec6-81bee8c9cc0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:52.444941 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09d864-a031-48b2-9ec6-81bee8c9cc0d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:52.455307 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1333/2658] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:33:52.459217 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761e561-c463-4c7c-9f43-47f7bf53a059 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:52.468953 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e761e561-c463-4c7c-9f43-47f7bf53a059 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:52.473458 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4016a-0cad-46d2-8788-1b36ff4063fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:52.474038 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4016a-0cad-46d2-8788-1b36ff4063fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:52.474318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4016a-0cad-46d2-8788-1b36ff4063fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:52.474594 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e4016a-0cad-46d2-8788-1b36ff4063fe admin admin] PATH_INFO: `/v3/projects/79e334fcb7d34faba7ce4a8169ac9b18/users/6ef9e863adab41ca84bdf45a7e88d92a/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:52.490161 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4016a-0cad-46d2-8788-1b36ff4063fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=79e334fcb7d34faba7ce4a8169ac9b18, user_id=6ef9e863adab41ca84bdf45a7e88d92a, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:52.493594 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e4016a-0cad-46d2-8788-1b36ff4063fe admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:52.506475 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1326/2659] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:33:52 2022] PUT /identity/v3/projects/79e334fcb7d34faba7ce4a8169ac9b18/users/6ef9e863adab41ca84bdf45a7e88d92a/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:52.510316 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09d864-a031-48b2-9ec6-81bee8c9cc0d admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:52.520400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09d864-a031-48b2-9ec6-81bee8c9cc0d admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:52.576601 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76481fa9-8543-48f3-a8bf-65aa69a65599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:52.577238 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76481fa9-8543-48f3-a8bf-65aa69a65599 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:52.577523 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76481fa9-8543-48f3-a8bf-65aa69a65599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:52.577790 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76481fa9-8543-48f3-a8bf-65aa69a65599 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:52.578485 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76481fa9-8543-48f3-a8bf-65aa69a65599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:52.580091 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76481fa9-8543-48f3-a8bf-65aa69a65599 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:52.591446 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1334/2660] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:33:52 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:33:52.595262 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4016a-0cad-46d2-8788-1b36ff4063fe admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:52.605868 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e4016a-0cad-46d2-8788-1b36ff4063fe admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:52.610325 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6815b4c-b1d1-4709-8890-2d14c2362022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:52.610965 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6815b4c-b1d1-4709-8890-2d14c2362022 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:52.611240 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6815b4c-b1d1-4709-8890-2d14c2362022 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:52.611532 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6815b4c-b1d1-4709-8890-2d14c2362022 admin admin] PATH_INFO: `/v3/projects/79e334fcb7d34faba7ce4a8169ac9b18/users/6ef9e863adab41ca84bdf45a7e88d92a/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:52.613570 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6815b4c-b1d1-4709-8890-2d14c2362022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79e334fcb7d34faba7ce4a8169ac9b18, user_id=6ef9e863adab41ca84bdf45a7e88d92a, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:52.616185 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6815b4c-b1d1-4709-8890-2d14c2362022 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:52.627037 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1327/2661] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:33:52 2022] PUT /identity/v3/projects/79e334fcb7d34faba7ce4a8169ac9b18/users/6ef9e863adab41ca84bdf45a7e88d92a/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:52.639318 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5027d02-4c0e-48b8-8815-4de082665d00 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:52.639606 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5027d02-4c0e-48b8-8815-4de082665d00 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:52.639888 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5027d02-4c0e-48b8-8815-4de082665d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:52.669874 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-c5027d02-4c0e-48b8-8815-4de082665d00 None None] MFA Rules not processed for user `6ef9e863adab41ca84bdf45a7e88d92a`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:52.671095 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-c5027d02-4c0e-48b8-8815-4de082665d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:52.739842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1335/2662] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:33:52 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:52.750429 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6815b4c-b1d1-4709-8890-2d14c2362022 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:52.752139 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a6815b4c-b1d1-4709-8890-2d14c2362022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:52.785930 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:52.810209 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6815b4c-b1d1-4709-8890-2d14c2362022 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:52.813768 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec70b3-09ec-4f91-a21d-34838b6aa34f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:52.814360 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec70b3-09ec-4f91-a21d-34838b6aa34f service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:52.814637 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec70b3-09ec-4f91-a21d-34838b6aa34f service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:52.814904 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec70b3-09ec-4f91-a21d-34838b6aa34f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:52.823569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec70b3-09ec-4f91-a21d-34838b6aa34f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:52.824995 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec70b3-09ec-4f91-a21d-34838b6aa34f service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:52.834160 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1328/2663] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:33:52 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 15:33:52.974399 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5027d02-4c0e-48b8-8815-4de082665d00 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:53.006539 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:53.043792 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5027d02-4c0e-48b8-8815-4de082665d00 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:53.048317 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a6d61-2b63-4128-aeb1-8195f3cdf3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:53.048958 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a6d61-2b63-4128-aeb1-8195f3cdf3df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:53.049244 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a6d61-2b63-4128-aeb1-8195f3cdf3df admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:53.049513 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188a6d61-2b63-4128-aeb1-8195f3cdf3df admin admin] PATH_INFO: `/v3/users/5811abaf7b6f4c4481c439ffe888ff7d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:53.050663 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a6d61-2b63-4128-aeb1-8195f3cdf3df admin admin] RBAC: Authorizing `identity:delete_user(user_id=5811abaf7b6f4c4481c439ffe888ff7d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:53.052603 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188a6d61-2b63-4128-aeb1-8195f3cdf3df admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:53.102719 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-188a6d61-2b63-4128-aeb1-8195f3cdf3df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5811abaf7b6f4c4481c439ffe888ff7d'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:53.103377 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-188a6d61-2b63-4128-aeb1-8195f3cdf3df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5811abaf7b6f4c4481c439ffe888ff7d'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:53.111097 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-188a6d61-2b63-4128-aeb1-8195f3cdf3df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5811abaf7b6f4c4481c439ffe888ff7d'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:53.119181 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-188a6d61-2b63-4128-aeb1-8195f3cdf3df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5811abaf7b6f4c4481c439ffe888ff7d'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:53.132400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-188a6d61-2b63-4128-aeb1-8195f3cdf3df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5811abaf7b6f4c4481c439ffe888ff7d'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:53.140074 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1336/2664] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:33:52 2022] DELETE /identity/v3/users/5811abaf7b6f4c4481c439ffe888ff7d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:53.144511 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80242be6-64f3-4ebe-91b6-b191a4e6de32 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:53.144858 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80242be6-64f3-4ebe-91b6-b191a4e6de32 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:53.145286 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80242be6-64f3-4ebe-91b6-b191a4e6de32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:53.165229 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-80242be6-64f3-4ebe-91b6-b191a4e6de32 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:53.166822 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-80242be6-64f3-4ebe-91b6-b191a4e6de32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:53.231291 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1329/2665] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:33:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:53.241386 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a6d61-2b63-4128-aeb1-8195f3cdf3df admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:53.242910 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-188a6d61-2b63-4128-aeb1-8195f3cdf3df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:53.305963 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188a6d61-2b63-4128-aeb1-8195f3cdf3df admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:53.309510 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b20d73-3aeb-47e5-864b-8d82dff385de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:53.310148 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b20d73-3aeb-47e5-864b-8d82dff385de service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:53.310424 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b20d73-3aeb-47e5-864b-8d82dff385de service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:53.310691 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b20d73-3aeb-47e5-864b-8d82dff385de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:53.319494 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b20d73-3aeb-47e5-864b-8d82dff385de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:53.321492 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b20d73-3aeb-47e5-864b-8d82dff385de service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:53.330871 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1337/2666] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:33:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:33:53.602551 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80242be6-64f3-4ebe-91b6-b191a4e6de32 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:53.603976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-80242be6-64f3-4ebe-91b6-b191a4e6de32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:53.617297 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80242be6-64f3-4ebe-91b6-b191a4e6de32 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:53.622534 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fe47d-26d5-4bb0-8625-55e3b512c4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:53.623174 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fe47d-26d5-4bb0-8625-55e3b512c4c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:53.623458 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fe47d-26d5-4bb0-8625-55e3b512c4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:53.623733 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3fe47d-26d5-4bb0-8625-55e3b512c4c6 admin admin] PATH_INFO: `/v3/projects/d0d209f284d7453b9c52b1202cf143ba` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:53.624934 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3fe47d-26d5-4bb0-8625-55e3b512c4c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0d209f284d7453b9c52b1202cf143ba)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:53.626817 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3fe47d-26d5-4bb0-8625-55e3b512c4c6 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:53.673218 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8c3fe47d-26d5-4bb0-8625-55e3b512c4c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0d209f284d7453b9c52b1202cf143ba', 'request_id': 'req-8c3fe47d-26d5-4bb0-8625-55e3b512c4c6'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:53.679620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8c3fe47d-26d5-4bb0-8625-55e3b512c4c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0d209f284d7453b9c52b1202cf143ba', 'request_id': 'req-8c3fe47d-26d5-4bb0-8625-55e3b512c4c6'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:53.686260 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8c3fe47d-26d5-4bb0-8625-55e3b512c4c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0d209f284d7453b9c52b1202cf143ba', 'request_id': 'req-8c3fe47d-26d5-4bb0-8625-55e3b512c4c6'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:53.698791 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8c3fe47d-26d5-4bb0-8625-55e3b512c4c6 admin admin] The token cache is being invalidate because project d0d209f284d7453b9c52b1202cf143ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:33:53.699074 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8c3fe47d-26d5-4bb0-8625-55e3b512c4c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:53.699688 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8c3fe47d-26d5-4bb0-8625-55e3b512c4c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:53.701175 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1330/2667] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:33:53 2022] DELETE /identity/v3/projects/d0d209f284d7453b9c52b1202cf143ba => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:53.705174 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b20d73-3aeb-47e5-864b-8d82dff385de service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:53.714808 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b20d73-3aeb-47e5-864b-8d82dff385de service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:53.761186 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:53.773485 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42f4c1-89f0-474f-a55a-ebf26fd32046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:53.774168 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42f4c1-89f0-474f-a55a-ebf26fd32046 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:53.774446 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42f4c1-89f0-474f-a55a-ebf26fd32046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:53.774719 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42f4c1-89f0-474f-a55a-ebf26fd32046 admin admin] PATH_INFO: `/v3/users/6ef9e863adab41ca84bdf45a7e88d92a` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:53.775861 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42f4c1-89f0-474f-a55a-ebf26fd32046 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ef9e863adab41ca84bdf45a7e88d92a)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:53.777867 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42f4c1-89f0-474f-a55a-ebf26fd32046 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:53.823305 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-8c42f4c1-89f0-474f-a55a-ebf26fd32046 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ef9e863adab41ca84bdf45a7e88d92a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:53.823944 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-8c42f4c1-89f0-474f-a55a-ebf26fd32046 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ef9e863adab41ca84bdf45a7e88d92a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:53.831171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-8c42f4c1-89f0-474f-a55a-ebf26fd32046 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ef9e863adab41ca84bdf45a7e88d92a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:53.838714 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-8c42f4c1-89f0-474f-a55a-ebf26fd32046 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ef9e863adab41ca84bdf45a7e88d92a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:53.851497 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-8c42f4c1-89f0-474f-a55a-ebf26fd32046 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ef9e863adab41ca84bdf45a7e88d92a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:53.857886 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1338/2668] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:33:53 2022] DELETE /identity/v3/users/6ef9e863adab41ca84bdf45a7e88d92a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:54.128824 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fe47d-26d5-4bb0-8625-55e3b512c4c6 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:54.130275 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8c3fe47d-26d5-4bb0-8625-55e3b512c4c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:54.142845 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3fe47d-26d5-4bb0-8625-55e3b512c4c6 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:54.194678 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:54.201648 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003aec2-0542-457c-b61f-395d97753b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:54.203024 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003aec2-0542-457c-b61f-395d97753b17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:54.203165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003aec2-0542-457c-b61f-395d97753b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:54.203445 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003aec2-0542-457c-b61f-395d97753b17 admin admin] PATH_INFO: `/v3/projects/79e334fcb7d34faba7ce4a8169ac9b18` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:54.204941 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a003aec2-0542-457c-b61f-395d97753b17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79e334fcb7d34faba7ce4a8169ac9b18)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:54.207892 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a003aec2-0542-457c-b61f-395d97753b17 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:54.255777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a003aec2-0542-457c-b61f-395d97753b17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79e334fcb7d34faba7ce4a8169ac9b18', 'request_id': 'req-a003aec2-0542-457c-b61f-395d97753b17'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:54.262418 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a003aec2-0542-457c-b61f-395d97753b17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79e334fcb7d34faba7ce4a8169ac9b18', 'request_id': 'req-a003aec2-0542-457c-b61f-395d97753b17'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:54.272796 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a003aec2-0542-457c-b61f-395d97753b17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79e334fcb7d34faba7ce4a8169ac9b18', 'request_id': 'req-a003aec2-0542-457c-b61f-395d97753b17'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:54.286315 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a003aec2-0542-457c-b61f-395d97753b17 admin admin] The token cache is being invalidate because project 79e334fcb7d34faba7ce4a8169ac9b18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:33:54.286601 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a003aec2-0542-457c-b61f-395d97753b17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:54.287217 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a003aec2-0542-457c-b61f-395d97753b17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:54.288730 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1331/2669] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:33:54 2022] DELETE /identity/v3/projects/79e334fcb7d34faba7ce4a8169ac9b18 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:54.295510 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac07c1-2f4f-4855-9d2b-7f523f53ad5d None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:54.295872 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac07c1-2f4f-4855-9d2b-7f523f53ad5d None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:54.296239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac07c1-2f4f-4855-9d2b-7f523f53ad5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:54.317057 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-2dac07c1-2f4f-4855-9d2b-7f523f53ad5d None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:54.318916 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-2dac07c1-2f4f-4855-9d2b-7f523f53ad5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:54.387493 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1339/2670] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:33:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:54.395330 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9eccae-b383-4f85-a1b7-b5101eee757b None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:54.395617 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9eccae-b383-4f85-a1b7-b5101eee757b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:54.395892 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9eccae-b383-4f85-a1b7-b5101eee757b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:54.417619 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-7a9eccae-b383-4f85-a1b7-b5101eee757b None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:54.418806 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7a9eccae-b383-4f85-a1b7-b5101eee757b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:54.426704 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1332/2671] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:33:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:54.430966 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac07c1-2f4f-4855-9d2b-7f523f53ad5d None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:54.441438 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac07c1-2f4f-4855-9d2b-7f523f53ad5d None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:54.447431 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8845e49-7078-4778-92e7-4dea72818f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:54.448077 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8845e49-7078-4778-92e7-4dea72818f89 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:54.448362 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8845e49-7078-4778-92e7-4dea72818f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:54.448638 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8845e49-7078-4778-92e7-4dea72818f89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:54.449626 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8845e49-7078-4778-92e7-4dea72818f89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:33:54.449937 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8845e49-7078-4778-92e7-4dea72818f89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:54.451527 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8845e49-7078-4778-92e7-4dea72818f89 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:54.466102 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1340/2672] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:33:54.470347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9eccae-b383-4f85-a1b7-b5101eee757b None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:54.480836 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9eccae-b383-4f85-a1b7-b5101eee757b None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:54.485997 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ccee61-2146-42f9-ad69-de30f493c4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:54.486590 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ccee61-2146-42f9-ad69-de30f493c4fc admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:54.486928 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ccee61-2146-42f9-ad69-de30f493c4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:54.487210 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ccee61-2146-42f9-ad69-de30f493c4fc admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:54.487882 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ccee61-2146-42f9-ad69-de30f493c4fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:54.489791 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ccee61-2146-42f9-ad69-de30f493c4fc admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:54.518302 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1333/2673] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:33:54 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:33:54.522450 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8845e49-7078-4778-92e7-4dea72818f89 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:54.533031 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8845e49-7078-4778-92e7-4dea72818f89 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:54.586757 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:54.593860 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831adc2-cace-47a1-acd1-81221ae2c36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:54.594714 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831adc2-cace-47a1-acd1-81221ae2c36d admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:54.595151 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831adc2-cace-47a1-acd1-81221ae2c36d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:54.595771 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f831adc2-cace-47a1-acd1-81221ae2c36d admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:54.596578 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831adc2-cace-47a1-acd1-81221ae2c36d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:54.598572 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f831adc2-cace-47a1-acd1-81221ae2c36d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:54.620043 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1341/2674] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:33:54 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:33:54.624582 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ccee61-2146-42f9-ad69-de30f493c4fc admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:54.635385 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ccee61-2146-42f9-ad69-de30f493c4fc admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:54.640176 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f257b37-dc2b-463d-ab2e-c4b35b698943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:54.640785 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f257b37-dc2b-463d-ab2e-c4b35b698943 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:54.641070 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f257b37-dc2b-463d-ab2e-c4b35b698943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:54.641384 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f257b37-dc2b-463d-ab2e-c4b35b698943 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:54.642076 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f257b37-dc2b-463d-ab2e-c4b35b698943 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:54.643819 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f257b37-dc2b-463d-ab2e-c4b35b698943 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:54.654615 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1334/2675] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:33:54.658656 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831adc2-cace-47a1-acd1-81221ae2c36d admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:54.669420 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f831adc2-cace-47a1-acd1-81221ae2c36d admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:54.674029 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916e2b53-bc05-48f7-a122-76eab8367159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:54.674635 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e2b53-bc05-48f7-a122-76eab8367159 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:54.674917 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e2b53-bc05-48f7-a122-76eab8367159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:54.675191 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916e2b53-bc05-48f7-a122-76eab8367159 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:54.675881 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e2b53-bc05-48f7-a122-76eab8367159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:54.677507 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916e2b53-bc05-48f7-a122-76eab8367159 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:54.688497 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1342/2676] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:33:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:33:54.692577 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f257b37-dc2b-463d-ab2e-c4b35b698943 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:54.702382 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f257b37-dc2b-463d-ab2e-c4b35b698943 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:54.706853 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83532c26-f659-46cb-b323-bf2a34b067dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:54.707484 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83532c26-f659-46cb-b323-bf2a34b067dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:54.707764 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83532c26-f659-46cb-b323-bf2a34b067dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:54.708073 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83532c26-f659-46cb-b323-bf2a34b067dc admin admin] PATH_INFO: `/v3/projects/c968f3e36a0343d1813e95fb5219d1c4/users/f4700548233d45b183e5c4ca34b2944f/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:54.723928 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83532c26-f659-46cb-b323-bf2a34b067dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c968f3e36a0343d1813e95fb5219d1c4, user_id=f4700548233d45b183e5c4ca34b2944f, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:54.726548 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83532c26-f659-46cb-b323-bf2a34b067dc admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:54.740104 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1335/2677] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:33:54 2022] PUT /identity/v3/projects/c968f3e36a0343d1813e95fb5219d1c4/users/f4700548233d45b183e5c4ca34b2944f/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:54.752173 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee74191-14a5-4a83-b4f0-6c510dfaaa5e None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:54.752650 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee74191-14a5-4a83-b4f0-6c510dfaaa5e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:54.752756 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee74191-14a5-4a83-b4f0-6c510dfaaa5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:54.779188 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-2ee74191-14a5-4a83-b4f0-6c510dfaaa5e None None] MFA Rules not processed for user `f4700548233d45b183e5c4ca34b2944f`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:54.780442 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-2ee74191-14a5-4a83-b4f0-6c510dfaaa5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:54.843039 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1343/2678] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:33:54 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:54.854662 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83532c26-f659-46cb-b323-bf2a34b067dc admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:54.856375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-83532c26-f659-46cb-b323-bf2a34b067dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:54.911630 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83532c26-f659-46cb-b323-bf2a34b067dc admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:54.916086 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35762eb5-d333-47b5-bf86-42a923c42051 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:54.916694 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35762eb5-d333-47b5-bf86-42a923c42051 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:54.916977 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35762eb5-d333-47b5-bf86-42a923c42051 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:54.917251 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35762eb5-d333-47b5-bf86-42a923c42051 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:54.925418 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35762eb5-d333-47b5-bf86-42a923c42051 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:54.926828 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35762eb5-d333-47b5-bf86-42a923c42051 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:54.936174 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1336/2679] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:33:54 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:33:54.959802 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee74191-14a5-4a83-b4f0-6c510dfaaa5e None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:55.020483 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee74191-14a5-4a83-b4f0-6c510dfaaa5e None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:55.025552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913879a6-03bf-411c-baf6-41c26b0ecffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:55.026180 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913879a6-03bf-411c-baf6-41c26b0ecffa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:55.026459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913879a6-03bf-411c-baf6-41c26b0ecffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:55.026730 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913879a6-03bf-411c-baf6-41c26b0ecffa admin admin] PATH_INFO: `/v3/users/f4700548233d45b183e5c4ca34b2944f` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:55.027883 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913879a6-03bf-411c-baf6-41c26b0ecffa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4700548233d45b183e5c4ca34b2944f)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:55.029815 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913879a6-03bf-411c-baf6-41c26b0ecffa admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:55.074562 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-913879a6-03bf-411c-baf6-41c26b0ecffa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4700548233d45b183e5c4ca34b2944f'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:55.075324 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-913879a6-03bf-411c-baf6-41c26b0ecffa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4700548233d45b183e5c4ca34b2944f'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:55.082448 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-913879a6-03bf-411c-baf6-41c26b0ecffa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4700548233d45b183e5c4ca34b2944f'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:55.090044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-913879a6-03bf-411c-baf6-41c26b0ecffa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4700548233d45b183e5c4ca34b2944f'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:55.094441 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:55.104608 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-913879a6-03bf-411c-baf6-41c26b0ecffa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4700548233d45b183e5c4ca34b2944f'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:55.111018 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1344/2680] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:33:54 2022] DELETE /identity/v3/users/f4700548233d45b183e5c4ca34b2944f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:55.115491 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26005c-6809-4b7d-9d32-ba34d61bd8e9 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:55.115779 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26005c-6809-4b7d-9d32-ba34d61bd8e9 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:55.116091 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26005c-6809-4b7d-9d32-ba34d61bd8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:55.135076 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-7c26005c-6809-4b7d-9d32-ba34d61bd8e9 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:55.136299 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7c26005c-6809-4b7d-9d32-ba34d61bd8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:55.155946 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:55.195296 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1337/2681] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:33:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:55.204896 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913879a6-03bf-411c-baf6-41c26b0ecffa admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:55.206449 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-913879a6-03bf-411c-baf6-41c26b0ecffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:55.263075 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913879a6-03bf-411c-baf6-41c26b0ecffa admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:55.266663 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82479ff-5626-4305-a57d-b5735777bfa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:55.267281 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82479ff-5626-4305-a57d-b5735777bfa9 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:55.267563 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82479ff-5626-4305-a57d-b5735777bfa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:55.267840 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82479ff-5626-4305-a57d-b5735777bfa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:55.277316 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82479ff-5626-4305-a57d-b5735777bfa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:55.278744 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82479ff-5626-4305-a57d-b5735777bfa9 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:55.288209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1345/2682] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:33:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:33:55.559615 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26005c-6809-4b7d-9d32-ba34d61bd8e9 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:55.561307 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7c26005c-6809-4b7d-9d32-ba34d61bd8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:55.574619 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26005c-6809-4b7d-9d32-ba34d61bd8e9 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:55.584416 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3770734f-0c3d-4be4-bb11-3f4ddf739d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:55.588090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770734f-0c3d-4be4-bb11-3f4ddf739d19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:55.588090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770734f-0c3d-4be4-bb11-3f4ddf739d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:55.588090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3770734f-0c3d-4be4-bb11-3f4ddf739d19 admin admin] PATH_INFO: `/v3/projects/c968f3e36a0343d1813e95fb5219d1c4` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:55.596034 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770734f-0c3d-4be4-bb11-3f4ddf739d19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c968f3e36a0343d1813e95fb5219d1c4)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:55.599502 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3770734f-0c3d-4be4-bb11-3f4ddf739d19 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:55.647955 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3770734f-0c3d-4be4-bb11-3f4ddf739d19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c968f3e36a0343d1813e95fb5219d1c4', 'request_id': 'req-3770734f-0c3d-4be4-bb11-3f4ddf739d19'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:55.654308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3770734f-0c3d-4be4-bb11-3f4ddf739d19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c968f3e36a0343d1813e95fb5219d1c4', 'request_id': 'req-3770734f-0c3d-4be4-bb11-3f4ddf739d19'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:55.659880 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3770734f-0c3d-4be4-bb11-3f4ddf739d19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c968f3e36a0343d1813e95fb5219d1c4', 'request_id': 'req-3770734f-0c3d-4be4-bb11-3f4ddf739d19'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:55.675006 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3770734f-0c3d-4be4-bb11-3f4ddf739d19 admin admin] The token cache is being invalidate because project c968f3e36a0343d1813e95fb5219d1c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:33:55.675298 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3770734f-0c3d-4be4-bb11-3f4ddf739d19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:55.676034 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-3770734f-0c3d-4be4-bb11-3f4ddf739d19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:33:55.677938 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1338/2683] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:33:55 2022] DELETE /identity/v3/projects/c968f3e36a0343d1813e95fb5219d1c4 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:55.684259 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04214a74-dbb4-432b-bf69-c829b8eb6fe1 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:55.684364 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04214a74-dbb4-432b-bf69-c829b8eb6fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:55.685424 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04214a74-dbb4-432b-bf69-c829b8eb6fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:55.709004 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-04214a74-dbb4-432b-bf69-c829b8eb6fe1 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:55.710426 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-04214a74-dbb4-432b-bf69-c829b8eb6fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:55.785292 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813ee9f-63c4-42e3-a5da-aae60b20391e None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:55.785530 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813ee9f-63c4-42e3-a5da-aae60b20391e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:55.785830 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2813ee9f-63c4-42e3-a5da-aae60b20391e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:55.788420 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1346/2684] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:33:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:55.806339 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-2813ee9f-63c4-42e3-a5da-aae60b20391e None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:55.807626 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-2813ee9f-63c4-42e3-a5da-aae60b20391e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:55.816265 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1339/2685] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:33:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:33:55.821369 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04214a74-dbb4-432b-bf69-c829b8eb6fe1 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:55.831983 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04214a74-dbb4-432b-bf69-c829b8eb6fe1 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:55.839450 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22de489-45ad-4956-8cbf-c102edb41431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:55.840097 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22de489-45ad-4956-8cbf-c102edb41431 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:55.840375 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22de489-45ad-4956-8cbf-c102edb41431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:55.840644 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22de489-45ad-4956-8cbf-c102edb41431 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:55.841486 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22de489-45ad-4956-8cbf-c102edb41431 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:33:55.841789 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22de489-45ad-4956-8cbf-c102edb41431 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:55.843440 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22de489-45ad-4956-8cbf-c102edb41431 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:55.859528 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1347/2686] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:33:55.861055 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813ee9f-63c4-42e3-a5da-aae60b20391e None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:55.870966 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2813ee9f-63c4-42e3-a5da-aae60b20391e None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:55.875567 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6dce3-0237-486d-8037-a00f95f0810f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:55.876264 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6dce3-0237-486d-8037-a00f95f0810f admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:55.876547 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6dce3-0237-486d-8037-a00f95f0810f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:55.876818 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6dce3-0237-486d-8037-a00f95f0810f admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:55.877466 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6dce3-0237-486d-8037-a00f95f0810f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:55.879321 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6dce3-0237-486d-8037-a00f95f0810f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:55.905938 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1340/2687] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:33:55 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:33:55.910051 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22de489-45ad-4956-8cbf-c102edb41431 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:55.921054 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22de489-45ad-4956-8cbf-c102edb41431 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:55.976461 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f07cea-63d3-4b75-b2c7-577105067ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:55.977724 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f07cea-63d3-4b75-b2c7-577105067ab5 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:55.978002 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f07cea-63d3-4b75-b2c7-577105067ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:55.978272 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f07cea-63d3-4b75-b2c7-577105067ab5 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:55.978932 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f07cea-63d3-4b75-b2c7-577105067ab5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:55.980868 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f07cea-63d3-4b75-b2c7-577105067ab5 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:56.001520 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1348/2688] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:33:55 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:33:56.005645 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6dce3-0237-486d-8037-a00f95f0810f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:56.015930 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6dce3-0237-486d-8037-a00f95f0810f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:56.020611 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0702542-5f1b-47f3-9dd6-a8e70cebc2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:56.021207 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0702542-5f1b-47f3-9dd6-a8e70cebc2ae admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:56.021485 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0702542-5f1b-47f3-9dd6-a8e70cebc2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:56.021752 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0702542-5f1b-47f3-9dd6-a8e70cebc2ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:56.022431 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0702542-5f1b-47f3-9dd6-a8e70cebc2ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:56.024564 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0702542-5f1b-47f3-9dd6-a8e70cebc2ae admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:56.034251 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1341/2689] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:33:56.038310 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f07cea-63d3-4b75-b2c7-577105067ab5 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:56.045590 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:56.049366 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f07cea-63d3-4b75-b2c7-577105067ab5 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:56.055450 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6834830e-9429-4813-8fbf-5c0e5c78d4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:56.056265 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834830e-9429-4813-8fbf-5c0e5c78d4d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:56.056769 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834830e-9429-4813-8fbf-5c0e5c78d4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:56.057235 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6834830e-9429-4813-8fbf-5c0e5c78d4d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:56.058128 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6834830e-9429-4813-8fbf-5c0e5c78d4d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:56.059728 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6834830e-9429-4813-8fbf-5c0e5c78d4d2 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:56.070225 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1349/2690] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:33:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 15:33:56.074930 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0702542-5f1b-47f3-9dd6-a8e70cebc2ae admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:56.084893 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0702542-5f1b-47f3-9dd6-a8e70cebc2ae admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:56.090726 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb58c49-a5a6-48ce-9b51-a7c1e2c0f3c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:56.091370 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb58c49-a5a6-48ce-9b51-a7c1e2c0f3c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:56.091648 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb58c49-a5a6-48ce-9b51-a7c1e2c0f3c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:56.091919 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb58c49-a5a6-48ce-9b51-a7c1e2c0f3c3 admin admin] PATH_INFO: `/v3/projects/c9574a5c5f494b58b3072fe786bc863c/users/40392585cccb41f6ac827782fa61d90b/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:56.106178 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb58c49-a5a6-48ce-9b51-a7c1e2c0f3c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9574a5c5f494b58b3072fe786bc863c, user_id=40392585cccb41f6ac827782fa61d90b, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:56.108822 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb58c49-a5a6-48ce-9b51-a7c1e2c0f3c3 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:56.121021 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1342/2691] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:33:56 2022] PUT /identity/v3/projects/c9574a5c5f494b58b3072fe786bc863c/users/40392585cccb41f6ac827782fa61d90b/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:33:56.125881 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697f3f4-e338-45e5-9b92-fca6f976c77c None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:56.126165 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697f3f4-e338-45e5-9b92-fca6f976c77c None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:56.126444 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697f3f4-e338-45e5-9b92-fca6f976c77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:56.145186 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-b697f3f4-e338-45e5-9b92-fca6f976c77c None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:56.146375 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b697f3f4-e338-45e5-9b92-fca6f976c77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:56.203671 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1350/2692] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:33:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:56.213839 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb58c49-a5a6-48ce-9b51-a7c1e2c0f3c3 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:56.215498 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-adb58c49-a5a6-48ce-9b51-a7c1e2c0f3c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:56.268659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:33:56.275224 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb58c49-a5a6-48ce-9b51-a7c1e2c0f3c3 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:56.279615 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185e729-16a9-48de-9286-2205f4cf0297 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:56.280267 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185e729-16a9-48de-9286-2205f4cf0297 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:56.280596 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185e729-16a9-48de-9286-2205f4cf0297 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:56.281278 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185e729-16a9-48de-9286-2205f4cf0297 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:56.291281 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185e729-16a9-48de-9286-2205f4cf0297 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:56.292926 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185e729-16a9-48de-9286-2205f4cf0297 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:56.302698 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1343/2693] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:33:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:33:56.910370 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfb76e-2677-4254-b5f9-b3e4248d5bd6 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:56.910876 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfb76e-2677-4254-b5f9-b3e4248d5bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:56.910963 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfb76e-2677-4254-b5f9-b3e4248d5bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:56.940673 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-51cfb76e-2677-4254-b5f9-b3e4248d5bd6 None None] MFA Rules not processed for user `40392585cccb41f6ac827782fa61d90b`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:56.942255 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-51cfb76e-2677-4254-b5f9-b3e4248d5bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:57.035802 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1351/2694] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:33:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:33:57.044252 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185e729-16a9-48de-9286-2205f4cf0297 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:33:57.046276 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0185e729-16a9-48de-9286-2205f4cf0297 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:57.112695 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185e729-16a9-48de-9286-2205f4cf0297 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:33:57.117009 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a054ad-4732-4916-9e75-82fc4db9b3c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:33:57.118301 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a054ad-4732-4916-9e75-82fc4db9b3c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:57.118662 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a054ad-4732-4916-9e75-82fc4db9b3c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:57.118980 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a054ad-4732-4916-9e75-82fc4db9b3c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:57.128209 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a054ad-4732-4916-9e75-82fc4db9b3c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:33:57.129976 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a054ad-4732-4916-9e75-82fc4db9b3c6 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:33:57.138849 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1344/2695] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:33:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:33:58.573926 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caabc10-9d2b-4da1-ae56-cf138ed21130 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:33:58.574374 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caabc10-9d2b-4da1-ae56-cf138ed21130 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:33:58.574620 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caabc10-9d2b-4da1-ae56-cf138ed21130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:33:58.597978 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-9caabc10-9d2b-4da1-ae56-cf138ed21130 None None] MFA Rules not processed for user `40392585cccb41f6ac827782fa61d90b`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:33:58.599187 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9caabc10-9d2b-4da1-ae56-cf138ed21130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:33:58.606899 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1352/2696] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:33:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:34:00.870166 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a054ad-4732-4916-9e75-82fc4db9b3c6 service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:00.872939 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-08a054ad-4732-4916-9e75-82fc4db9b3c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:34:00.891672 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a054ad-4732-4916-9e75-82fc4db9b3c6 service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:00.896872 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a569e-320d-47c6-bb18-8afa379d99d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:00.897548 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a569e-320d-47c6-bb18-8afa379d99d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:00.897838 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a569e-320d-47c6-bb18-8afa379d99d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:00.898109 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a569e-320d-47c6-bb18-8afa379d99d1 admin admin] PATH_INFO: `/v3/users/ace2276831e8408caa3103db8997840c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:00.899327 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a569e-320d-47c6-bb18-8afa379d99d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ace2276831e8408caa3103db8997840c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:00.901366 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a569e-320d-47c6-bb18-8afa379d99d1 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:00.954281 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d60a569e-320d-47c6-bb18-8afa379d99d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ace2276831e8408caa3103db8997840c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:00.955254 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d60a569e-320d-47c6-bb18-8afa379d99d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ace2276831e8408caa3103db8997840c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:00.963259 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d60a569e-320d-47c6-bb18-8afa379d99d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ace2276831e8408caa3103db8997840c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:00.964224 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d60a569e-320d-47c6-bb18-8afa379d99d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ace2276831e8408caa3103db8997840c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:00.976822 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d60a569e-320d-47c6-bb18-8afa379d99d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ace2276831e8408caa3103db8997840c'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:00.993532 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1345/2697] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:34:00 2022] DELETE /identity/v3/users/ace2276831e8408caa3103db8997840c => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:34:01.175621 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caabc10-9d2b-4da1-ae56-cf138ed21130 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:01.189216 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caabc10-9d2b-4da1-ae56-cf138ed21130 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:01.251092 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab760e-35b1-42f4-8dd7-532edc4be76e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:01.251727 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab760e-35b1-42f4-8dd7-532edc4be76e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:01.252029 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab760e-35b1-42f4-8dd7-532edc4be76e admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:01.252306 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab760e-35b1-42f4-8dd7-532edc4be76e admin admin] PATH_INFO: `/v3/projects/d24b7614e9a64f89aa6260ff106690e9` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:01.253461 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab760e-35b1-42f4-8dd7-532edc4be76e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d24b7614e9a64f89aa6260ff106690e9)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:01.255344 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bab760e-35b1-42f4-8dd7-532edc4be76e admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:01.277579 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:34:01.307310 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-5bab760e-35b1-42f4-8dd7-532edc4be76e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd24b7614e9a64f89aa6260ff106690e9', 'request_id': 'req-5bab760e-35b1-42f4-8dd7-532edc4be76e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:01.314070 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-5bab760e-35b1-42f4-8dd7-532edc4be76e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd24b7614e9a64f89aa6260ff106690e9', 'request_id': 'req-5bab760e-35b1-42f4-8dd7-532edc4be76e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:01.321608 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-5bab760e-35b1-42f4-8dd7-532edc4be76e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd24b7614e9a64f89aa6260ff106690e9', 'request_id': 'req-5bab760e-35b1-42f4-8dd7-532edc4be76e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:01.334839 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-5bab760e-35b1-42f4-8dd7-532edc4be76e admin admin] The token cache is being invalidate because project d24b7614e9a64f89aa6260ff106690e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:34:01.335125 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-5bab760e-35b1-42f4-8dd7-532edc4be76e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:01.335734 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-5bab760e-35b1-42f4-8dd7-532edc4be76e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:01.338111 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1353/2698] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:34:01 2022] DELETE /identity/v3/projects/d24b7614e9a64f89aa6260ff106690e9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:34:01.342247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a569e-320d-47c6-bb18-8afa379d99d1 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:01.343802 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d60a569e-320d-47c6-bb18-8afa379d99d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:34:01.366461 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a569e-320d-47c6-bb18-8afa379d99d1 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:01.431350 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1819a-daaa-4f3a-83fb-6d54c2b1a09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:01.432019 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1819a-daaa-4f3a-83fb-6d54c2b1a09a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:01.432305 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1819a-daaa-4f3a-83fb-6d54c2b1a09a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:01.432578 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1819a-daaa-4f3a-83fb-6d54c2b1a09a admin admin] PATH_INFO: `/v3/users/adbfca20639744a5870ce333421cffa4` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:01.433873 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1819a-daaa-4f3a-83fb-6d54c2b1a09a admin admin] RBAC: Authorizing `identity:delete_user(user_id=adbfca20639744a5870ce333421cffa4)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:01.435827 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1819a-daaa-4f3a-83fb-6d54c2b1a09a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:01.440771 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:34:01.488920 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-dae1819a-daaa-4f3a-83fb-6d54c2b1a09a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adbfca20639744a5870ce333421cffa4'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:01.490041 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-dae1819a-daaa-4f3a-83fb-6d54c2b1a09a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adbfca20639744a5870ce333421cffa4'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:01.498590 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-dae1819a-daaa-4f3a-83fb-6d54c2b1a09a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adbfca20639744a5870ce333421cffa4'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:01.499367 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-dae1819a-daaa-4f3a-83fb-6d54c2b1a09a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adbfca20639744a5870ce333421cffa4'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:01.512389 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-dae1819a-daaa-4f3a-83fb-6d54c2b1a09a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adbfca20639744a5870ce333421cffa4'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:01.527201 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1346/2699] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:34:01 2022] DELETE /identity/v3/users/adbfca20639744a5870ce333421cffa4 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:34:01.716893 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab760e-35b1-42f4-8dd7-532edc4be76e admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:01.718374 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5bab760e-35b1-42f4-8dd7-532edc4be76e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:34:01.737166 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bab760e-35b1-42f4-8dd7-532edc4be76e admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:01.803153 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35318dc8-8baa-44d5-b7b5-ca89943f782a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:01.803920 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35318dc8-8baa-44d5-b7b5-ca89943f782a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:01.804208 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35318dc8-8baa-44d5-b7b5-ca89943f782a admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:01.804534 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35318dc8-8baa-44d5-b7b5-ca89943f782a admin admin] PATH_INFO: `/v3/projects/2e0c3c2f4f78482c95cbaf13d46d2632` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:01.806268 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35318dc8-8baa-44d5-b7b5-ca89943f782a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e0c3c2f4f78482c95cbaf13d46d2632)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:01.808222 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35318dc8-8baa-44d5-b7b5-ca89943f782a admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:01.862077 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-35318dc8-8baa-44d5-b7b5-ca89943f782a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e0c3c2f4f78482c95cbaf13d46d2632', 'request_id': 'req-35318dc8-8baa-44d5-b7b5-ca89943f782a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:01.869097 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-35318dc8-8baa-44d5-b7b5-ca89943f782a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e0c3c2f4f78482c95cbaf13d46d2632', 'request_id': 'req-35318dc8-8baa-44d5-b7b5-ca89943f782a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:01.875646 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-35318dc8-8baa-44d5-b7b5-ca89943f782a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e0c3c2f4f78482c95cbaf13d46d2632', 'request_id': 'req-35318dc8-8baa-44d5-b7b5-ca89943f782a'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:01.891132 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-35318dc8-8baa-44d5-b7b5-ca89943f782a admin admin] The token cache is being invalidate because project 2e0c3c2f4f78482c95cbaf13d46d2632 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:34:01.891537 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-35318dc8-8baa-44d5-b7b5-ca89943f782a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:01.892298 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-35318dc8-8baa-44d5-b7b5-ca89943f782a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:01.893900 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1354/2700] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:34:01 2022] DELETE /identity/v3/projects/2e0c3c2f4f78482c95cbaf13d46d2632 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:34:01.898838 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914eb1f2-8be9-4bbe-8d7a-5fa27a80144b None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:01.899433 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914eb1f2-8be9-4bbe-8d7a-5fa27a80144b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:01.899800 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914eb1f2-8be9-4bbe-8d7a-5fa27a80144b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:01.926489 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-914eb1f2-8be9-4bbe-8d7a-5fa27a80144b None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:34:01.927698 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-914eb1f2-8be9-4bbe-8d7a-5fa27a80144b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:34:02.006789 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1347/2701] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:34:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:34:02.016510 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e50975-5677-4a21-aec2-24db24b77445 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:02.016829 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e50975-5677-4a21-aec2-24db24b77445 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:02.017155 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e50975-5677-4a21-aec2-24db24b77445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:02.038267 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-e8e50975-5677-4a21-aec2-24db24b77445 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:34:02.039608 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e8e50975-5677-4a21-aec2-24db24b77445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:34:02.048547 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1355/2702] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:34:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:34:02.052757 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914eb1f2-8be9-4bbe-8d7a-5fa27a80144b None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:02.063017 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914eb1f2-8be9-4bbe-8d7a-5fa27a80144b None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:02.068338 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fa53f-3435-4d57-b616-66d514bdbe1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:02.068953 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fa53f-3435-4d57-b616-66d514bdbe1f admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:02.069232 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fa53f-3435-4d57-b616-66d514bdbe1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:02.069502 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499fa53f-3435-4d57-b616-66d514bdbe1f admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:02.070194 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499fa53f-3435-4d57-b616-66d514bdbe1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:34:02.070503 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499fa53f-3435-4d57-b616-66d514bdbe1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:02.072701 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499fa53f-3435-4d57-b616-66d514bdbe1f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:02.084659 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1348/2703] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:34:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:34:02.089188 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e50975-5677-4a21-aec2-24db24b77445 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:02.099422 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e50975-5677-4a21-aec2-24db24b77445 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:02.106044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a263512-0ddc-43df-86fd-a0d9b98b54b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:02.106747 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a263512-0ddc-43df-86fd-a0d9b98b54b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:02.107032 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a263512-0ddc-43df-86fd-a0d9b98b54b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:02.107310 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a263512-0ddc-43df-86fd-a0d9b98b54b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:02.108022 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a263512-0ddc-43df-86fd-a0d9b98b54b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:02.109925 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a263512-0ddc-43df-86fd-a0d9b98b54b0 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:02.143080 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1356/2704] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:34:02 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:34:02.144458 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fa53f-3435-4d57-b616-66d514bdbe1f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:02.154727 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499fa53f-3435-4d57-b616-66d514bdbe1f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:02.214258 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec264777-5240-48c5-810c-10e204c6dafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:02.214871 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec264777-5240-48c5-810c-10e204c6dafd admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:02.215150 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec264777-5240-48c5-810c-10e204c6dafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:02.215419 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec264777-5240-48c5-810c-10e204c6dafd admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:02.216106 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec264777-5240-48c5-810c-10e204c6dafd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:02.217999 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec264777-5240-48c5-810c-10e204c6dafd admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:02.235278 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:34:02.244301 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1349/2705] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:34:02 2022] POST /identity/v3/users => generated 289 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:34:02.248122 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a263512-0ddc-43df-86fd-a0d9b98b54b0 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:02.258318 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a263512-0ddc-43df-86fd-a0d9b98b54b0 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:02.262855 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d1ea4-5a0f-4f9a-86e4-e424f46787ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:02.263457 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d1ea4-5a0f-4f9a-86e4-e424f46787ed admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:02.263736 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d1ea4-5a0f-4f9a-86e4-e424f46787ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:02.264030 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d1ea4-5a0f-4f9a-86e4-e424f46787ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:02.264721 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d1ea4-5a0f-4f9a-86e4-e424f46787ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:02.266299 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d1ea4-5a0f-4f9a-86e4-e424f46787ed admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:02.268467 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:34:02.282228 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1357/2706] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:34:02.283599 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec264777-5240-48c5-810c-10e204c6dafd admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:02.295498 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec264777-5240-48c5-810c-10e204c6dafd admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:02.300146 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75812cf-5a98-481b-b7dc-e159ce54af07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:02.300821 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75812cf-5a98-481b-b7dc-e159ce54af07 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:02.301099 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75812cf-5a98-481b-b7dc-e159ce54af07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:02.301374 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75812cf-5a98-481b-b7dc-e159ce54af07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:02.302070 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75812cf-5a98-481b-b7dc-e159ce54af07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:02.303644 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75812cf-5a98-481b-b7dc-e159ce54af07 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:02.315464 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1350/2707] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:34:02.319780 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d1ea4-5a0f-4f9a-86e4-e424f46787ed admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:02.333884 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d1ea4-5a0f-4f9a-86e4-e424f46787ed admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:02.347511 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423694c-f533-46d2-abff-9e41156928df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:02.348207 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423694c-f533-46d2-abff-9e41156928df admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:02.348490 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423694c-f533-46d2-abff-9e41156928df admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:02.348797 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8423694c-f533-46d2-abff-9e41156928df admin admin] PATH_INFO: `/v3/projects/e968c32b696b47c8a0f9a266a8293609/users/b139578f0c654d968f0e4557cd4d817e/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:02.364443 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423694c-f533-46d2-abff-9e41156928df admin admin] RBAC: Authorizing `identity:create_grant(project_id=e968c32b696b47c8a0f9a266a8293609, user_id=b139578f0c654d968f0e4557cd4d817e, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:02.367088 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8423694c-f533-46d2-abff-9e41156928df admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:02.381051 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1358/2708] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:34:02 2022] PUT /identity/v3/projects/e968c32b696b47c8a0f9a266a8293609/users/b139578f0c654d968f0e4557cd4d817e/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:34:02.391532 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2d411-abd1-4666-ae41-d51b195d96df None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:02.392011 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2d411-abd1-4666-ae41-d51b195d96df None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:02.392290 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2d411-abd1-4666-ae41-d51b195d96df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:02.422991 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-bfc2d411-abd1-4666-ae41-d51b195d96df None None] MFA Rules not processed for user `b139578f0c654d968f0e4557cd4d817e`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:34:02.424274 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bfc2d411-abd1-4666-ae41-d51b195d96df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:34:02.488225 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1351/2709] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:34:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:34:02.492789 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423694c-f533-46d2-abff-9e41156928df admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:02.554436 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8423694c-f533-46d2-abff-9e41156928df admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:02.559006 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76a3e2-7b7a-447b-81e8-b5c940e2d54c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:02.559609 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76a3e2-7b7a-447b-81e8-b5c940e2d54c admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:02.559889 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76a3e2-7b7a-447b-81e8-b5c940e2d54c admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:02.560203 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76a3e2-7b7a-447b-81e8-b5c940e2d54c admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:02.560853 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76a3e2-7b7a-447b-81e8-b5c940e2d54c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:02.562742 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76a3e2-7b7a-447b-81e8-b5c940e2d54c admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:02.589565 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1359/2710] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:34:02 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:34:02.593323 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2d411-abd1-4666-ae41-d51b195d96df None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:02.604943 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2d411-abd1-4666-ae41-d51b195d96df None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:02.660329 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687d059-3fbf-4b91-bdf7-938c53c43b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:02.660954 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687d059-3fbf-4b91-bdf7-938c53c43b5e admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:02.661240 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687d059-3fbf-4b91-bdf7-938c53c43b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:02.661516 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687d059-3fbf-4b91-bdf7-938c53c43b5e admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:02.662189 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687d059-3fbf-4b91-bdf7-938c53c43b5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:02.664150 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687d059-3fbf-4b91-bdf7-938c53c43b5e admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:02.688637 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1352/2711] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:34:02 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:34:02.692922 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76a3e2-7b7a-447b-81e8-b5c940e2d54c admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:02.704420 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76a3e2-7b7a-447b-81e8-b5c940e2d54c admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:02.709260 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42d5fc-3110-4204-8239-e14b16a34d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:02.709875 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42d5fc-3110-4204-8239-e14b16a34d50 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:02.710160 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42d5fc-3110-4204-8239-e14b16a34d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:02.710437 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a42d5fc-3110-4204-8239-e14b16a34d50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:02.711137 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a42d5fc-3110-4204-8239-e14b16a34d50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:02.713289 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a42d5fc-3110-4204-8239-e14b16a34d50 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:02.724150 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1360/2712] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 15:34:02.728663 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687d059-3fbf-4b91-bdf7-938c53c43b5e admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:02.738906 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687d059-3fbf-4b91-bdf7-938c53c43b5e admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:02.743559 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d762e81-8462-48ac-98e6-d1b77c71ccdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:02.744202 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d762e81-8462-48ac-98e6-d1b77c71ccdf admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:02.744481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d762e81-8462-48ac-98e6-d1b77c71ccdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:02.744751 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d762e81-8462-48ac-98e6-d1b77c71ccdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:02.745432 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d762e81-8462-48ac-98e6-d1b77c71ccdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:02.746997 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d762e81-8462-48ac-98e6-d1b77c71ccdf admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:02.757293 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1353/2713] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:34:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 15:34:02.761511 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42d5fc-3110-4204-8239-e14b16a34d50 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:02.771453 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a42d5fc-3110-4204-8239-e14b16a34d50 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:02.777376 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0cacc-6305-4d7a-978c-5dd1a47f0d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:02.778044 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0cacc-6305-4d7a-978c-5dd1a47f0d09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:02.778324 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0cacc-6305-4d7a-978c-5dd1a47f0d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:02.778599 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0cacc-6305-4d7a-978c-5dd1a47f0d09 admin admin] PATH_INFO: `/v3/projects/13d1b6b4714c4fecbbc4d7a2454756f2/users/3dc8638c8dee49dbba5674e5463dc300/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:02.794569 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d0cacc-6305-4d7a-978c-5dd1a47f0d09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13d1b6b4714c4fecbbc4d7a2454756f2, user_id=3dc8638c8dee49dbba5674e5463dc300, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:02.797333 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d0cacc-6305-4d7a-978c-5dd1a47f0d09 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:02.810127 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1361/2714] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:34:02 2022] PUT /identity/v3/projects/13d1b6b4714c4fecbbc4d7a2454756f2/users/3dc8638c8dee49dbba5674e5463dc300/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:34:02.820366 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d914aa9-1fa8-42ee-87f2-18e28200373d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:02.820651 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d914aa9-1fa8-42ee-87f2-18e28200373d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:02.821528 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d914aa9-1fa8-42ee-87f2-18e28200373d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:02.849318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-1d914aa9-1fa8-42ee-87f2-18e28200373d None None] MFA Rules not processed for user `3dc8638c8dee49dbba5674e5463dc300`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:34:02.850509 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1d914aa9-1fa8-42ee-87f2-18e28200373d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:34:02.893522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:34:02.916285 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1354/2715] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:34:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:34:02.920710 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0cacc-6305-4d7a-978c-5dd1a47f0d09 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:02.983168 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d0cacc-6305-4d7a-978c-5dd1a47f0d09 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:02.987776 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468afa5a-956d-4b3b-9208-714a681afb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:02.988441 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468afa5a-956d-4b3b-9208-714a681afb6d admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:02.988726 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468afa5a-956d-4b3b-9208-714a681afb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:02.988999 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468afa5a-956d-4b3b-9208-714a681afb6d admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:02.989665 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468afa5a-956d-4b3b-9208-714a681afb6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:02.991591 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468afa5a-956d-4b3b-9208-714a681afb6d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:03.021936 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1362/2716] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:34:02 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:34:03.023115 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d914aa9-1fa8-42ee-87f2-18e28200373d None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:03.034890 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d914aa9-1fa8-42ee-87f2-18e28200373d None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:03.092631 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ab295-6dad-4917-b2e8-e57829af6832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:03.093157 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ab295-6dad-4917-b2e8-e57829af6832 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:03.093441 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ab295-6dad-4917-b2e8-e57829af6832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:03.093716 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10ab295-6dad-4917-b2e8-e57829af6832 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:03.094375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ab295-6dad-4917-b2e8-e57829af6832 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:03.096304 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10ab295-6dad-4917-b2e8-e57829af6832 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:03.116719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1355/2717] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:34:03 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:34:03.120731 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468afa5a-956d-4b3b-9208-714a681afb6d admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:03.130880 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468afa5a-956d-4b3b-9208-714a681afb6d admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:03.136066 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c0065-ef68-4d1f-b67a-9747b68bbbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:03.136669 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c0065-ef68-4d1f-b67a-9747b68bbbf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:03.136953 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c0065-ef68-4d1f-b67a-9747b68bbbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:03.137232 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c0065-ef68-4d1f-b67a-9747b68bbbf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:03.137923 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c0065-ef68-4d1f-b67a-9747b68bbbf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:03.139511 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c0065-ef68-4d1f-b67a-9747b68bbbf9 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:03.141645 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:34:03.151846 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1363/2718] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:34:03.155777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ab295-6dad-4917-b2e8-e57829af6832 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:03.165612 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10ab295-6dad-4917-b2e8-e57829af6832 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:03.170384 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80027230-3026-445a-b937-135fa84a4de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:03.171027 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80027230-3026-445a-b937-135fa84a4de8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:03.171309 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80027230-3026-445a-b937-135fa84a4de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:03.171582 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80027230-3026-445a-b937-135fa84a4de8 admin admin] PATH_INFO: `/v3/projects/ab7a3cabe9ae4993a90bafa8ace00571/users/66fb7e9f1dd642a794e4ac0cfe6d46b4/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:03.186914 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80027230-3026-445a-b937-135fa84a4de8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab7a3cabe9ae4993a90bafa8ace00571, user_id=66fb7e9f1dd642a794e4ac0cfe6d46b4, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:03.189581 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80027230-3026-445a-b937-135fa84a4de8 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:03.202118 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1356/2719] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:34:03 2022] PUT /identity/v3/projects/ab7a3cabe9ae4993a90bafa8ace00571/users/66fb7e9f1dd642a794e4ac0cfe6d46b4/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:34:03.205978 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c0065-ef68-4d1f-b67a-9747b68bbbf9 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:03.216403 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c0065-ef68-4d1f-b67a-9747b68bbbf9 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:03.271645 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272fb64-2722-4221-952f-d0feec64228c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:03.272287 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272fb64-2722-4221-952f-d0feec64228c admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:03.272550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272fb64-2722-4221-952f-d0feec64228c admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:03.272826 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272fb64-2722-4221-952f-d0feec64228c admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:03.273508 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e272fb64-2722-4221-952f-d0feec64228c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:03.275118 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e272fb64-2722-4221-952f-d0feec64228c admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:03.284556 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1364/2720] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:34:03 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 15:34:03.288806 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80027230-3026-445a-b937-135fa84a4de8 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:03.299317 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80027230-3026-445a-b937-135fa84a4de8 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:03.304025 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f518b-efcd-4e9d-b15d-563babbb9a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:03.304768 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f518b-efcd-4e9d-b15d-563babbb9a96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:03.305091 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f518b-efcd-4e9d-b15d-563babbb9a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:03.305878 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f518b-efcd-4e9d-b15d-563babbb9a96 admin admin] PATH_INFO: `/v3/projects/ab7a3cabe9ae4993a90bafa8ace00571/users/66fb7e9f1dd642a794e4ac0cfe6d46b4/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:03.307846 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f518b-efcd-4e9d-b15d-563babbb9a96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab7a3cabe9ae4993a90bafa8ace00571, user_id=66fb7e9f1dd642a794e4ac0cfe6d46b4, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:03.310482 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f518b-efcd-4e9d-b15d-563babbb9a96 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:03.320585 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1357/2721] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:34:03 2022] PUT /identity/v3/projects/ab7a3cabe9ae4993a90bafa8ace00571/users/66fb7e9f1dd642a794e4ac0cfe6d46b4/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:34:03.332178 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84b2de-f5c3-488f-8fae-79b91c43a4b6 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:03.332471 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84b2de-f5c3-488f-8fae-79b91c43a4b6 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:03.332751 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb84b2de-f5c3-488f-8fae-79b91c43a4b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:03.359702 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-cb84b2de-f5c3-488f-8fae-79b91c43a4b6 None None] MFA Rules not processed for user `66fb7e9f1dd642a794e4ac0cfe6d46b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:34:03.360881 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-cb84b2de-f5c3-488f-8fae-79b91c43a4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:34:03.429542 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1365/2722] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:34:03 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:34:03.441119 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f518b-efcd-4e9d-b15d-563babbb9a96 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:03.442826 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-874f518b-efcd-4e9d-b15d-563babbb9a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:34:03.499291 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f518b-efcd-4e9d-b15d-563babbb9a96 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:03.503121 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5b76f-5ba8-42a3-9558-0b4dbd77a3ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:03.503732 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5b76f-5ba8-42a3-9558-0b4dbd77a3ce service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:03.504043 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5b76f-5ba8-42a3-9558-0b4dbd77a3ce service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:03.504320 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5b76f-5ba8-42a3-9558-0b4dbd77a3ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:03.558403 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:34:03.563064 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5b76f-5ba8-42a3-9558-0b4dbd77a3ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:03.564826 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5b76f-5ba8-42a3-9558-0b4dbd77a3ce service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:03.573945 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1358/2723] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:34:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:34:05.088737 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84b2de-f5c3-488f-8fae-79b91c43a4b6 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:05.090182 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-cb84b2de-f5c3-488f-8fae-79b91c43a4b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:34:05.102673 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb84b2de-f5c3-488f-8fae-79b91c43a4b6 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:05.106195 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd51006-9a85-4806-b5bf-ab723a50de54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:05.106801 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd51006-9a85-4806-b5bf-ab723a50de54 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:05.107083 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd51006-9a85-4806-b5bf-ab723a50de54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:05.107353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd51006-9a85-4806-b5bf-ab723a50de54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:05.164277 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd51006-9a85-4806-b5bf-ab723a50de54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:05.166470 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd51006-9a85-4806-b5bf-ab723a50de54 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:05.175215 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1366/2724] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:34:05 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:34:05.705231 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5b76f-5ba8-42a3-9558-0b4dbd77a3ce service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:05.715197 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5b76f-5ba8-42a3-9558-0b4dbd77a3ce service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:05.719725 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b436b8-0bb2-46d1-be2b-8ad7b04bba7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:05.720396 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b436b8-0bb2-46d1-be2b-8ad7b04bba7e service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:05.720671 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b436b8-0bb2-46d1-be2b-8ad7b04bba7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:05.720943 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b436b8-0bb2-46d1-be2b-8ad7b04bba7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:05.734644 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b436b8-0bb2-46d1-be2b-8ad7b04bba7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:05.736105 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b436b8-0bb2-46d1-be2b-8ad7b04bba7e service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:05.746647 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1359/2725] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:34:05 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:34:09.627300 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd51006-9a85-4806-b5bf-ab723a50de54 service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:09.645667 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=100 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:34:09.690448 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd51006-9a85-4806-b5bf-ab723a50de54 service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:09.694876 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09672240-0d4c-4c98-9465-1adfeeaf87f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:09.695518 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09672240-0d4c-4c98-9465-1adfeeaf87f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:09.695805 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09672240-0d4c-4c98-9465-1adfeeaf87f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:09.696114 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09672240-0d4c-4c98-9465-1adfeeaf87f9 admin admin] PATH_INFO: `/v3/users/b139578f0c654d968f0e4557cd4d817e` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:09.697305 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09672240-0d4c-4c98-9465-1adfeeaf87f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b139578f0c654d968f0e4557cd4d817e)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:09.699209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09672240-0d4c-4c98-9465-1adfeeaf87f9 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:09.748342 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-09672240-0d4c-4c98-9465-1adfeeaf87f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b139578f0c654d968f0e4557cd4d817e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:09.749000 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-09672240-0d4c-4c98-9465-1adfeeaf87f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b139578f0c654d968f0e4557cd4d817e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:09.757775 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-09672240-0d4c-4c98-9465-1adfeeaf87f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b139578f0c654d968f0e4557cd4d817e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:09.765910 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-09672240-0d4c-4c98-9465-1adfeeaf87f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b139578f0c654d968f0e4557cd4d817e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:09.779637 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-09672240-0d4c-4c98-9465-1adfeeaf87f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b139578f0c654d968f0e4557cd4d817e'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:09.790188 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1367/2726] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:34:09 2022] DELETE /identity/v3/users/b139578f0c654d968f0e4557cd4d817e => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:34:09.795064 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073143c-84c5-4e86-8f3b-b59e8ee1dbfb None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:09.795687 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073143c-84c5-4e86-8f3b-b59e8ee1dbfb None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:09.795687 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073143c-84c5-4e86-8f3b-b59e8ee1dbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:09.817040 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b073143c-84c5-4e86-8f3b-b59e8ee1dbfb None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:34:09.818259 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b073143c-84c5-4e86-8f3b-b59e8ee1dbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:34:09.881253 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1360/2727] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:34:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:34:09.891376 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09672240-0d4c-4c98-9465-1adfeeaf87f9 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:09.892733 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-09672240-0d4c-4c98-9465-1adfeeaf87f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:34:09.957078 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09672240-0d4c-4c98-9465-1adfeeaf87f9 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:09.960786 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7deee-e5c2-4983-9a26-77256af3d1de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:09.961407 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7deee-e5c2-4983-9a26-77256af3d1de service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:09.962299 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7deee-e5c2-4983-9a26-77256af3d1de service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:09.962583 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7deee-e5c2-4983-9a26-77256af3d1de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:09.972295 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7deee-e5c2-4983-9a26-77256af3d1de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:09.973845 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae7deee-e5c2-4983-9a26-77256af3d1de service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:09.984273 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1368/2728] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:34:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 15:34:10.266589 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073143c-84c5-4e86-8f3b-b59e8ee1dbfb None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:10.269252 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b073143c-84c5-4e86-8f3b-b59e8ee1dbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:34:10.297785 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073143c-84c5-4e86-8f3b-b59e8ee1dbfb None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:10.302983 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e41e6-4a10-43e6-9088-093ff381cbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:10.303840 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e41e6-4a10-43e6-9088-093ff381cbf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:10.304229 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e41e6-4a10-43e6-9088-093ff381cbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:10.304595 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e41e6-4a10-43e6-9088-093ff381cbf2 admin admin] PATH_INFO: `/v3/projects/e968c32b696b47c8a0f9a266a8293609` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:10.305887 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e41e6-4a10-43e6-9088-093ff381cbf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e968c32b696b47c8a0f9a266a8293609)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:10.307847 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021e41e6-4a10-43e6-9088-093ff381cbf2 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:10.356209 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-021e41e6-4a10-43e6-9088-093ff381cbf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e968c32b696b47c8a0f9a266a8293609', 'request_id': 'req-021e41e6-4a10-43e6-9088-093ff381cbf2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:10.362209 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-021e41e6-4a10-43e6-9088-093ff381cbf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e968c32b696b47c8a0f9a266a8293609', 'request_id': 'req-021e41e6-4a10-43e6-9088-093ff381cbf2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:10.367566 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-021e41e6-4a10-43e6-9088-093ff381cbf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e968c32b696b47c8a0f9a266a8293609', 'request_id': 'req-021e41e6-4a10-43e6-9088-093ff381cbf2'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:10.379467 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-021e41e6-4a10-43e6-9088-093ff381cbf2 admin admin] The token cache is being invalidate because project e968c32b696b47c8a0f9a266a8293609 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:34:10.379751 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-021e41e6-4a10-43e6-9088-093ff381cbf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:10.380380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-021e41e6-4a10-43e6-9088-093ff381cbf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:10.381852 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1361/2729] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:34:10 2022] DELETE /identity/v3/projects/e968c32b696b47c8a0f9a266a8293609 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:34:10.386299 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7deee-e5c2-4983-9a26-77256af3d1de service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:10.395977 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae7deee-e5c2-4983-9a26-77256af3d1de service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:10.440192 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:34:10.461027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d56b18-fef6-4c0e-9871-1fd61bef07fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:10.462239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d56b18-fef6-4c0e-9871-1fd61bef07fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:10.462532 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d56b18-fef6-4c0e-9871-1fd61bef07fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:10.462799 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d56b18-fef6-4c0e-9871-1fd61bef07fa admin admin] PATH_INFO: `/v3/users/3dc8638c8dee49dbba5674e5463dc300` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:10.463965 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d56b18-fef6-4c0e-9871-1fd61bef07fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dc8638c8dee49dbba5674e5463dc300)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:10.466110 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d56b18-fef6-4c0e-9871-1fd61bef07fa admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:10.513054 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-75d56b18-fef6-4c0e-9871-1fd61bef07fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dc8638c8dee49dbba5674e5463dc300'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:10.513713 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-75d56b18-fef6-4c0e-9871-1fd61bef07fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dc8638c8dee49dbba5674e5463dc300'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:10.522214 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-75d56b18-fef6-4c0e-9871-1fd61bef07fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dc8638c8dee49dbba5674e5463dc300'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:10.529706 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-75d56b18-fef6-4c0e-9871-1fd61bef07fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dc8638c8dee49dbba5674e5463dc300'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:10.541511 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-75d56b18-fef6-4c0e-9871-1fd61bef07fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dc8638c8dee49dbba5674e5463dc300'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:10.547309 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1369/2730] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:34:10 2022] DELETE /identity/v3/users/3dc8638c8dee49dbba5674e5463dc300 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:34:10.846288 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e41e6-4a10-43e6-9088-093ff381cbf2 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:10.847833 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-021e41e6-4a10-43e6-9088-093ff381cbf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:34:10.860905 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e41e6-4a10-43e6-9088-093ff381cbf2 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:10.925282 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e87d64-097c-4256-aa55-6e25de60c154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:10.925925 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e87d64-097c-4256-aa55-6e25de60c154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:10.926211 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e87d64-097c-4256-aa55-6e25de60c154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:10.926486 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e87d64-097c-4256-aa55-6e25de60c154 admin admin] PATH_INFO: `/v3/projects/13d1b6b4714c4fecbbc4d7a2454756f2` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:10.927656 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e87d64-097c-4256-aa55-6e25de60c154 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13d1b6b4714c4fecbbc4d7a2454756f2)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:10.929563 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e87d64-097c-4256-aa55-6e25de60c154 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:10.936252 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:34:10.975865 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-55e87d64-097c-4256-aa55-6e25de60c154 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13d1b6b4714c4fecbbc4d7a2454756f2', 'request_id': 'req-55e87d64-097c-4256-aa55-6e25de60c154'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:10.982338 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-55e87d64-097c-4256-aa55-6e25de60c154 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13d1b6b4714c4fecbbc4d7a2454756f2', 'request_id': 'req-55e87d64-097c-4256-aa55-6e25de60c154'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:10.988884 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-55e87d64-097c-4256-aa55-6e25de60c154 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13d1b6b4714c4fecbbc4d7a2454756f2', 'request_id': 'req-55e87d64-097c-4256-aa55-6e25de60c154'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:11.002091 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-55e87d64-097c-4256-aa55-6e25de60c154 admin admin] The token cache is being invalidate because project 13d1b6b4714c4fecbbc4d7a2454756f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:34:11.002418 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-55e87d64-097c-4256-aa55-6e25de60c154 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:11.003007 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-55e87d64-097c-4256-aa55-6e25de60c154 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:11.004559 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1362/2731] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:34:10 2022] DELETE /identity/v3/projects/13d1b6b4714c4fecbbc4d7a2454756f2 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:34:11.009153 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d56b18-fef6-4c0e-9871-1fd61bef07fa admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:11.010642 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-75d56b18-fef6-4c0e-9871-1fd61bef07fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:34:11.023811 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d56b18-fef6-4c0e-9871-1fd61bef07fa admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:11.081749 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bec628-c8af-4346-89c9-018db8d10ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:11.082460 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bec628-c8af-4346-89c9-018db8d10ab4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:11.082776 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bec628-c8af-4346-89c9-018db8d10ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:11.083090 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bec628-c8af-4346-89c9-018db8d10ab4 admin admin] PATH_INFO: `/v3/users/66fb7e9f1dd642a794e4ac0cfe6d46b4` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:11.084610 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bec628-c8af-4346-89c9-018db8d10ab4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66fb7e9f1dd642a794e4ac0cfe6d46b4)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:11.086837 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bec628-c8af-4346-89c9-018db8d10ab4 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:11.134315 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f6bec628-c8af-4346-89c9-018db8d10ab4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66fb7e9f1dd642a794e4ac0cfe6d46b4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:11.134972 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f6bec628-c8af-4346-89c9-018db8d10ab4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66fb7e9f1dd642a794e4ac0cfe6d46b4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:11.143479 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f6bec628-c8af-4346-89c9-018db8d10ab4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66fb7e9f1dd642a794e4ac0cfe6d46b4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:11.148897 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:34:11.151228 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f6bec628-c8af-4346-89c9-018db8d10ab4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66fb7e9f1dd642a794e4ac0cfe6d46b4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:11.165958 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-f6bec628-c8af-4346-89c9-018db8d10ab4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66fb7e9f1dd642a794e4ac0cfe6d46b4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:11.172046 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1370/2732] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:34:11 2022] DELETE /identity/v3/users/66fb7e9f1dd642a794e4ac0cfe6d46b4 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:34:11.456210 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e87d64-097c-4256-aa55-6e25de60c154 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:11.457728 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-55e87d64-097c-4256-aa55-6e25de60c154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:34:11.471392 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e87d64-097c-4256-aa55-6e25de60c154 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:11.533547 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358342b4-bf5b-406a-ae50-8c6fb4198c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:11.534193 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358342b4-bf5b-406a-ae50-8c6fb4198c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:11.534475 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358342b4-bf5b-406a-ae50-8c6fb4198c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:11.534745 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358342b4-bf5b-406a-ae50-8c6fb4198c05 admin admin] PATH_INFO: `/v3/projects/ab7a3cabe9ae4993a90bafa8ace00571` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:11.535888 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358342b4-bf5b-406a-ae50-8c6fb4198c05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab7a3cabe9ae4993a90bafa8ace00571)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:11.537844 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358342b4-bf5b-406a-ae50-8c6fb4198c05 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:11.587982 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-358342b4-bf5b-406a-ae50-8c6fb4198c05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab7a3cabe9ae4993a90bafa8ace00571', 'request_id': 'req-358342b4-bf5b-406a-ae50-8c6fb4198c05'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:11.594115 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-358342b4-bf5b-406a-ae50-8c6fb4198c05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab7a3cabe9ae4993a90bafa8ace00571', 'request_id': 'req-358342b4-bf5b-406a-ae50-8c6fb4198c05'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:11.599676 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-358342b4-bf5b-406a-ae50-8c6fb4198c05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab7a3cabe9ae4993a90bafa8ace00571', 'request_id': 'req-358342b4-bf5b-406a-ae50-8c6fb4198c05'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:11.612761 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-358342b4-bf5b-406a-ae50-8c6fb4198c05 admin admin] The token cache is being invalidate because project ab7a3cabe9ae4993a90bafa8ace00571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:34:11.613050 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-358342b4-bf5b-406a-ae50-8c6fb4198c05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:11.613664 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-358342b4-bf5b-406a-ae50-8c6fb4198c05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:34:11.615167 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1363/2733] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:34:11 2022] DELETE /identity/v3/projects/ab7a3cabe9ae4993a90bafa8ace00571 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:34:21.168400 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=8,keystone:DELETE=2 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:34:21.609635 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=73,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:34:30.101226 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c36d2a-709d-4dcf-b469-5ae0f117a1d0 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:30.101760 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c36d2a-709d-4dcf-b469-5ae0f117a1d0 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:30.101760 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c36d2a-709d-4dcf-b469-5ae0f117a1d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:30.121266 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-52c36d2a-709d-4dcf-b469-5ae0f117a1d0 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:34:30.122462 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-52c36d2a-709d-4dcf-b469-5ae0f117a1d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:34:30.180948 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1371/2734] 10.222.0.57 () {58 vars in 1016 bytes} [Wed Jul 27 15:34:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:34:30.204847 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358342b4-bf5b-406a-ae50-8c6fb4198c05 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:30.206433 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-358342b4-bf5b-406a-ae50-8c6fb4198c05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:34:30.284167 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358342b4-bf5b-406a-ae50-8c6fb4198c05 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:30.289566 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e3e61-d1a2-4094-a542-85af0d20b250 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:30.290182 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e3e61-d1a2-4094-a542-85af0d20b250 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:30.290466 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e3e61-d1a2-4094-a542-85af0d20b250 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:30.291057 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e3e61-d1a2-4094-a542-85af0d20b250 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:30.299054 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e3e61-d1a2-4094-a542-85af0d20b250 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:30.300657 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e3e61-d1a2-4094-a542-85af0d20b250 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:30.310580 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1364/2735] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:34:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:34:34.193277 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257e1dd-04a9-4956-8b50-0b25b61fdc69 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:34.193828 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257e1dd-04a9-4956-8b50-0b25b61fdc69 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:34.193828 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6257e1dd-04a9-4956-8b50-0b25b61fdc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:34.213235 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-6257e1dd-04a9-4956-8b50-0b25b61fdc69 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:34:34.214533 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6257e1dd-04a9-4956-8b50-0b25b61fdc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:34:34.222732 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1372/2736] 10.222.0.57 () {58 vars in 1016 bytes} [Wed Jul 27 15:34:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:34:34.243720 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e3e61-d1a2-4094-a542-85af0d20b250 service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:34.245176 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-697e3e61-d1a2-4094-a542-85af0d20b250 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:34:34.260579 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e3e61-d1a2-4094-a542-85af0d20b250 service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:34.266229 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda09ef1-1a31-4dc7-b1ac-7e36bc79d8e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:34.266873 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda09ef1-1a31-4dc7-b1ac-7e36bc79d8e1 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:34.267156 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda09ef1-1a31-4dc7-b1ac-7e36bc79d8e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:34.267432 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda09ef1-1a31-4dc7-b1ac-7e36bc79d8e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:34.275887 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda09ef1-1a31-4dc7-b1ac-7e36bc79d8e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:34.277479 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda09ef1-1a31-4dc7-b1ac-7e36bc79d8e1 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:34.287454 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1365/2737] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:34:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:34:42.618922 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb263c-3df8-407e-927d-eedb12b005fb None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:42.619430 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb263c-3df8-407e-927d-eedb12b005fb None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:42.619535 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb263c-3df8-407e-927d-eedb12b005fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:42.639643 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-c0fb263c-3df8-407e-927d-eedb12b005fb None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:34:42.640858 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-c0fb263c-3df8-407e-927d-eedb12b005fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:34:42.648589 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1373/2738] 10.222.0.57 () {58 vars in 1016 bytes} [Wed Jul 27 15:34:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:34:42.670561 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda09ef1-1a31-4dc7-b1ac-7e36bc79d8e1 service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:42.682955 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda09ef1-1a31-4dc7-b1ac-7e36bc79d8e1 service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:42.688574 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6715ff0-c1d9-4d52-9064-910653ae6561 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:42.689199 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6715ff0-c1d9-4d52-9064-910653ae6561 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:42.689456 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6715ff0-c1d9-4d52-9064-910653ae6561 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:42.689727 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6715ff0-c1d9-4d52-9064-910653ae6561 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:42.698522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6715ff0-c1d9-4d52-9064-910653ae6561 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:42.700187 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6715ff0-c1d9-4d52-9064-910653ae6561 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:42.709573 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1366/2739] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:34:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:34:46.740189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a4cdf-4c95-4815-aeec-1d9b36c76e10 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:46.741113 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a4cdf-4c95-4815-aeec-1d9b36c76e10 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:46.741415 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0a4cdf-4c95-4815-aeec-1d9b36c76e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:46.767778 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-7e0a4cdf-4c95-4815-aeec-1d9b36c76e10 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:34:46.769145 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-7e0a4cdf-4c95-4815-aeec-1d9b36c76e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:34:46.778884 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1374/2740] 10.222.0.57 () {58 vars in 1016 bytes} [Wed Jul 27 15:34:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:34:46.822950 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6715ff0-c1d9-4d52-9064-910653ae6561 service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:46.840189 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6715ff0-c1d9-4d52-9064-910653ae6561 service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:46.843122 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e99c19-b817-46c2-9444-1c7b5e0b9049 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:46.843122 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e99c19-b817-46c2-9444-1c7b5e0b9049 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:46.843435 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e99c19-b817-46c2-9444-1c7b5e0b9049 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:46.843537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e99c19-b817-46c2-9444-1c7b5e0b9049 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:46.854406 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e99c19-b817-46c2-9444-1c7b5e0b9049 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:46.856041 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e99c19-b817-46c2-9444-1c7b5e0b9049 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:46.875079 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1367/2741] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:34:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:34:50.955719 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51457d-4c92-49f6-9256-ea4e5587e37d None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:50.956248 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51457d-4c92-49f6-9256-ea4e5587e37d None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:50.956378 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51457d-4c92-49f6-9256-ea4e5587e37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:50.976408 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-fa51457d-4c92-49f6-9256-ea4e5587e37d None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:34:50.978270 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-fa51457d-4c92-49f6-9256-ea4e5587e37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:34:50.986834 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1375/2742] 10.222.0.57 () {58 vars in 1016 bytes} [Wed Jul 27 15:34:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:34:51.008680 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e99c19-b817-46c2-9444-1c7b5e0b9049 service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:51.022050 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e99c19-b817-46c2-9444-1c7b5e0b9049 service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:51.027972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f88eb97-7e2d-4f35-a60c-8c12f8128151 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:51.028611 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88eb97-7e2d-4f35-a60c-8c12f8128151 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:51.028899 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88eb97-7e2d-4f35-a60c-8c12f8128151 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:51.029180 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f88eb97-7e2d-4f35-a60c-8c12f8128151 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:51.037552 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f88eb97-7e2d-4f35-a60c-8c12f8128151 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:51.039311 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f88eb97-7e2d-4f35-a60c-8c12f8128151 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:51.049927 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1368/2743] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:34:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:34:51.892099 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c49414-201d-4b66-bc2d-2edd02e7fff1 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:51.892386 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c49414-201d-4b66-bc2d-2edd02e7fff1 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:51.892661 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c49414-201d-4b66-bc2d-2edd02e7fff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:51.900323 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=40 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:34:51.913020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-03c49414-201d-4b66-bc2d-2edd02e7fff1 None None] MFA Rules not processed for user `6f2efb7dbdb3468fa083b35159324081`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:34:51.914256 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-03c49414-201d-4b66-bc2d-2edd02e7fff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:34:51.981548 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1376/2744] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:34:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:34:54.117513 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48568156-7885-49c7-9772-24642e9a377e None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:54.118109 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48568156-7885-49c7-9772-24642e9a377e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:54.118109 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48568156-7885-49c7-9772-24642e9a377e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:54.125997 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=59 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:34:54.139219 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-48568156-7885-49c7-9772-24642e9a377e None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:34:54.140452 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-48568156-7885-49c7-9772-24642e9a377e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:34:54.149715 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1369/2745] 10.222.0.57 () {58 vars in 1016 bytes} [Wed Jul 27 15:34:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:34:54.170576 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c49414-201d-4b66-bc2d-2edd02e7fff1 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:54.183945 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c49414-201d-4b66-bc2d-2edd02e7fff1 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:54.189463 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e0799-4592-4c08-8000-7ffa78560536 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:54.190177 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e0799-4592-4c08-8000-7ffa78560536 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:54.190520 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e0799-4592-4c08-8000-7ffa78560536 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:54.190857 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e0799-4592-4c08-8000-7ffa78560536 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:54.199917 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e0799-4592-4c08-8000-7ffa78560536 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:54.201532 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9e0799-4592-4c08-8000-7ffa78560536 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:54.211658 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1377/2746] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:34:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:34:57.246155 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48568156-7885-49c7-9772-24642e9a377e None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:57.247520 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-48568156-7885-49c7-9772-24642e9a377e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:34:57.303456 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48568156-7885-49c7-9772-24642e9a377e None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:57.307084 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655eb8c8-71aa-4174-95a9-39f563bee635 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:57.307687 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655eb8c8-71aa-4174-95a9-39f563bee635 service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:57.307968 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655eb8c8-71aa-4174-95a9-39f563bee635 service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:57.308276 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655eb8c8-71aa-4174-95a9-39f563bee635 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:57.309986 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-655eb8c8-71aa-4174-95a9-39f563bee635 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:34:57.323193 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655eb8c8-71aa-4174-95a9-39f563bee635 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:57.324652 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655eb8c8-71aa-4174-95a9-39f563bee635 service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:57.335431 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1370/2747] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:34:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:34:59.892007 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e0799-4592-4c08-8000-7ffa78560536 service nova] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:34:59.893449 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9e9e0799-4592-4c08-8000-7ffa78560536 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:34:59.956112 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e0799-4592-4c08-8000-7ffa78560536 service nova] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:34:59.960355 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cdc443-9e24-4572-a535-536fc7a806a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:34:59.960524 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdc443-9e24-4572-a535-536fc7a806a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:34:59.960690 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdc443-9e24-4572-a535-536fc7a806a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:34:59.960967 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cdc443-9e24-4572-a535-536fc7a806a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:34:59.962794 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-c9cdc443-9e24-4572-a535-536fc7a806a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:34:59.976543 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cdc443-9e24-4572-a535-536fc7a806a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:34:59.978491 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cdc443-9e24-4572-a535-536fc7a806a5 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:34:59.990221 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1378/2748] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:34:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:35:07.330644 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=28 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:35:09.985901 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=56 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:35:10.522205 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ba8d1-bc74-455d-9845-ae6952aa1cf7 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:35:10.522683 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ba8d1-bc74-455d-9845-ae6952aa1cf7 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:35:10.522779 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139ba8d1-bc74-455d-9845-ae6952aa1cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:35:10.541710 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-139ba8d1-bc74-455d-9845-ae6952aa1cf7 None None] MFA Rules not processed for user `40392585cccb41f6ac827782fa61d90b`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:35:10.542889 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-139ba8d1-bc74-455d-9845-ae6952aa1cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:35:10.596767 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1371/2749] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:35:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:35:20.589932 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=25 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:35:23.542237 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233b671-cd64-4e0c-82bc-65b1ce67c45d None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:35:23.542775 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233b671-cd64-4e0c-82bc-65b1ce67c45d None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:35:23.542775 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5233b671-cd64-4e0c-82bc-65b1ce67c45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:35:23.562412 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-5233b671-cd64-4e0c-82bc-65b1ce67c45d None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:35:23.563592 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-5233b671-cd64-4e0c-82bc-65b1ce67c45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:35:23.571330 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1379/2750] 10.222.0.57 () {58 vars in 1016 bytes} [Wed Jul 27 15:35:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:35:23.594048 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ba8d1-bc74-455d-9845-ae6952aa1cf7 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:35:23.607624 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139ba8d1-bc74-455d-9845-ae6952aa1cf7 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:35:23.613259 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c79a6-3ac4-4ea0-858a-f6437fd07396 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:35:23.613859 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c79a6-3ac4-4ea0-858a-f6437fd07396 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:35:23.614142 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c79a6-3ac4-4ea0-858a-f6437fd07396 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:35:23.614417 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6c79a6-3ac4-4ea0-858a-f6437fd07396 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:35:23.622646 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c79a6-3ac4-4ea0-858a-f6437fd07396 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:35:23.624349 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6c79a6-3ac4-4ea0-858a-f6437fd07396 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:35:23.633579 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1372/2751] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:35:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:35:26.804370 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0416963-5588-402b-8711-0873bc7e1291 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:35:26.804937 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0416963-5588-402b-8711-0873bc7e1291 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:35:26.804937 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0416963-5588-402b-8711-0873bc7e1291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:35:26.825016 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-b0416963-5588-402b-8711-0873bc7e1291 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:35:26.827610 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b0416963-5588-402b-8711-0873bc7e1291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:35:26.836664 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1380/2752] 10.222.0.57 () {58 vars in 1016 bytes} [Wed Jul 27 15:35:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:35:26.858330 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c79a6-3ac4-4ea0-858a-f6437fd07396 service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:35:26.869487 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6c79a6-3ac4-4ea0-858a-f6437fd07396 service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:35:26.874922 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045d105-ce9d-419d-a4d6-95e97c90731f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:35:26.875524 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045d105-ce9d-419d-a4d6-95e97c90731f service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:35:26.875804 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045d105-ce9d-419d-a4d6-95e97c90731f service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:35:26.876111 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0045d105-ce9d-419d-a4d6-95e97c90731f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:35:26.884481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045d105-ce9d-419d-a4d6-95e97c90731f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:35:26.886553 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0045d105-ce9d-419d-a4d6-95e97c90731f service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:35:26.896345 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1373/2753] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:35:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:35:29.877912 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36eadc-dce5-4f9a-8fa7-934e9a4f4dc3 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:35:29.878437 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36eadc-dce5-4f9a-8fa7-934e9a4f4dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:35:29.878437 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac36eadc-dce5-4f9a-8fa7-934e9a4f4dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:35:29.897793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-ac36eadc-dce5-4f9a-8fa7-934e9a4f4dc3 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:35:29.898982 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ac36eadc-dce5-4f9a-8fa7-934e9a4f4dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:35:29.907309 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1381/2754] 10.222.0.57 () {58 vars in 1016 bytes} [Wed Jul 27 15:35:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:35:29.928447 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045d105-ce9d-419d-a4d6-95e97c90731f service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:35:29.939713 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0045d105-ce9d-419d-a4d6-95e97c90731f service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:35:29.945179 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4295e-c6f3-4a2b-bb2f-c57444c3283f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:35:29.945812 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4295e-c6f3-4a2b-bb2f-c57444c3283f service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:35:29.946096 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4295e-c6f3-4a2b-bb2f-c57444c3283f service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:35:29.946389 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf4295e-c6f3-4a2b-bb2f-c57444c3283f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:35:29.955007 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf4295e-c6f3-4a2b-bb2f-c57444c3283f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:35:29.956615 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf4295e-c6f3-4a2b-bb2f-c57444c3283f service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:35:29.966568 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1374/2755] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:35:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:35:33.057786 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fb497-c324-45a4-bb22-54935e92c43e None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:35:33.058276 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fb497-c324-45a4-bb22-54935e92c43e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:35:33.058376 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5fb497-c324-45a4-bb22-54935e92c43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:35:33.079003 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-6f5fb497-c324-45a4-bb22-54935e92c43e None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:35:33.080260 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6f5fb497-c324-45a4-bb22-54935e92c43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:35:33.088208 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1382/2756] 10.222.0.57 () {58 vars in 1016 bytes} [Wed Jul 27 15:35:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:35:33.115448 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4295e-c6f3-4a2b-bb2f-c57444c3283f service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:35:33.127069 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf4295e-c6f3-4a2b-bb2f-c57444c3283f service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:35:33.132749 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828a805-5426-4a0f-b333-c271a0e8c52c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:35:33.133354 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828a805-5426-4a0f-b333-c271a0e8c52c service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:35:33.133633 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828a805-5426-4a0f-b333-c271a0e8c52c service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:35:33.133903 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5828a805-5426-4a0f-b333-c271a0e8c52c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:35:33.142759 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5828a805-5426-4a0f-b333-c271a0e8c52c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:35:33.144356 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5828a805-5426-4a0f-b333-c271a0e8c52c service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:35:33.153692 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1375/2757] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:35:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:35:37.227189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c16ba3-add6-412e-966d-72e4f14e934c None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:35:37.227669 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c16ba3-add6-412e-966d-72e4f14e934c None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:35:37.227669 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c16ba3-add6-412e-966d-72e4f14e934c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:35:37.246959 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-34c16ba3-add6-412e-966d-72e4f14e934c None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:35:37.248189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-34c16ba3-add6-412e-966d-72e4f14e934c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:35:37.256016 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1383/2758] 10.222.0.57 () {58 vars in 1016 bytes} [Wed Jul 27 15:35:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:35:37.285712 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828a805-5426-4a0f-b333-c271a0e8c52c service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:35:37.296877 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5828a805-5426-4a0f-b333-c271a0e8c52c service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:35:37.302185 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66a67b-85d3-453f-8d53-fc9d42235939 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:35:37.302772 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66a67b-85d3-453f-8d53-fc9d42235939 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:35:37.303048 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66a67b-85d3-453f-8d53-fc9d42235939 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:35:37.303314 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f66a67b-85d3-453f-8d53-fc9d42235939 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:35:37.311293 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66a67b-85d3-453f-8d53-fc9d42235939 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:35:37.312856 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f66a67b-85d3-453f-8d53-fc9d42235939 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:35:37.321995 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1376/2759] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:35:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:35:47.024844 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c16ba3-add6-412e-966d-72e4f14e934c None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:35:47.037916 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c16ba3-add6-412e-966d-72e4f14e934c None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:35:47.044461 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe9e09-207b-4416-a825-2813f4862237 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:35:47.045078 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe9e09-207b-4416-a825-2813f4862237 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:35:47.045364 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe9e09-207b-4416-a825-2813f4862237 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:35:47.045640 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe9e09-207b-4416-a825-2813f4862237 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:35:47.047555 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-acfe9e09-207b-4416-a825-2813f4862237 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:35:47.063425 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe9e09-207b-4416-a825-2813f4862237 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:35:47.065265 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe9e09-207b-4416-a825-2813f4862237 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:35:47.076600 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1384/2760] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:35:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 15:35:47.317931 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=30 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:35:57.071951 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=21 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:36:03.383249 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66a67b-85d3-453f-8d53-fc9d42235939 service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:36:03.384867 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1f66a67b-85d3-453f-8d53-fc9d42235939 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:36:03.396798 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f66a67b-85d3-453f-8d53-fc9d42235939 service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:36:03.400648 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f17f9-e3b1-4491-bcb3-7318b353f81d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:36:03.401378 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f17f9-e3b1-4491-bcb3-7318b353f81d service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:36:03.401689 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f17f9-e3b1-4491-bcb3-7318b353f81d service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:36:03.401946 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5f17f9-e3b1-4491-bcb3-7318b353f81d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:36:03.403729 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6a5f17f9-e3b1-4491-bcb3-7318b353f81d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:36:03.413818 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5f17f9-e3b1-4491-bcb3-7318b353f81d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:36:03.415247 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5f17f9-e3b1-4491-bcb3-7318b353f81d service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:36:03.425561 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1377/2761] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:36:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:36:06.138668 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe9e09-207b-4416-a825-2813f4862237 service nova] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:36:06.140121 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-acfe9e09-207b-4416-a825-2813f4862237 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:36:06.155681 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe9e09-207b-4416-a825-2813f4862237 service nova] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:36:06.160136 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a18f5-919e-4aac-acdd-8dbe489871bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:36:06.160766 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a18f5-919e-4aac-acdd-8dbe489871bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:36:06.161042 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a18f5-919e-4aac-acdd-8dbe489871bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:36:06.161312 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a18f5-919e-4aac-acdd-8dbe489871bc admin admin] PATH_INFO: `/v3/users/40392585cccb41f6ac827782fa61d90b` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:36:06.162447 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a18f5-919e-4aac-acdd-8dbe489871bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=40392585cccb41f6ac827782fa61d90b)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:36:06.164379 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a18f5-919e-4aac-acdd-8dbe489871bc admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:36:06.209563 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-fb0a18f5-919e-4aac-acdd-8dbe489871bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40392585cccb41f6ac827782fa61d90b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:36:06.210196 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-fb0a18f5-919e-4aac-acdd-8dbe489871bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40392585cccb41f6ac827782fa61d90b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:36:06.217418 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-fb0a18f5-919e-4aac-acdd-8dbe489871bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40392585cccb41f6ac827782fa61d90b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:36:06.224556 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-fb0a18f5-919e-4aac-acdd-8dbe489871bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40392585cccb41f6ac827782fa61d90b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:36:06.238349 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-fb0a18f5-919e-4aac-acdd-8dbe489871bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40392585cccb41f6ac827782fa61d90b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:36:06.244983 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1385/2762] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:36:06 2022] DELETE /identity/v3/users/40392585cccb41f6ac827782fa61d90b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:36:06.418079 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f17f9-e3b1-4491-bcb3-7318b353f81d service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:36:06.433380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5f17f9-e3b1-4491-bcb3-7318b353f81d service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:36:06.489123 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02ee1d5-ce05-4f7a-bac9-69fa0823a468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:36:06.489757 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ee1d5-ce05-4f7a-bac9-69fa0823a468 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:36:06.490042 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ee1d5-ce05-4f7a-bac9-69fa0823a468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:36:06.490318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02ee1d5-ce05-4f7a-bac9-69fa0823a468 admin admin] PATH_INFO: `/v3/projects/c9574a5c5f494b58b3072fe786bc863c` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:36:06.491474 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ee1d5-ce05-4f7a-bac9-69fa0823a468 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9574a5c5f494b58b3072fe786bc863c)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:36:06.493408 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02ee1d5-ce05-4f7a-bac9-69fa0823a468 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:36:06.537699 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e02ee1d5-ce05-4f7a-bac9-69fa0823a468 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9574a5c5f494b58b3072fe786bc863c', 'request_id': 'req-e02ee1d5-ce05-4f7a-bac9-69fa0823a468'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:36:06.543841 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e02ee1d5-ce05-4f7a-bac9-69fa0823a468 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9574a5c5f494b58b3072fe786bc863c', 'request_id': 'req-e02ee1d5-ce05-4f7a-bac9-69fa0823a468'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:36:06.549170 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e02ee1d5-ce05-4f7a-bac9-69fa0823a468 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9574a5c5f494b58b3072fe786bc863c', 'request_id': 'req-e02ee1d5-ce05-4f7a-bac9-69fa0823a468'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:36:06.561115 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e02ee1d5-ce05-4f7a-bac9-69fa0823a468 admin admin] The token cache is being invalidate because project c9574a5c5f494b58b3072fe786bc863c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:36:06.561396 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e02ee1d5-ce05-4f7a-bac9-69fa0823a468 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:36:06.561999 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e02ee1d5-ce05-4f7a-bac9-69fa0823a468 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:36:06.563451 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1378/2763] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:36:06 2022] DELETE /identity/v3/projects/c9574a5c5f494b58b3072fe786bc863c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:36:06.568929 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b571b7a-5dbf-406a-8b0b-116650fdbfb6 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:36:06.569216 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b571b7a-5dbf-406a-8b0b-116650fdbfb6 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:36:06.569491 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b571b7a-5dbf-406a-8b0b-116650fdbfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:36:06.588661 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-0b571b7a-5dbf-406a-8b0b-116650fdbfb6 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:36:06.589850 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-0b571b7a-5dbf-406a-8b0b-116650fdbfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:36:06.648133 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1386/2764] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:36:06.655769 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b078e3a-9551-4250-8c9d-8a0e772fb975 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:36:06.656089 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b078e3a-9551-4250-8c9d-8a0e772fb975 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:36:06.656364 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b078e3a-9551-4250-8c9d-8a0e772fb975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:36:06.676971 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-5b078e3a-9551-4250-8c9d-8a0e772fb975 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:36:06.678184 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-5b078e3a-9551-4250-8c9d-8a0e772fb975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:36:06.686276 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1379/2765] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:36:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:36:06.690476 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b571b7a-5dbf-406a-8b0b-116650fdbfb6 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:36:06.700132 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b571b7a-5dbf-406a-8b0b-116650fdbfb6 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:36:06.704652 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6f7ad-1b61-4f29-83c2-b2e3aa7fa585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:36:06.705253 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6f7ad-1b61-4f29-83c2-b2e3aa7fa585 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:36:06.705531 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6f7ad-1b61-4f29-83c2-b2e3aa7fa585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:36:06.705805 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f6f7ad-1b61-4f29-83c2-b2e3aa7fa585 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:36:06.706494 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6f7ad-1b61-4f29-83c2-b2e3aa7fa585 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:36:06.706798 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6f7ad-1b61-4f29-83c2-b2e3aa7fa585 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:36:06.708421 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f6f7ad-1b61-4f29-83c2-b2e3aa7fa585 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:36:06.719693 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1387/2766] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:36:06.724355 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b078e3a-9551-4250-8c9d-8a0e772fb975 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:36:06.733528 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b078e3a-9551-4250-8c9d-8a0e772fb975 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:36:06.738888 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff47de-d53b-4411-9865-a103c96f41ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:36:06.739517 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff47de-d53b-4411-9865-a103c96f41ac admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:36:06.739835 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff47de-d53b-4411-9865-a103c96f41ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:36:06.740170 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ff47de-d53b-4411-9865-a103c96f41ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:36:06.740873 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff47de-d53b-4411-9865-a103c96f41ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:36:06.742796 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ff47de-d53b-4411-9865-a103c96f41ac admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:36:06.778250 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1380/2767] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:36:06 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:36:06.782226 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6f7ad-1b61-4f29-83c2-b2e3aa7fa585 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:36:06.793452 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f6f7ad-1b61-4f29-83c2-b2e3aa7fa585 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:36:06.848684 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd82bc-e64f-4ee5-b230-16aaa5c931af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:36:06.849293 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd82bc-e64f-4ee5-b230-16aaa5c931af admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:36:06.849575 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd82bc-e64f-4ee5-b230-16aaa5c931af admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:36:06.849851 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fd82bc-e64f-4ee5-b230-16aaa5c931af admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:36:06.850502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fd82bc-e64f-4ee5-b230-16aaa5c931af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:36:06.852453 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fd82bc-e64f-4ee5-b230-16aaa5c931af admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:36:06.860186 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:36:06.877997 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1388/2768] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:36:06 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:36:06.879147 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff47de-d53b-4411-9865-a103c96f41ac admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:36:06.889375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ff47de-d53b-4411-9865-a103c96f41ac admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:36:06.894030 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df981b3-3e31-4360-b2b7-64a1c70b197c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:36:06.894693 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df981b3-3e31-4360-b2b7-64a1c70b197c admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:36:06.895015 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df981b3-3e31-4360-b2b7-64a1c70b197c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:36:06.895316 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df981b3-3e31-4360-b2b7-64a1c70b197c admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:36:06.896133 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df981b3-3e31-4360-b2b7-64a1c70b197c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:36:06.897893 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df981b3-3e31-4360-b2b7-64a1c70b197c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:36:06.907729 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1381/2769] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:36:06.914596 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd82bc-e64f-4ee5-b230-16aaa5c931af admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:36:06.927381 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fd82bc-e64f-4ee5-b230-16aaa5c931af admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:36:06.932038 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7991e70-2e05-4016-8d4e-8a1669551d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:36:06.932641 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7991e70-2e05-4016-8d4e-8a1669551d7d admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:36:06.932920 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7991e70-2e05-4016-8d4e-8a1669551d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:36:06.933191 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7991e70-2e05-4016-8d4e-8a1669551d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:36:06.933882 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7991e70-2e05-4016-8d4e-8a1669551d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:36:06.935454 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7991e70-2e05-4016-8d4e-8a1669551d7d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:36:06.947263 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1389/2770] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:36:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:36:06.951756 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df981b3-3e31-4360-b2b7-64a1c70b197c admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:36:06.965168 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df981b3-3e31-4360-b2b7-64a1c70b197c admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:36:06.970051 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348cdcc-9203-4762-93b5-525a5d8b36bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:36:06.970730 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348cdcc-9203-4762-93b5-525a5d8b36bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:36:06.971016 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348cdcc-9203-4762-93b5-525a5d8b36bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:36:06.971290 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4348cdcc-9203-4762-93b5-525a5d8b36bd admin admin] PATH_INFO: `/v3/projects/b9136b9708b440c8a6c6b88b2472779a/users/17ade914bb1c4585a551d47709ecba6b/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:36:06.986216 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4348cdcc-9203-4762-93b5-525a5d8b36bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9136b9708b440c8a6c6b88b2472779a, user_id=17ade914bb1c4585a551d47709ecba6b, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:36:06.989505 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4348cdcc-9203-4762-93b5-525a5d8b36bd admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:36:07.001888 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1382/2771] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:36:06 2022] PUT /identity/v3/projects/b9136b9708b440c8a6c6b88b2472779a/users/17ade914bb1c4585a551d47709ecba6b/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:36:07.006962 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad72546-1bac-47bc-a35a-e407c51940de None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:36:07.007255 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad72546-1bac-47bc-a35a-e407c51940de None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:36:07.007536 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad72546-1bac-47bc-a35a-e407c51940de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:36:07.026691 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-6ad72546-1bac-47bc-a35a-e407c51940de None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:36:07.027887 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6ad72546-1bac-47bc-a35a-e407c51940de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:36:07.086033 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1390/2772] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:36:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:36:07.095532 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348cdcc-9203-4762-93b5-525a5d8b36bd admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:36:07.097871 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4348cdcc-9203-4762-93b5-525a5d8b36bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:36:07.104214 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:36:07.155006 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4348cdcc-9203-4762-93b5-525a5d8b36bd admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:36:07.158679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f060db9-ed1f-46d1-a2c5-40db11787f93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:36:07.159818 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f060db9-ed1f-46d1-a2c5-40db11787f93 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:36:07.160135 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f060db9-ed1f-46d1-a2c5-40db11787f93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:36:07.160411 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f060db9-ed1f-46d1-a2c5-40db11787f93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:36:07.169603 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f060db9-ed1f-46d1-a2c5-40db11787f93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:36:07.171015 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f060db9-ed1f-46d1-a2c5-40db11787f93 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:36:07.180651 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1383/2773] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:36:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:36:11.057875 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83114f-c120-4bf7-a912-94c8598cf7c6 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:36:11.058425 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83114f-c120-4bf7-a912-94c8598cf7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:36:11.058425 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c83114f-c120-4bf7-a912-94c8598cf7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:36:11.090492 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-4c83114f-c120-4bf7-a912-94c8598cf7c6 None None] MFA Rules not processed for user `17ade914bb1c4585a551d47709ecba6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:36:11.092273 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-4c83114f-c120-4bf7-a912-94c8598cf7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:36:11.172153 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1391/2774] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:36:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:36:11.176901 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f060db9-ed1f-46d1-a2c5-40db11787f93 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:36:11.191685 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f060db9-ed1f-46d1-a2c5-40db11787f93 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:36:11.197470 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523c5eb-720c-4d8c-a96e-66eead7dac22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:36:11.198125 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523c5eb-720c-4d8c-a96e-66eead7dac22 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:36:11.198412 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523c5eb-720c-4d8c-a96e-66eead7dac22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:36:11.198720 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2523c5eb-720c-4d8c-a96e-66eead7dac22 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:36:11.199630 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2523c5eb-720c-4d8c-a96e-66eead7dac22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:36:11.201474 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2523c5eb-720c-4d8c-a96e-66eead7dac22 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:36:11.241242 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83114f-c120-4bf7-a912-94c8598cf7c6 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:36:11.248197 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1384/2775] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:36:11 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:36:11.255797 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c83114f-c120-4bf7-a912-94c8598cf7c6 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:36:11.316027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1453e4-e80b-4892-8266-511a5eade0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:36:11.316672 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1453e4-e80b-4892-8266-511a5eade0d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:36:11.316958 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1453e4-e80b-4892-8266-511a5eade0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:36:11.317340 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1453e4-e80b-4892-8266-511a5eade0d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:36:11.317898 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1453e4-e80b-4892-8266-511a5eade0d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:36:11.320160 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1453e4-e80b-4892-8266-511a5eade0d4 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:36:11.337594 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:36:11.344953 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1392/2776] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:36:11 2022] POST /identity/v3/users => generated 298 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:36:11.349376 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523c5eb-720c-4d8c-a96e-66eead7dac22 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:36:11.360014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2523c5eb-720c-4d8c-a96e-66eead7dac22 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:36:11.365816 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c024cc-6047-4590-9198-c222c2999358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:36:11.366468 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c024cc-6047-4590-9198-c222c2999358 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:36:11.366750 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c024cc-6047-4590-9198-c222c2999358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:36:11.367023 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c024cc-6047-4590-9198-c222c2999358 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:36:11.367726 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c024cc-6047-4590-9198-c222c2999358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:36:11.369353 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c024cc-6047-4590-9198-c222c2999358 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:36:11.380635 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1385/2777] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:36:11.384825 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1453e4-e80b-4892-8266-511a5eade0d4 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:36:11.395553 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1453e4-e80b-4892-8266-511a5eade0d4 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:36:11.400347 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c89a7-1e9a-4adb-bd01-aa3888efbfe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:36:11.401023 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c89a7-1e9a-4adb-bd01-aa3888efbfe4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:36:11.401308 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c89a7-1e9a-4adb-bd01-aa3888efbfe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:36:11.401588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2c89a7-1e9a-4adb-bd01-aa3888efbfe4 admin admin] PATH_INFO: `/v3/projects/741b8094ae1e46a694be3435fe7f7a29/users/75f19437deb94841ad816f4955a7f764/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:36:11.418373 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c89a7-1e9a-4adb-bd01-aa3888efbfe4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=741b8094ae1e46a694be3435fe7f7a29, user_id=75f19437deb94841ad816f4955a7f764, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:36:11.421856 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2c89a7-1e9a-4adb-bd01-aa3888efbfe4 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:36:11.438809 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1393/2778] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:36:11 2022] PUT /identity/v3/projects/741b8094ae1e46a694be3435fe7f7a29/users/75f19437deb94841ad816f4955a7f764/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:36:11.442986 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c024cc-6047-4590-9198-c222c2999358 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:36:11.453765 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c024cc-6047-4590-9198-c222c2999358 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:36:11.513790 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0e3a1e-8064-425d-b6bf-4b9447de075c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:36:11.514406 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e3a1e-8064-425d-b6bf-4b9447de075c admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:36:11.514684 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e3a1e-8064-425d-b6bf-4b9447de075c admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:36:11.514953 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0e3a1e-8064-425d-b6bf-4b9447de075c admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:36:11.515645 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e3a1e-8064-425d-b6bf-4b9447de075c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:36:11.517293 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0e3a1e-8064-425d-b6bf-4b9447de075c admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:36:11.528612 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1386/2779] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:36:11 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:36:11.533074 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c89a7-1e9a-4adb-bd01-aa3888efbfe4 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:36:11.544825 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2c89a7-1e9a-4adb-bd01-aa3888efbfe4 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:36:11.549845 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf936b-582c-4754-ac75-bccad827e4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:36:11.550526 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf936b-582c-4754-ac75-bccad827e4ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:36:11.550812 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf936b-582c-4754-ac75-bccad827e4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:36:11.551098 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf936b-582c-4754-ac75-bccad827e4ff admin admin] PATH_INFO: `/v3/projects/741b8094ae1e46a694be3435fe7f7a29/users/75f19437deb94841ad816f4955a7f764/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:36:11.553151 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf936b-582c-4754-ac75-bccad827e4ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=741b8094ae1e46a694be3435fe7f7a29, user_id=75f19437deb94841ad816f4955a7f764, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:36:11.555829 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf936b-582c-4754-ac75-bccad827e4ff admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:36:11.567191 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1394/2780] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:36:11 2022] PUT /identity/v3/projects/741b8094ae1e46a694be3435fe7f7a29/users/75f19437deb94841ad816f4955a7f764/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:36:15.857847 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ebb6b-e574-43c9-9b2e-43b7bfd2896d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:36:15.858312 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ebb6b-e574-43c9-9b2e-43b7bfd2896d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:36:15.858550 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ebb6b-e574-43c9-9b2e-43b7bfd2896d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:36:15.889840 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-787ebb6b-e574-43c9-9b2e-43b7bfd2896d None None] MFA Rules not processed for user `75f19437deb94841ad816f4955a7f764`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:36:15.890983 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-787ebb6b-e574-43c9-9b2e-43b7bfd2896d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:36:15.951410 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:36:15.962868 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1387/2781] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:36:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:36:15.975213 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf936b-582c-4754-ac75-bccad827e4ff admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:36:15.976957 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-05bf936b-582c-4754-ac75-bccad827e4ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:36:16.060594 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf936b-582c-4754-ac75-bccad827e4ff admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:36:16.064293 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff647a-7804-46eb-8660-fd36a69bff34 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f71721ca75a461d92044091564de424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:36:16.065040 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff647a-7804-46eb-8660-fd36a69bff34 service glance] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:36:16.065837 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff647a-7804-46eb-8660-fd36a69bff34 service glance] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:36:16.066115 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff647a-7804-46eb-8660-fd36a69bff34 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:36:16.124439 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff647a-7804-46eb-8660-fd36a69bff34 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:36:16.125912 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cff647a-7804-46eb-8660-fd36a69bff34 service glance] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:36:16.135673 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1395/2782] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:36:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:36:16.266274 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653673f-fde3-4f30-84b9-a0e72817edb4 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:36:16.266793 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653673f-fde3-4f30-84b9-a0e72817edb4 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:36:16.267069 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1653673f-fde3-4f30-84b9-a0e72817edb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:36:16.321186 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-1653673f-fde3-4f30-84b9-a0e72817edb4 None None] MFA Rules not processed for user `b470b4c2ca1a4d1a8a864789bf603d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:36:16.322410 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1653673f-fde3-4f30-84b9-a0e72817edb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:36:16.396538 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1388/2783] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Jul 27 15:36:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:36:16.446806 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff647a-7804-46eb-8660-fd36a69bff34 service glance] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:36:16.448273 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-7cff647a-7804-46eb-8660-fd36a69bff34 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:36:16.509582 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:36:16.548140 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff647a-7804-46eb-8660-fd36a69bff34 service glance] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:36:16.556157 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec050fd1-6118-47ff-a1c0-ce519b5fb321 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68bbf8bb59a84829afacd9677c9639a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:36:16.557337 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec050fd1-6118-47ff-a1c0-ce519b5fb321 service swift] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:36:16.557631 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec050fd1-6118-47ff-a1c0-ce519b5fb321 service swift] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:36:16.557908 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec050fd1-6118-47ff-a1c0-ce519b5fb321 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:36:16.570507 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec050fd1-6118-47ff-a1c0-ce519b5fb321 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:36:16.572168 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec050fd1-6118-47ff-a1c0-ce519b5fb321 service swift] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:36:16.581309 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1396/2784] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Jul 27 15:36:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 15:36:23.356616 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653673f-fde3-4f30-84b9-a0e72817edb4 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:36:23.358365 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1653673f-fde3-4f30-84b9-a0e72817edb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:36:23.456569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1653673f-fde3-4f30-84b9-a0e72817edb4 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:36:23.463230 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06745c7-a434-48eb-b3fc-f5531a3722aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:36:23.463854 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06745c7-a434-48eb-b3fc-f5531a3722aa service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:36:23.464169 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06745c7-a434-48eb-b3fc-f5531a3722aa service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:36:23.464444 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06745c7-a434-48eb-b3fc-f5531a3722aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:36:23.466181 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e06745c7-a434-48eb-b3fc-f5531a3722aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:36:23.534687 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06745c7-a434-48eb-b3fc-f5531a3722aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:36:23.536243 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06745c7-a434-48eb-b3fc-f5531a3722aa service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:36:23.555773 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1389/2785] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:36:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:36:25.475577 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae3e36-d399-4234-8ce9-f5a86057315b None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:36:25.476152 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae3e36-d399-4234-8ce9-f5a86057315b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:36:25.476152 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ae3e36-d399-4234-8ce9-f5a86057315b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:36:25.494484 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-f3ae3e36-d399-4234-8ce9-f5a86057315b None None] MFA Rules not processed for user `17ade914bb1c4585a551d47709ecba6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:36:25.495659 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f3ae3e36-d399-4234-8ce9-f5a86057315b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:36:25.503337 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1397/2786] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:36:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:36:25.787827 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06745c7-a434-48eb-b3fc-f5531a3722aa service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:36:25.789305 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e06745c7-a434-48eb-b3fc-f5531a3722aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:36:25.795958 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:36:25.853620 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06745c7-a434-48eb-b3fc-f5531a3722aa service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:36:25.857266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce34600-8c39-48f7-b2f2-9659f19ea102 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:36:25.857941 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce34600-8c39-48f7-b2f2-9659f19ea102 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:36:25.858148 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce34600-8c39-48f7-b2f2-9659f19ea102 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:36:25.858439 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce34600-8c39-48f7-b2f2-9659f19ea102 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:36:25.860318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-bce34600-8c39-48f7-b2f2-9659f19ea102 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:36:25.870585 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce34600-8c39-48f7-b2f2-9659f19ea102 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:36:25.872015 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce34600-8c39-48f7-b2f2-9659f19ea102 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:36:25.880698 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1390/2787] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:36:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:36:26.200344 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae3e36-d399-4234-8ce9-f5a86057315b None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:36:26.201708 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f3ae3e36-d399-4234-8ce9-f5a86057315b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:36:26.281141 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ae3e36-d399-4234-8ce9-f5a86057315b None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:36:26.286539 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cdb9e-70b3-429e-a280-9255d7e3c3be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a386d326dc634cbd943ac30f6e8d08bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:36:26.287147 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cdb9e-70b3-429e-a280-9255d7e3c3be service placement] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:36:26.287426 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cdb9e-70b3-429e-a280-9255d7e3c3be service placement] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:36:26.287696 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cdb9e-70b3-429e-a280-9255d7e3c3be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:36:26.289429 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-f10cdb9e-70b3-429e-a280-9255d7e3c3be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:36:26.301437 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10cdb9e-70b3-429e-a280-9255d7e3c3be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:36:26.302984 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10cdb9e-70b3-429e-a280-9255d7e3c3be service placement] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:36:26.315027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1398/2788] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:36:26 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 15:36:27.606483 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb5989-a3f0-4134-bbd3-ce480c03bd60 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:36:27.606982 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb5989-a3f0-4134-bbd3-ce480c03bd60 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:36:27.607092 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb5989-a3f0-4134-bbd3-ce480c03bd60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:36:27.626693 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-59eb5989-a3f0-4134-bbd3-ce480c03bd60 None None] MFA Rules not processed for user `b470b4c2ca1a4d1a8a864789bf603d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:36:27.628548 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-59eb5989-a3f0-4134-bbd3-ce480c03bd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:36:27.635805 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1391/2789] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Jul 27 15:36:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:36:27.648310 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cdb9e-70b3-429e-a280-9255d7e3c3be service placement] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:36:27.659972 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cdb9e-70b3-429e-a280-9255d7e3c3be service placement] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:36:27.665861 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdba82d-ed38-46de-b827-fd0c6f170499 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68bbf8bb59a84829afacd9677c9639a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:36:27.666550 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdba82d-ed38-46de-b827-fd0c6f170499 service swift] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:36:27.667150 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdba82d-ed38-46de-b827-fd0c6f170499 service swift] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:36:27.667496 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdba82d-ed38-46de-b827-fd0c6f170499 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:36:27.676163 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdba82d-ed38-46de-b827-fd0c6f170499 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:36:27.677735 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdba82d-ed38-46de-b827-fd0c6f170499 service swift] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:36:27.685952 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1399/2790] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Jul 27 15:36:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 15:36:37.621334 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=27 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:36:37.682642 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=57 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:36:42.809472 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb5989-a3f0-4134-bbd3-ce480c03bd60 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:36:42.811102 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-59eb5989-a3f0-4134-bbd3-ce480c03bd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:36:42.829253 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb5989-a3f0-4134-bbd3-ce480c03bd60 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:36:42.838932 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a135be-4676-4e8f-bf2b-8448a5927f90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:36:42.839570 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a135be-4676-4e8f-bf2b-8448a5927f90 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:36:42.839854 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a135be-4676-4e8f-bf2b-8448a5927f90 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:36:42.840179 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a135be-4676-4e8f-bf2b-8448a5927f90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:36:42.842259 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-55a135be-4676-4e8f-bf2b-8448a5927f90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:36:42.855846 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a135be-4676-4e8f-bf2b-8448a5927f90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:36:42.857481 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a135be-4676-4e8f-bf2b-8448a5927f90 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:36:42.868861 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1392/2791] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:36:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:36:48.234149 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddef33-f913-4e9f-b541-fad788ccfbfb None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:36:48.234615 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddef33-f913-4e9f-b541-fad788ccfbfb None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:36:48.234720 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ddef33-f913-4e9f-b541-fad788ccfbfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:36:48.260065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-c2ddef33-f913-4e9f-b541-fad788ccfbfb None None] MFA Rules not processed for user `b470b4c2ca1a4d1a8a864789bf603d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:36:48.263800 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-c2ddef33-f913-4e9f-b541-fad788ccfbfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:36:48.274751 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1400/2792] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Jul 27 15:36:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:36:48.288190 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a135be-4676-4e8f-bf2b-8448a5927f90 service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:36:48.299875 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a135be-4676-4e8f-bf2b-8448a5927f90 service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:36:48.304879 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313688c6-9280-4997-b73e-fddade3e900a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68bbf8bb59a84829afacd9677c9639a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:36:48.305460 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313688c6-9280-4997-b73e-fddade3e900a service swift] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:36:48.305736 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313688c6-9280-4997-b73e-fddade3e900a service swift] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:36:48.306013 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313688c6-9280-4997-b73e-fddade3e900a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:36:48.313805 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313688c6-9280-4997-b73e-fddade3e900a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:36:48.315409 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313688c6-9280-4997-b73e-fddade3e900a service swift] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:36:48.323515 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1393/2793] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Jul 27 15:36:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 15:36:54.008846 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ddef33-f913-4e9f-b541-fad788ccfbfb None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:36:54.024023 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ddef33-f913-4e9f-b541-fad788ccfbfb None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:36:54.028269 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a03e8e-2629-4017-bfd9-ba8efde31651 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:36:54.029394 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a03e8e-2629-4017-bfd9-ba8efde31651 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:36:54.029723 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a03e8e-2629-4017-bfd9-ba8efde31651 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:36:54.030332 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a03e8e-2629-4017-bfd9-ba8efde31651 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:36:54.044614 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a03e8e-2629-4017-bfd9-ba8efde31651 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:36:54.047619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a03e8e-2629-4017-bfd9-ba8efde31651 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:36:54.060472 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1401/2794] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:36:54 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 15:36:56.216392 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313688c6-9280-4997-b73e-fddade3e900a service swift] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:36:56.237011 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313688c6-9280-4997-b73e-fddade3e900a service swift] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:36:56.248092 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dc166a-b8ae-4360-9951-1fcf9f974edd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:36:56.249234 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc166a-b8ae-4360-9951-1fcf9f974edd service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:36:56.249993 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc166a-b8ae-4360-9951-1fcf9f974edd service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:36:56.251698 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dc166a-b8ae-4360-9951-1fcf9f974edd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:36:56.259382 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-44dc166a-b8ae-4360-9951-1fcf9f974edd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:36:56.279086 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc166a-b8ae-4360-9951-1fcf9f974edd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:36:56.281084 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44dc166a-b8ae-4360-9951-1fcf9f974edd service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:36:56.296104 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1394/2795] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:36:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:37:04.054106 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=9 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:37:04.256588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a03e8e-2629-4017-bfd9-ba8efde31651 service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:37:04.265272 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a03e8e-2629-4017-bfd9-ba8efde31651 service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:37:04.269467 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad20ff-67df-4f75-a0b7-619eccc6c156 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:37:04.270224 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad20ff-67df-4f75-a0b7-619eccc6c156 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:37:04.270517 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad20ff-67df-4f75-a0b7-619eccc6c156 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:37:04.270807 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad20ff-67df-4f75-a0b7-619eccc6c156 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:37:04.272588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-14ad20ff-67df-4f75-a0b7-619eccc6c156 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:37:04.282525 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad20ff-67df-4f75-a0b7-619eccc6c156 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:37:04.284685 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad20ff-67df-4f75-a0b7-619eccc6c156 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:37:04.293478 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1402/2796] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:37:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:37:06.207641 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c04b9-9542-47b3-85f6-f82307f51023 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:37:06.208163 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c04b9-9542-47b3-85f6-f82307f51023 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:37:06.208262 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c04b9-9542-47b3-85f6-f82307f51023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:37:06.227212 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-125c04b9-9542-47b3-85f6-f82307f51023 None None] MFA Rules not processed for user `b470b4c2ca1a4d1a8a864789bf603d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:37:06.228436 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-125c04b9-9542-47b3-85f6-f82307f51023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:37:06.235521 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1395/2797] 10.222.0.40 () {58 vars in 1009 bytes} [Wed Jul 27 15:37:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:37:06.248306 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad20ff-67df-4f75-a0b7-619eccc6c156 service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:37:06.261557 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad20ff-67df-4f75-a0b7-619eccc6c156 service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:37:06.266540 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187c7d0-1af3-425f-b54a-4c9b130836dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68bbf8bb59a84829afacd9677c9639a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:37:06.267695 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187c7d0-1af3-425f-b54a-4c9b130836dc service swift] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:37:06.267980 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187c7d0-1af3-425f-b54a-4c9b130836dc service swift] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:37:06.268282 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187c7d0-1af3-425f-b54a-4c9b130836dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:37:06.276351 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187c7d0-1af3-425f-b54a-4c9b130836dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:37:06.277869 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187c7d0-1af3-425f-b54a-4c9b130836dc service swift] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:37:06.286449 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1403/2798] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Jul 27 15:37:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 15:37:16.222439 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=21 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:37:16.282649 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=12 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:37:25.242984 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3a541-baae-4144-a608-fc74f0a9bcb6 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:37:25.243486 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3a541-baae-4144-a608-fc74f0a9bcb6 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:37:25.243593 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3a541-baae-4144-a608-fc74f0a9bcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:37:25.263090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d4e3a541-baae-4144-a608-fc74f0a9bcb6 None None] MFA Rules not processed for user `b470b4c2ca1a4d1a8a864789bf603d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:37:25.264257 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d4e3a541-baae-4144-a608-fc74f0a9bcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:37:25.272074 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1396/2799] 10.222.0.40 () {58 vars in 967 bytes} [Wed Jul 27 15:37:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:37:25.293298 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187c7d0-1af3-425f-b54a-4c9b130836dc service swift] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:37:25.303793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187c7d0-1af3-425f-b54a-4c9b130836dc service swift] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:37:25.308810 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5d6ff-6745-43a4-8065-c2740c0d3ca6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68bbf8bb59a84829afacd9677c9639a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:37:25.309408 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5d6ff-6745-43a4-8065-c2740c0d3ca6 service swift] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:37:25.309690 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5d6ff-6745-43a4-8065-c2740c0d3ca6 service swift] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:37:25.309966 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef5d6ff-6745-43a4-8065-c2740c0d3ca6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:37:25.318280 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5d6ff-6745-43a4-8065-c2740c0d3ca6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:37:25.319842 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef5d6ff-6745-43a4-8065-c2740c0d3ca6 service swift] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:37:25.327840 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1404/2800] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Jul 27 15:37:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 15:37:35.258001 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:37:35.324741 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=6 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:38:25.657349 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3a541-baae-4144-a608-fc74f0a9bcb6 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:38:25.659453 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d4e3a541-baae-4144-a608-fc74f0a9bcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:38:25.676370 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3a541-baae-4144-a608-fc74f0a9bcb6 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:38:25.681329 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54254fd4-18d0-476c-92f2-27cd845b3249 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a386d326dc634cbd943ac30f6e8d08bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:38:25.681955 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54254fd4-18d0-476c-92f2-27cd845b3249 service placement] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:38:25.682232 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54254fd4-18d0-476c-92f2-27cd845b3249 service placement] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:38:25.682504 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54254fd4-18d0-476c-92f2-27cd845b3249 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:38:25.684318 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-54254fd4-18d0-476c-92f2-27cd845b3249 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:38:25.696362 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54254fd4-18d0-476c-92f2-27cd845b3249 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:38:25.697947 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54254fd4-18d0-476c-92f2-27cd845b3249 service placement] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:38:25.708308 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1397/2801] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:38:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:38:29.158316 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5d6ff-6745-43a4-8065-c2740c0d3ca6 service swift] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:38:29.167924 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef5d6ff-6745-43a4-8065-c2740c0d3ca6 service swift] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:38:29.171829 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba1512-659b-4c9b-a168-a9da72f019cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:38:29.172471 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba1512-659b-4c9b-a168-a9da72f019cf service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:38:29.172756 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba1512-659b-4c9b-a168-a9da72f019cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:38:29.173030 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ba1512-659b-4c9b-a168-a9da72f019cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:38:29.175001 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-71ba1512-659b-4c9b-a168-a9da72f019cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:38:29.242040 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba1512-659b-4c9b-a168-a9da72f019cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:38:29.244249 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ba1512-659b-4c9b-a168-a9da72f019cf service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:38:29.254716 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1405/2802] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:38:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:38:32.328577 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54254fd4-18d0-476c-92f2-27cd845b3249 service placement] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:38:32.341271 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54254fd4-18d0-476c-92f2-27cd845b3249 service placement] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:38:32.346468 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6380ad-a0c2-4e5d-b122-b958adf2f2c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a386d326dc634cbd943ac30f6e8d08bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:38:32.347131 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6380ad-a0c2-4e5d-b122-b958adf2f2c0 service placement] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:38:32.347436 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6380ad-a0c2-4e5d-b122-b958adf2f2c0 service placement] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:38:32.347717 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6380ad-a0c2-4e5d-b122-b958adf2f2c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:38:32.349519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-ad6380ad-a0c2-4e5d-b122-b958adf2f2c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:38:32.362246 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6380ad-a0c2-4e5d-b122-b958adf2f2c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:38:32.363899 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6380ad-a0c2-4e5d-b122-b958adf2f2c0 service placement] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:38:32.375090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1398/2803] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:38:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:38:32.389991 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba1512-659b-4c9b-a168-a9da72f019cf service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:38:32.391419 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-71ba1512-659b-4c9b-a168-a9da72f019cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:38:32.404566 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ba1512-659b-4c9b-a168-a9da72f019cf service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:38:32.409510 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed41874-403f-41e3-86e8-38c4d547b208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:38:32.410148 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed41874-403f-41e3-86e8-38c4d547b208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:38:32.410473 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed41874-403f-41e3-86e8-38c4d547b208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:38:32.410744 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed41874-403f-41e3-86e8-38c4d547b208 admin admin] PATH_INFO: `/v3/users/6f2efb7dbdb3468fa083b35159324081` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:38:32.412078 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed41874-403f-41e3-86e8-38c4d547b208 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f2efb7dbdb3468fa083b35159324081)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:38:32.413991 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed41874-403f-41e3-86e8-38c4d547b208 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:38:32.464616 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-0ed41874-403f-41e3-86e8-38c4d547b208 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f2efb7dbdb3468fa083b35159324081'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:38:32.465208 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-0ed41874-403f-41e3-86e8-38c4d547b208 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f2efb7dbdb3468fa083b35159324081'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:38:32.472141 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-0ed41874-403f-41e3-86e8-38c4d547b208 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f2efb7dbdb3468fa083b35159324081'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:38:32.479802 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-0ed41874-403f-41e3-86e8-38c4d547b208 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f2efb7dbdb3468fa083b35159324081'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:38:32.492082 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-0ed41874-403f-41e3-86e8-38c4d547b208 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f2efb7dbdb3468fa083b35159324081'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:38:32.498235 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1406/2804] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:38:32 2022] DELETE /identity/v3/users/6f2efb7dbdb3468fa083b35159324081 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:38:32.683103 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6380ad-a0c2-4e5d-b122-b958adf2f2c0 service placement] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:38:32.693756 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6380ad-a0c2-4e5d-b122-b958adf2f2c0 service placement] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:38:32.751338 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a49ce6-3004-4b04-bd42-a06118a06617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:38:32.751905 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a49ce6-3004-4b04-bd42-a06118a06617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:38:32.752232 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a49ce6-3004-4b04-bd42-a06118a06617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:38:32.752506 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a49ce6-3004-4b04-bd42-a06118a06617 admin admin] PATH_INFO: `/v3/projects/a6e257753bf04fe7ab7c0a57f817dae1` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:38:32.753687 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a49ce6-3004-4b04-bd42-a06118a06617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6e257753bf04fe7ab7c0a57f817dae1)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:38:32.755588 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a49ce6-3004-4b04-bd42-a06118a06617 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:38:32.800732 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a9a49ce6-3004-4b04-bd42-a06118a06617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6e257753bf04fe7ab7c0a57f817dae1', 'request_id': 'req-a9a49ce6-3004-4b04-bd42-a06118a06617'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:38:32.807224 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a9a49ce6-3004-4b04-bd42-a06118a06617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6e257753bf04fe7ab7c0a57f817dae1', 'request_id': 'req-a9a49ce6-3004-4b04-bd42-a06118a06617'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:38:32.812903 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a9a49ce6-3004-4b04-bd42-a06118a06617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6e257753bf04fe7ab7c0a57f817dae1', 'request_id': 'req-a9a49ce6-3004-4b04-bd42-a06118a06617'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:38:32.825859 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a9a49ce6-3004-4b04-bd42-a06118a06617 admin admin] The token cache is being invalidate because project a6e257753bf04fe7ab7c0a57f817dae1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:38:32.826128 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a9a49ce6-3004-4b04-bd42-a06118a06617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:38:32.826739 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a9a49ce6-3004-4b04-bd42-a06118a06617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:38:32.828327 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1399/2805] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:38:32 2022] DELETE /identity/v3/projects/a6e257753bf04fe7ab7c0a57f817dae1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:38:32.833485 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e706472-ba0b-404c-ab31-79ddbbfad463 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:38:32.833815 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e706472-ba0b-404c-ab31-79ddbbfad463 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:38:32.834147 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e706472-ba0b-404c-ab31-79ddbbfad463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:38:32.854495 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-4e706472-ba0b-404c-ab31-79ddbbfad463 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:38:32.855692 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-4e706472-ba0b-404c-ab31-79ddbbfad463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:38:32.912685 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1407/2806] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:38:32.921080 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d03101-f4fa-412d-8220-1cff0dd6ba4d None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:38:32.921373 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d03101-f4fa-412d-8220-1cff0dd6ba4d None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:38:32.921648 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d03101-f4fa-412d-8220-1cff0dd6ba4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:38:32.940581 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-d8d03101-f4fa-412d-8220-1cff0dd6ba4d None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:38:32.941761 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-d8d03101-f4fa-412d-8220-1cff0dd6ba4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:38:32.949988 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1400/2807] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:38:32.954143 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e706472-ba0b-404c-ab31-79ddbbfad463 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:38:32.964730 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e706472-ba0b-404c-ab31-79ddbbfad463 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:38:32.969404 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b09e3-f923-4a74-966e-7d1ce1e7b23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:38:32.970007 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b09e3-f923-4a74-966e-7d1ce1e7b23f admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:38:32.970289 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b09e3-f923-4a74-966e-7d1ce1e7b23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:38:32.970567 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b09e3-f923-4a74-966e-7d1ce1e7b23f admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:38:32.971260 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b09e3-f923-4a74-966e-7d1ce1e7b23f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:38:32.971565 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b09e3-f923-4a74-966e-7d1ce1e7b23f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:38:32.973191 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b09e3-f923-4a74-966e-7d1ce1e7b23f admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:38:32.974702 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:38:32.986184 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1408/2808] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:38:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 15:38:32.990405 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d03101-f4fa-412d-8220-1cff0dd6ba4d None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:38:33.000161 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d03101-f4fa-412d-8220-1cff0dd6ba4d None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:38:33.004856 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdcfddf-ba5b-4b0e-a411-3034b9314e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:38:33.005403 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcfddf-ba5b-4b0e-a411-3034b9314e59 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:38:33.005686 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcfddf-ba5b-4b0e-a411-3034b9314e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:38:33.005961 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdcfddf-ba5b-4b0e-a411-3034b9314e59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:38:33.006618 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdcfddf-ba5b-4b0e-a411-3034b9314e59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:38:33.008532 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdcfddf-ba5b-4b0e-a411-3034b9314e59 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:38:33.035585 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1401/2809] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:38:32 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:38:33.039722 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b09e3-f923-4a74-966e-7d1ce1e7b23f admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:38:33.050032 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b09e3-f923-4a74-966e-7d1ce1e7b23f admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:38:33.107973 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0616e-8228-4ea2-924f-a53282d318b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:38:33.108612 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0616e-8228-4ea2-924f-a53282d318b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:38:33.108898 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0616e-8228-4ea2-924f-a53282d318b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:38:33.109172 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0616e-8228-4ea2-924f-a53282d318b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:38:33.109845 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb0616e-8228-4ea2-924f-a53282d318b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:38:33.111751 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb0616e-8228-4ea2-924f-a53282d318b9 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:38:33.137930 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1409/2810] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:38:33 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:38:33.139536 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdcfddf-ba5b-4b0e-a411-3034b9314e59 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:38:33.149919 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdcfddf-ba5b-4b0e-a411-3034b9314e59 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:38:33.154562 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba537b-cf59-401d-a9a3-833cf38cb7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:38:33.155200 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba537b-cf59-401d-a9a3-833cf38cb7bd admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:38:33.155480 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba537b-cf59-401d-a9a3-833cf38cb7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:38:33.155757 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba537b-cf59-401d-a9a3-833cf38cb7bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:38:33.156518 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba537b-cf59-401d-a9a3-833cf38cb7bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:38:33.158103 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba537b-cf59-401d-a9a3-833cf38cb7bd admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:38:33.168714 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1402/2811] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:38:33.172522 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0616e-8228-4ea2-924f-a53282d318b9 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:38:33.183744 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0616e-8228-4ea2-924f-a53282d318b9 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:38:33.189213 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0dd43-5f04-43a7-b685-f289e6635776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:38:33.189836 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0dd43-5f04-43a7-b685-f289e6635776 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:38:33.190117 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0dd43-5f04-43a7-b685-f289e6635776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:38:33.190395 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0dd43-5f04-43a7-b685-f289e6635776 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:38:33.191093 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0dd43-5f04-43a7-b685-f289e6635776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:38:33.192762 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0dd43-5f04-43a7-b685-f289e6635776 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:38:33.204355 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1410/2812] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:38:33.208648 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba537b-cf59-401d-a9a3-833cf38cb7bd admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:38:33.218995 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba537b-cf59-401d-a9a3-833cf38cb7bd admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:38:33.223802 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6ed84-c4c8-4fd0-a70f-317698e9b4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:38:33.224501 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6ed84-c4c8-4fd0-a70f-317698e9b4bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:38:33.224787 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6ed84-c4c8-4fd0-a70f-317698e9b4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:38:33.225091 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6ed84-c4c8-4fd0-a70f-317698e9b4bf admin admin] PATH_INFO: `/v3/projects/1e474b5cd46540e9a4b03ba66b904d48/users/1b1a3f29252f48e887a5d70e06d68739/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:38:33.240387 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6ed84-c4c8-4fd0-a70f-317698e9b4bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e474b5cd46540e9a4b03ba66b904d48, user_id=1b1a3f29252f48e887a5d70e06d68739, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:38:33.243585 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6ed84-c4c8-4fd0-a70f-317698e9b4bf admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:38:33.252909 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:38:33.258350 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1403/2813] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:38:33 2022] PUT /identity/v3/projects/1e474b5cd46540e9a4b03ba66b904d48/users/1b1a3f29252f48e887a5d70e06d68739/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:38:33.269688 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d81e8-847f-4840-bbfd-2b14c972fc97 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:38:33.270005 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d81e8-847f-4840-bbfd-2b14c972fc97 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:38:33.270285 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277d81e8-847f-4840-bbfd-2b14c972fc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:38:33.298249 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-277d81e8-847f-4840-bbfd-2b14c972fc97 None None] MFA Rules not processed for user `1b1a3f29252f48e887a5d70e06d68739`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:38:33.299446 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-277d81e8-847f-4840-bbfd-2b14c972fc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:38:33.365522 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1411/2814] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:38:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:38:33.370528 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6ed84-c4c8-4fd0-a70f-317698e9b4bf admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:38:33.429842 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6ed84-c4c8-4fd0-a70f-317698e9b4bf admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:38:33.435863 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a76e3-dff7-4dd3-aeb0-45c95cc273cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:38:33.436530 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a76e3-dff7-4dd3-aeb0-45c95cc273cc admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:38:33.436813 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a76e3-dff7-4dd3-aeb0-45c95cc273cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:38:33.437182 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a76e3-dff7-4dd3-aeb0-45c95cc273cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:38:33.437866 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a76e3-dff7-4dd3-aeb0-45c95cc273cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:38:33.439873 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a76e3-dff7-4dd3-aeb0-45c95cc273cc admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:38:33.465275 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1404/2815] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:38:33 2022] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:38:33.469506 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d81e8-847f-4840-bbfd-2b14c972fc97 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:38:33.481071 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277d81e8-847f-4840-bbfd-2b14c972fc97 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:38:33.536360 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a5a27-8f06-4a55-837b-28bd499dcebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:38:33.536920 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a5a27-8f06-4a55-837b-28bd499dcebd admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:38:33.537198 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a5a27-8f06-4a55-837b-28bd499dcebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:38:33.537472 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a5a27-8f06-4a55-837b-28bd499dcebd admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:38:33.538140 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a5a27-8f06-4a55-837b-28bd499dcebd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:38:33.540809 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a5a27-8f06-4a55-837b-28bd499dcebd admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:38:33.549777 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:38:33.562516 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1412/2816] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:38:33 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:38:33.566454 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a76e3-dff7-4dd3-aeb0-45c95cc273cc admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:38:33.577841 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a76e3-dff7-4dd3-aeb0-45c95cc273cc admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:38:33.582544 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea141f3-24a9-40a1-83cc-3f7bee063a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:38:33.583157 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea141f3-24a9-40a1-83cc-3f7bee063a29 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:38:33.583441 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea141f3-24a9-40a1-83cc-3f7bee063a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:38:33.583719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea141f3-24a9-40a1-83cc-3f7bee063a29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:38:33.584463 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea141f3-24a9-40a1-83cc-3f7bee063a29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:38:33.586082 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea141f3-24a9-40a1-83cc-3f7bee063a29 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:38:33.598304 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1405/2817] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:38:33.603353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a5a27-8f06-4a55-837b-28bd499dcebd admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:38:33.614020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a5a27-8f06-4a55-837b-28bd499dcebd admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:38:33.619391 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fb2a5-6558-4647-bb9c-75ef6bab5142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:38:33.620089 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fb2a5-6558-4647-bb9c-75ef6bab5142 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:38:33.620376 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fb2a5-6558-4647-bb9c-75ef6bab5142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:38:33.620678 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13fb2a5-6558-4647-bb9c-75ef6bab5142 admin admin] PATH_INFO: `/v3/projects/22d51ad342ef46aab6065214ae235956/users/48cecdb7691b4c7b96ead0d2cb86a401/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:38:33.635373 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13fb2a5-6558-4647-bb9c-75ef6bab5142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22d51ad342ef46aab6065214ae235956, user_id=48cecdb7691b4c7b96ead0d2cb86a401, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:38:33.638111 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13fb2a5-6558-4647-bb9c-75ef6bab5142 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:38:33.650894 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1413/2818] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:38:33 2022] PUT /identity/v3/projects/22d51ad342ef46aab6065214ae235956/users/48cecdb7691b4c7b96ead0d2cb86a401/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:38:33.655169 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea141f3-24a9-40a1-83cc-3f7bee063a29 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:38:33.665690 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea141f3-24a9-40a1-83cc-3f7bee063a29 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:38:33.721804 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3301f-e3a2-4da3-ba7a-8c86efd56671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:38:33.722414 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3301f-e3a2-4da3-ba7a-8c86efd56671 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:38:33.722694 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3301f-e3a2-4da3-ba7a-8c86efd56671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:38:33.722970 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3301f-e3a2-4da3-ba7a-8c86efd56671 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:38:33.723657 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3301f-e3a2-4da3-ba7a-8c86efd56671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:38:33.725263 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3301f-e3a2-4da3-ba7a-8c86efd56671 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:38:33.735140 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1406/2819] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:38:33.739411 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fb2a5-6558-4647-bb9c-75ef6bab5142 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:38:33.750659 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13fb2a5-6558-4647-bb9c-75ef6bab5142 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:38:33.755245 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efba9a-587e-4289-81cf-4e4b72b8a4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:38:33.755898 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efba9a-587e-4289-81cf-4e4b72b8a4c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:38:33.756207 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efba9a-587e-4289-81cf-4e4b72b8a4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:38:33.756483 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7efba9a-587e-4289-81cf-4e4b72b8a4c4 admin admin] PATH_INFO: `/v3/projects/22d51ad342ef46aab6065214ae235956/users/48cecdb7691b4c7b96ead0d2cb86a401/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:38:33.758420 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7efba9a-587e-4289-81cf-4e4b72b8a4c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22d51ad342ef46aab6065214ae235956, user_id=48cecdb7691b4c7b96ead0d2cb86a401, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:38:33.761104 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7efba9a-587e-4289-81cf-4e4b72b8a4c4 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:38:33.770982 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1414/2820] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:38:33 2022] PUT /identity/v3/projects/22d51ad342ef46aab6065214ae235956/users/48cecdb7691b4c7b96ead0d2cb86a401/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:38:33.783036 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e049182-a85b-4db0-bb78-84f81b800a8b None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:38:33.783323 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e049182-a85b-4db0-bb78-84f81b800a8b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:38:33.783594 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e049182-a85b-4db0-bb78-84f81b800a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:38:33.813483 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9e049182-a85b-4db0-bb78-84f81b800a8b None None] MFA Rules not processed for user `48cecdb7691b4c7b96ead0d2cb86a401`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:38:33.814821 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9e049182-a85b-4db0-bb78-84f81b800a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:38:33.872456 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:38:33.882001 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1407/2821] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:38:33 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:38:33.893229 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efba9a-587e-4289-81cf-4e4b72b8a4c4 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:38:33.894966 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-a7efba9a-587e-4289-81cf-4e4b72b8a4c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:38:33.952592 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7efba9a-587e-4289-81cf-4e4b72b8a4c4 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:38:33.956248 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff2147-0d18-46dc-a1a5-b3ee9baa9eee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:38:33.956856 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff2147-0d18-46dc-a1a5-b3ee9baa9eee service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:38:33.957141 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff2147-0d18-46dc-a1a5-b3ee9baa9eee service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:38:33.957413 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ff2147-0d18-46dc-a1a5-b3ee9baa9eee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:38:33.966704 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff2147-0d18-46dc-a1a5-b3ee9baa9eee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:38:33.968152 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ff2147-0d18-46dc-a1a5-b3ee9baa9eee service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:38:33.977461 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1415/2822] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:38:33 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:38:34.052300 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e049182-a85b-4db0-bb78-84f81b800a8b None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:38:34.061927 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e049182-a85b-4db0-bb78-84f81b800a8b None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:38:34.065574 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb222432-2447-461c-83c2-7b4644fc718a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:38:34.066145 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb222432-2447-461c-83c2-7b4644fc718a service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:38:34.066426 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb222432-2447-461c-83c2-7b4644fc718a service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:38:34.066699 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb222432-2447-461c-83c2-7b4644fc718a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:38:34.122295 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb222432-2447-461c-83c2-7b4644fc718a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:38:34.123712 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb222432-2447-461c-83c2-7b4644fc718a service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:38:34.132482 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1408/2823] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:38:34 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:38:43.973306 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:INSERT=4,keystone:SELECT=43 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:38:44.128546 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=30 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:39:03.140172 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff2147-0d18-46dc-a1a5-b3ee9baa9eee service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:03.200845 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ff2147-0d18-46dc-a1a5-b3ee9baa9eee service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:03.205464 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a499d-94e5-44fd-892a-0aa487ebfaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:03.206066 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a499d-94e5-44fd-892a-0aa487ebfaf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:03.206348 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a499d-94e5-44fd-892a-0aa487ebfaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:03.206619 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a499d-94e5-44fd-892a-0aa487ebfaf4 admin admin] PATH_INFO: `/v3/users/1b1a3f29252f48e887a5d70e06d68739` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:03.207766 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a499d-94e5-44fd-892a-0aa487ebfaf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b1a3f29252f48e887a5d70e06d68739)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:03.209697 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a499d-94e5-44fd-892a-0aa487ebfaf4 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:03.255490 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-9b0a499d-94e5-44fd-892a-0aa487ebfaf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b1a3f29252f48e887a5d70e06d68739'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:03.256182 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-9b0a499d-94e5-44fd-892a-0aa487ebfaf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b1a3f29252f48e887a5d70e06d68739'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:03.263046 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-9b0a499d-94e5-44fd-892a-0aa487ebfaf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b1a3f29252f48e887a5d70e06d68739'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:03.270020 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-9b0a499d-94e5-44fd-892a-0aa487ebfaf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b1a3f29252f48e887a5d70e06d68739'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:03.282235 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-9b0a499d-94e5-44fd-892a-0aa487ebfaf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b1a3f29252f48e887a5d70e06d68739'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:03.287954 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1416/2824] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:39:03 2022] DELETE /identity/v3/users/1b1a3f29252f48e887a5d70e06d68739 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:39:03.293238 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db2afb-7b03-4484-8cd9-dd309cad0d37 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:03.293713 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db2afb-7b03-4484-8cd9-dd309cad0d37 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:03.294180 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54db2afb-7b03-4484-8cd9-dd309cad0d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:03.312686 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-54db2afb-7b03-4484-8cd9-dd309cad0d37 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:39:03.313864 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-54db2afb-7b03-4484-8cd9-dd309cad0d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:03.371159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1409/2825] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:39:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:39:03.383738 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a499d-94e5-44fd-892a-0aa487ebfaf4 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:03.387008 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-9b0a499d-94e5-44fd-892a-0aa487ebfaf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:03.446420 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a499d-94e5-44fd-892a-0aa487ebfaf4 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:03.450091 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564ebaa-b54c-4cda-891a-1bc7668bcff8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:03.450710 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564ebaa-b54c-4cda-891a-1bc7668bcff8 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:03.450990 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564ebaa-b54c-4cda-891a-1bc7668bcff8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:03.451263 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564ebaa-b54c-4cda-891a-1bc7668bcff8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:03.460221 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564ebaa-b54c-4cda-891a-1bc7668bcff8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:03.462327 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564ebaa-b54c-4cda-891a-1bc7668bcff8 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:03.475720 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1417/2826] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:39:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:39:03.761726 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db2afb-7b03-4484-8cd9-dd309cad0d37 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:03.763294 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-54db2afb-7b03-4484-8cd9-dd309cad0d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:03.778693 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54db2afb-7b03-4484-8cd9-dd309cad0d37 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:03.783583 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86743f9-0684-4243-a824-e781eb88b88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:03.784259 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86743f9-0684-4243-a824-e781eb88b88d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:03.784544 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86743f9-0684-4243-a824-e781eb88b88d admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:03.784821 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86743f9-0684-4243-a824-e781eb88b88d admin admin] PATH_INFO: `/v3/projects/1e474b5cd46540e9a4b03ba66b904d48` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:03.785981 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86743f9-0684-4243-a824-e781eb88b88d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e474b5cd46540e9a4b03ba66b904d48)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:03.787875 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86743f9-0684-4243-a824-e781eb88b88d admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:03.837085 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e86743f9-0684-4243-a824-e781eb88b88d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e474b5cd46540e9a4b03ba66b904d48', 'request_id': 'req-e86743f9-0684-4243-a824-e781eb88b88d'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:03.845128 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e86743f9-0684-4243-a824-e781eb88b88d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e474b5cd46540e9a4b03ba66b904d48', 'request_id': 'req-e86743f9-0684-4243-a824-e781eb88b88d'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:03.850632 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e86743f9-0684-4243-a824-e781eb88b88d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e474b5cd46540e9a4b03ba66b904d48', 'request_id': 'req-e86743f9-0684-4243-a824-e781eb88b88d'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:03.866932 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e86743f9-0684-4243-a824-e781eb88b88d admin admin] The token cache is being invalidate because project 1e474b5cd46540e9a4b03ba66b904d48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:39:03.867820 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e86743f9-0684-4243-a824-e781eb88b88d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:03.868508 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-e86743f9-0684-4243-a824-e781eb88b88d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:03.870143 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1410/2827] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:39:03 2022] DELETE /identity/v3/projects/1e474b5cd46540e9a4b03ba66b904d48 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:39:03.874218 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564ebaa-b54c-4cda-891a-1bc7668bcff8 service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:03.884631 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564ebaa-b54c-4cda-891a-1bc7668bcff8 service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:03.903118 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:39:03.948786 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea0ee4-acab-44a7-a50e-a3d88b362eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:03.949428 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea0ee4-acab-44a7-a50e-a3d88b362eac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:03.949710 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea0ee4-acab-44a7-a50e-a3d88b362eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:03.949971 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea0ee4-acab-44a7-a50e-a3d88b362eac admin admin] PATH_INFO: `/v3/users/48cecdb7691b4c7b96ead0d2cb86a401` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:03.951369 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea0ee4-acab-44a7-a50e-a3d88b362eac admin admin] RBAC: Authorizing `identity:delete_user(user_id=48cecdb7691b4c7b96ead0d2cb86a401)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:03.953312 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea0ee4-acab-44a7-a50e-a3d88b362eac admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:03.999209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-70ea0ee4-acab-44a7-a50e-a3d88b362eac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48cecdb7691b4c7b96ead0d2cb86a401'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:03.999860 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-70ea0ee4-acab-44a7-a50e-a3d88b362eac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48cecdb7691b4c7b96ead0d2cb86a401'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:04.010204 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-70ea0ee4-acab-44a7-a50e-a3d88b362eac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48cecdb7691b4c7b96ead0d2cb86a401'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:04.017610 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-70ea0ee4-acab-44a7-a50e-a3d88b362eac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48cecdb7691b4c7b96ead0d2cb86a401'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:04.031304 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-70ea0ee4-acab-44a7-a50e-a3d88b362eac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48cecdb7691b4c7b96ead0d2cb86a401'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:04.037312 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1418/2828] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:39:03 2022] DELETE /identity/v3/users/48cecdb7691b4c7b96ead0d2cb86a401 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:39:04.308443 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86743f9-0684-4243-a824-e781eb88b88d admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:04.310019 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-e86743f9-0684-4243-a824-e781eb88b88d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:04.323694 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86743f9-0684-4243-a824-e781eb88b88d admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:04.380508 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d483361a-c717-4875-a274-cb24832969ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:04.381159 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483361a-c717-4875-a274-cb24832969ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:04.381442 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483361a-c717-4875-a274-cb24832969ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:04.381721 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d483361a-c717-4875-a274-cb24832969ba admin admin] PATH_INFO: `/v3/projects/22d51ad342ef46aab6065214ae235956` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:04.382894 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d483361a-c717-4875-a274-cb24832969ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=22d51ad342ef46aab6065214ae235956)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:04.384883 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d483361a-c717-4875-a274-cb24832969ba admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:04.414658 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:39:04.432663 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d483361a-c717-4875-a274-cb24832969ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22d51ad342ef46aab6065214ae235956', 'request_id': 'req-d483361a-c717-4875-a274-cb24832969ba'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:04.439120 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d483361a-c717-4875-a274-cb24832969ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22d51ad342ef46aab6065214ae235956', 'request_id': 'req-d483361a-c717-4875-a274-cb24832969ba'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:04.444649 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d483361a-c717-4875-a274-cb24832969ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22d51ad342ef46aab6065214ae235956', 'request_id': 'req-d483361a-c717-4875-a274-cb24832969ba'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:04.456519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d483361a-c717-4875-a274-cb24832969ba admin admin] The token cache is being invalidate because project 22d51ad342ef46aab6065214ae235956 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:39:04.456809 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d483361a-c717-4875-a274-cb24832969ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:04.457435 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-d483361a-c717-4875-a274-cb24832969ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:04.458928 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1411/2829] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:39:04 2022] DELETE /identity/v3/projects/22d51ad342ef46aab6065214ae235956 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:39:04.464581 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ad717-290d-46df-ac08-a5a5ad1e3bc0 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:04.465065 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ad717-290d-46df-ac08-a5a5ad1e3bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:04.465191 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ad717-290d-46df-ac08-a5a5ad1e3bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:04.485611 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-c33ad717-290d-46df-ac08-a5a5ad1e3bc0 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:39:04.486851 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-c33ad717-290d-46df-ac08-a5a5ad1e3bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:04.546305 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1419/2830] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:39:04.555408 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b197569-e737-485b-9d53-0776b7ad2c41 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:04.555706 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b197569-e737-485b-9d53-0776b7ad2c41 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:04.556008 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b197569-e737-485b-9d53-0776b7ad2c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:04.576437 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-4b197569-e737-485b-9d53-0776b7ad2c41 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:39:04.577636 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4b197569-e737-485b-9d53-0776b7ad2c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:04.585817 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1412/2831] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:39:04.590546 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ad717-290d-46df-ac08-a5a5ad1e3bc0 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:04.600366 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ad717-290d-46df-ac08-a5a5ad1e3bc0 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:04.605579 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba230a3-e5aa-492f-845b-ac983d1ebe46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:04.606192 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba230a3-e5aa-492f-845b-ac983d1ebe46 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:04.606476 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba230a3-e5aa-492f-845b-ac983d1ebe46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:04.606752 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba230a3-e5aa-492f-845b-ac983d1ebe46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:04.607451 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba230a3-e5aa-492f-845b-ac983d1ebe46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80057) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:39:04.607756 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba230a3-e5aa-492f-845b-ac983d1ebe46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:04.609393 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba230a3-e5aa-492f-845b-ac983d1ebe46 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:04.620920 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1420/2832] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:39:04.625037 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b197569-e737-485b-9d53-0776b7ad2c41 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:04.634355 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b197569-e737-485b-9d53-0776b7ad2c41 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:04.639088 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b924c-e131-4bb9-881e-38824ac9b99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:04.639632 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b924c-e131-4bb9-881e-38824ac9b99f admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:04.639911 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b924c-e131-4bb9-881e-38824ac9b99f admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:04.640218 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b924c-e131-4bb9-881e-38824ac9b99f admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:04.640883 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b924c-e131-4bb9-881e-38824ac9b99f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:04.642857 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b924c-e131-4bb9-881e-38824ac9b99f admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:04.670537 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1413/2833] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:39:04 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:39:04.674524 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba230a3-e5aa-492f-845b-ac983d1ebe46 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:04.684420 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba230a3-e5aa-492f-845b-ac983d1ebe46 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:04.710689 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:39:04.743515 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac740a4-c99f-4be4-b1d4-2ac965f7e9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:04.744171 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac740a4-c99f-4be4-b1d4-2ac965f7e9bc admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:04.744458 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac740a4-c99f-4be4-b1d4-2ac965f7e9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:04.744734 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac740a4-c99f-4be4-b1d4-2ac965f7e9bc admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:04.745405 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac740a4-c99f-4be4-b1d4-2ac965f7e9bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:04.747330 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac740a4-c99f-4be4-b1d4-2ac965f7e9bc admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:04.767781 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1421/2834] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:39:04 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:39:04.771665 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b924c-e131-4bb9-881e-38824ac9b99f admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:04.782427 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b924c-e131-4bb9-881e-38824ac9b99f admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:04.786972 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d8bbe-9589-4930-b22e-754e5133d534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:04.787571 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d8bbe-9589-4930-b22e-754e5133d534 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:04.787871 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d8bbe-9589-4930-b22e-754e5133d534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:04.788161 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420d8bbe-9589-4930-b22e-754e5133d534 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:04.788853 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d8bbe-9589-4930-b22e-754e5133d534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:04.791052 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420d8bbe-9589-4930-b22e-754e5133d534 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:04.801569 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1414/2835] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:39:04.805289 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac740a4-c99f-4be4-b1d4-2ac965f7e9bc admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:04.815353 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac740a4-c99f-4be4-b1d4-2ac965f7e9bc admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:04.819939 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e1bf46-3af7-4ea2-8888-07991e89af6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:04.820566 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1bf46-3af7-4ea2-8888-07991e89af6c admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:04.820849 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1bf46-3af7-4ea2-8888-07991e89af6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:04.821125 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e1bf46-3af7-4ea2-8888-07991e89af6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:04.821814 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e1bf46-3af7-4ea2-8888-07991e89af6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:04.823390 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e1bf46-3af7-4ea2-8888-07991e89af6c admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:04.833838 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1422/2836] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:39:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:39:04.838304 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d8bbe-9589-4930-b22e-754e5133d534 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:04.848074 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420d8bbe-9589-4930-b22e-754e5133d534 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:04.853442 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d7538-ca39-49f1-9896-1af3996d0a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:04.854084 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d7538-ca39-49f1-9896-1af3996d0a2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:04.854371 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d7538-ca39-49f1-9896-1af3996d0a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:04.854664 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d7538-ca39-49f1-9896-1af3996d0a2a admin admin] PATH_INFO: `/v3/projects/56531e79472b41b0a4c879a4b873699a/users/db70a569f2b34177b108f5a1bd7a86d9/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:04.869430 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d7538-ca39-49f1-9896-1af3996d0a2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=56531e79472b41b0a4c879a4b873699a, user_id=db70a569f2b34177b108f5a1bd7a86d9, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:04.872072 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80d7538-ca39-49f1-9896-1af3996d0a2a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:04.885685 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1415/2837] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:39:04 2022] PUT /identity/v3/projects/56531e79472b41b0a4c879a4b873699a/users/db70a569f2b34177b108f5a1bd7a86d9/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:39:04.949831 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc498a7-9c6e-436a-b84c-bb9ea393cf89 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:04.950055 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc498a7-9c6e-436a-b84c-bb9ea393cf89 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:04.950332 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc498a7-9c6e-436a-b84c-bb9ea393cf89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:04.983637 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-abc498a7-9c6e-436a-b84c-bb9ea393cf89 None None] MFA Rules not processed for user `db70a569f2b34177b108f5a1bd7a86d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:39:04.984872 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-abc498a7-9c6e-436a-b84c-bb9ea393cf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:05.048896 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1423/2838] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:39:04 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:39:05.053671 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d7538-ca39-49f1-9896-1af3996d0a2a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:05.114010 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d7538-ca39-49f1-9896-1af3996d0a2a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:05.119240 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d7fb4-9436-4480-bdba-5fe166467e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:05.119843 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d7fb4-9436-4480-bdba-5fe166467e05 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:05.120156 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d7fb4-9436-4480-bdba-5fe166467e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:05.120434 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d7fb4-9436-4480-bdba-5fe166467e05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:05.121099 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d7fb4-9436-4480-bdba-5fe166467e05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:05.122973 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d7fb4-9436-4480-bdba-5fe166467e05 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:05.149176 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1416/2839] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:39:05 2022] POST /identity/v3/projects => generated 369 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:39:05.153271 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc498a7-9c6e-436a-b84c-bb9ea393cf89 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:05.163862 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc498a7-9c6e-436a-b84c-bb9ea393cf89 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:05.219793 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8633b8b-513f-4f2b-b0f5-ab0f2c220a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:05.220386 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8633b8b-513f-4f2b-b0f5-ab0f2c220a65 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:05.220654 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8633b8b-513f-4f2b-b0f5-ab0f2c220a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:05.220930 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8633b8b-513f-4f2b-b0f5-ab0f2c220a65 admin admin] PATH_INFO: `/v3/users` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:05.221592 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8633b8b-513f-4f2b-b0f5-ab0f2c220a65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:05.223502 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8633b8b-513f-4f2b-b0f5-ab0f2c220a65 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:05.244223 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1424/2840] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:39:05 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:39:05.248168 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d7fb4-9436-4480-bdba-5fe166467e05 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:05.258155 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d7fb4-9436-4480-bdba-5fe166467e05 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:05.262613 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d8ad3-c6d6-47d9-80c2-762f0a917f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:05.263202 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d8ad3-c6d6-47d9-80c2-762f0a917f50 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:05.263480 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d8ad3-c6d6-47d9-80c2-762f0a917f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:05.263766 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535d8ad3-c6d6-47d9-80c2-762f0a917f50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:05.264462 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d8ad3-c6d6-47d9-80c2-762f0a917f50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:05.266019 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535d8ad3-c6d6-47d9-80c2-762f0a917f50 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:05.276655 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1417/2841] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:39:05.280500 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8633b8b-513f-4f2b-b0f5-ab0f2c220a65 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:05.290819 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8633b8b-513f-4f2b-b0f5-ab0f2c220a65 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:05.295695 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d86890-4249-4d21-b396-7a04908f401b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:05.296405 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d86890-4249-4d21-b396-7a04908f401b admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:05.296691 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d86890-4249-4d21-b396-7a04908f401b admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:05.296967 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d86890-4249-4d21-b396-7a04908f401b admin admin] PATH_INFO: `/v3/projects/2da96eaee2344ba2a913b293c41e5a53/users/fddf52f5191341e0a45f92d665a1317e/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:05.311423 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d86890-4249-4d21-b396-7a04908f401b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2da96eaee2344ba2a913b293c41e5a53, user_id=fddf52f5191341e0a45f92d665a1317e, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:05.314149 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d86890-4249-4d21-b396-7a04908f401b admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:05.327705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1425/2842] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:39:05 2022] PUT /identity/v3/projects/2da96eaee2344ba2a913b293c41e5a53/users/fddf52f5191341e0a45f92d665a1317e/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:39:05.331530 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d8ad3-c6d6-47d9-80c2-762f0a917f50 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:05.341838 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535d8ad3-c6d6-47d9-80c2-762f0a917f50 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:05.361760 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:39:05.399151 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8099e3-dd1c-4d5c-a2e7-e34802257af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:05.399757 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8099e3-dd1c-4d5c-a2e7-e34802257af8 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:05.400074 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8099e3-dd1c-4d5c-a2e7-e34802257af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:05.400351 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8099e3-dd1c-4d5c-a2e7-e34802257af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:05.401035 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8099e3-dd1c-4d5c-a2e7-e34802257af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:05.402608 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8099e3-dd1c-4d5c-a2e7-e34802257af8 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:05.412071 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1418/2843] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:39:05 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:39:05.417365 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d86890-4249-4d21-b396-7a04908f401b admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:05.424655 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:39:05.431405 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d86890-4249-4d21-b396-7a04908f401b admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:05.437261 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3386ef4-3968-4d08-9976-dcc47428315e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:05.437932 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3386ef4-3968-4d08-9976-dcc47428315e admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:05.438235 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3386ef4-3968-4d08-9976-dcc47428315e admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:05.438493 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3386ef4-3968-4d08-9976-dcc47428315e admin admin] PATH_INFO: `/v3/projects/2da96eaee2344ba2a913b293c41e5a53/users/fddf52f5191341e0a45f92d665a1317e/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:05.440479 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3386ef4-3968-4d08-9976-dcc47428315e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2da96eaee2344ba2a913b293c41e5a53, user_id=fddf52f5191341e0a45f92d665a1317e, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:05.443130 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3386ef4-3968-4d08-9976-dcc47428315e admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:05.453825 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1426/2844] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:39:05 2022] PUT /identity/v3/projects/2da96eaee2344ba2a913b293c41e5a53/users/fddf52f5191341e0a45f92d665a1317e/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:39:05.464271 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c0cdf-b37d-4b14-8a52-97e3cd3ec006 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:05.464564 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c0cdf-b37d-4b14-8a52-97e3cd3ec006 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:05.464840 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8c0cdf-b37d-4b14-8a52-97e3cd3ec006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:05.492795 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-0e8c0cdf-b37d-4b14-8a52-97e3cd3ec006 None None] MFA Rules not processed for user `fddf52f5191341e0a45f92d665a1317e`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:39:05.493927 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0e8c0cdf-b37d-4b14-8a52-97e3cd3ec006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:05.560759 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1419/2845] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:39:05 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:39:05.571468 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3386ef4-3968-4d08-9976-dcc47428315e admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:05.574232 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-c3386ef4-3968-4d08-9976-dcc47428315e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:05.631603 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3386ef4-3968-4d08-9976-dcc47428315e admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:05.635734 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8120f5-e80d-42a0-9133-ac0fbf5adf2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:05.636442 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8120f5-e80d-42a0-9133-ac0fbf5adf2e service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:05.636724 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8120f5-e80d-42a0-9133-ac0fbf5adf2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:05.636998 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8120f5-e80d-42a0-9133-ac0fbf5adf2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:05.645927 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8120f5-e80d-42a0-9133-ac0fbf5adf2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:05.647346 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8120f5-e80d-42a0-9133-ac0fbf5adf2e service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:05.657491 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1427/2846] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:39:05 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:39:06.973636 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c0cdf-b37d-4b14-8a52-97e3cd3ec006 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:07.034380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8c0cdf-b37d-4b14-8a52-97e3cd3ec006 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:07.038756 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df0bc0-ec69-42f6-bd02-697cd0263a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:07.039384 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df0bc0-ec69-42f6-bd02-697cd0263a3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:07.039664 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df0bc0-ec69-42f6-bd02-697cd0263a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:07.040522 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df0bc0-ec69-42f6-bd02-697cd0263a3a admin admin] PATH_INFO: `/v3/users/db70a569f2b34177b108f5a1bd7a86d9` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:07.041703 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df0bc0-ec69-42f6-bd02-697cd0263a3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=db70a569f2b34177b108f5a1bd7a86d9)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:07.043586 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df0bc0-ec69-42f6-bd02-697cd0263a3a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:07.088495 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-71df0bc0-ec69-42f6-bd02-697cd0263a3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db70a569f2b34177b108f5a1bd7a86d9'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:07.089136 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-71df0bc0-ec69-42f6-bd02-697cd0263a3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db70a569f2b34177b108f5a1bd7a86d9'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:07.090324 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:39:07.097457 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-71df0bc0-ec69-42f6-bd02-697cd0263a3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db70a569f2b34177b108f5a1bd7a86d9'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:07.098077 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-71df0bc0-ec69-42f6-bd02-697cd0263a3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db70a569f2b34177b108f5a1bd7a86d9'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:07.110454 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-71df0bc0-ec69-42f6-bd02-697cd0263a3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db70a569f2b34177b108f5a1bd7a86d9'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:07.122745 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1420/2847] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:39:06 2022] DELETE /identity/v3/users/db70a569f2b34177b108f5a1bd7a86d9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:39:07.127295 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce32e64-fa5a-4c0b-a273-77e94edb9209 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:07.127775 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce32e64-fa5a-4c0b-a273-77e94edb9209 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:07.127875 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce32e64-fa5a-4c0b-a273-77e94edb9209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:07.146945 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-6ce32e64-fa5a-4c0b-a273-77e94edb9209 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:39:07.148183 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6ce32e64-fa5a-4c0b-a273-77e94edb9209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:07.205881 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1428/2848] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:39:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:39:07.216196 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df0bc0-ec69-42f6-bd02-697cd0263a3a admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:07.217612 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-71df0bc0-ec69-42f6-bd02-697cd0263a3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:07.272676 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df0bc0-ec69-42f6-bd02-697cd0263a3a admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:07.276922 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8675d-a1f6-4fe5-bc4e-41ac91c333fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:07.277529 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8675d-a1f6-4fe5-bc4e-41ac91c333fd service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:07.277811 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8675d-a1f6-4fe5-bc4e-41ac91c333fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:07.278086 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8675d-a1f6-4fe5-bc4e-41ac91c333fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:07.287204 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8675d-a1f6-4fe5-bc4e-41ac91c333fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:07.288649 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8675d-a1f6-4fe5-bc4e-41ac91c333fd service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:07.299290 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1421/2849] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:39:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:39:07.566837 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce32e64-fa5a-4c0b-a273-77e94edb9209 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:07.568411 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6ce32e64-fa5a-4c0b-a273-77e94edb9209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:07.581558 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce32e64-fa5a-4c0b-a273-77e94edb9209 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:07.586488 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a84164-3b47-4d7b-bbaf-203247111a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:07.587238 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a84164-3b47-4d7b-bbaf-203247111a91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:07.587588 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a84164-3b47-4d7b-bbaf-203247111a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:07.587870 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a84164-3b47-4d7b-bbaf-203247111a91 admin admin] PATH_INFO: `/v3/projects/56531e79472b41b0a4c879a4b873699a` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:07.590260 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a84164-3b47-4d7b-bbaf-203247111a91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56531e79472b41b0a4c879a4b873699a)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:07.592238 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a84164-3b47-4d7b-bbaf-203247111a91 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:07.640066 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e8a84164-3b47-4d7b-bbaf-203247111a91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56531e79472b41b0a4c879a4b873699a', 'request_id': 'req-e8a84164-3b47-4d7b-bbaf-203247111a91'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:07.646147 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e8a84164-3b47-4d7b-bbaf-203247111a91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56531e79472b41b0a4c879a4b873699a', 'request_id': 'req-e8a84164-3b47-4d7b-bbaf-203247111a91'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:07.651659 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e8a84164-3b47-4d7b-bbaf-203247111a91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56531e79472b41b0a4c879a4b873699a', 'request_id': 'req-e8a84164-3b47-4d7b-bbaf-203247111a91'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:07.663700 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e8a84164-3b47-4d7b-bbaf-203247111a91 admin admin] The token cache is being invalidate because project 56531e79472b41b0a4c879a4b873699a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:39:07.664006 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e8a84164-3b47-4d7b-bbaf-203247111a91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:07.664628 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-e8a84164-3b47-4d7b-bbaf-203247111a91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:07.666123 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1429/2850] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:39:07 2022] DELETE /identity/v3/projects/56531e79472b41b0a4c879a4b873699a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:39:07.670451 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8675d-a1f6-4fe5-bc4e-41ac91c333fd service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:07.679960 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8675d-a1f6-4fe5-bc4e-41ac91c333fd service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:07.737696 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caf4631-cf43-43b3-ade0-b41f75ed239b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:07.738362 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf4631-cf43-43b3-ade0-b41f75ed239b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:07.738646 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf4631-cf43-43b3-ade0-b41f75ed239b admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:07.738923 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf4631-cf43-43b3-ade0-b41f75ed239b admin admin] PATH_INFO: `/v3/users/fddf52f5191341e0a45f92d665a1317e` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:07.740213 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf4631-cf43-43b3-ade0-b41f75ed239b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fddf52f5191341e0a45f92d665a1317e)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:07.742162 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caf4631-cf43-43b3-ade0-b41f75ed239b admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:07.790478 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9caf4631-cf43-43b3-ade0-b41f75ed239b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fddf52f5191341e0a45f92d665a1317e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:07.791131 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9caf4631-cf43-43b3-ade0-b41f75ed239b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fddf52f5191341e0a45f92d665a1317e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:07.798514 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9caf4631-cf43-43b3-ade0-b41f75ed239b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fddf52f5191341e0a45f92d665a1317e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:07.799197 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9caf4631-cf43-43b3-ade0-b41f75ed239b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fddf52f5191341e0a45f92d665a1317e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:07.813190 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:39:07.816804 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-9caf4631-cf43-43b3-ade0-b41f75ed239b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fddf52f5191341e0a45f92d665a1317e'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:07.831495 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1422/2851] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:39:07 2022] DELETE /identity/v3/users/fddf52f5191341e0a45f92d665a1317e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:39:08.277490 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a84164-3b47-4d7b-bbaf-203247111a91 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:08.279071 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e8a84164-3b47-4d7b-bbaf-203247111a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:08.292251 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a84164-3b47-4d7b-bbaf-203247111a91 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:08.309702 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:39:08.358800 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bffa93-177a-43d2-b35a-90be33017e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:08.359437 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bffa93-177a-43d2-b35a-90be33017e74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:08.359716 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bffa93-177a-43d2-b35a-90be33017e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:08.360023 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bffa93-177a-43d2-b35a-90be33017e74 admin admin] PATH_INFO: `/v3/projects/2da96eaee2344ba2a913b293c41e5a53` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:08.361149 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bffa93-177a-43d2-b35a-90be33017e74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2da96eaee2344ba2a913b293c41e5a53)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:08.363043 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bffa93-177a-43d2-b35a-90be33017e74 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:08.412270 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-c7bffa93-177a-43d2-b35a-90be33017e74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2da96eaee2344ba2a913b293c41e5a53', 'request_id': 'req-c7bffa93-177a-43d2-b35a-90be33017e74'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:08.418670 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-c7bffa93-177a-43d2-b35a-90be33017e74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2da96eaee2344ba2a913b293c41e5a53', 'request_id': 'req-c7bffa93-177a-43d2-b35a-90be33017e74'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:08.424788 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-c7bffa93-177a-43d2-b35a-90be33017e74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2da96eaee2344ba2a913b293c41e5a53', 'request_id': 'req-c7bffa93-177a-43d2-b35a-90be33017e74'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:08.441569 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-c7bffa93-177a-43d2-b35a-90be33017e74 admin admin] The token cache is being invalidate because project 2da96eaee2344ba2a913b293c41e5a53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:39:08.442005 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-c7bffa93-177a-43d2-b35a-90be33017e74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:08.442755 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-c7bffa93-177a-43d2-b35a-90be33017e74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:08.444359 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1430/2852] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:39:08 2022] DELETE /identity/v3/projects/2da96eaee2344ba2a913b293c41e5a53 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:39:08.449348 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945ec02-df01-4b0a-940a-a2487fad72ef None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:08.449861 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945ec02-df01-4b0a-940a-a2487fad72ef None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:08.449983 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9945ec02-df01-4b0a-940a-a2487fad72ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:08.469969 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-9945ec02-df01-4b0a-940a-a2487fad72ef None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:39:08.471175 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-9945ec02-df01-4b0a-940a-a2487fad72ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:08.529465 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1423/2853] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:39:08.538257 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16f734-9558-490d-85c4-37c7e34f2226 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:08.538542 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16f734-9558-490d-85c4-37c7e34f2226 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:08.538818 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16f734-9558-490d-85c4-37c7e34f2226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:08.558804 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-1c16f734-9558-490d-85c4-37c7e34f2226 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:39:08.560063 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-1c16f734-9558-490d-85c4-37c7e34f2226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:08.567830 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1431/2854] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:39:08.571919 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945ec02-df01-4b0a-940a-a2487fad72ef None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:08.582461 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9945ec02-df01-4b0a-940a-a2487fad72ef None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:08.587634 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc49ecf-60c4-443a-b40a-8f82e05f1277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:08.588281 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc49ecf-60c4-443a-b40a-8f82e05f1277 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:08.588561 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc49ecf-60c4-443a-b40a-8f82e05f1277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:08.588836 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc49ecf-60c4-443a-b40a-8f82e05f1277 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:08.589562 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc49ecf-60c4-443a-b40a-8f82e05f1277 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:39:08.589869 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc49ecf-60c4-443a-b40a-8f82e05f1277 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:08.591462 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc49ecf-60c4-443a-b40a-8f82e05f1277 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:08.604042 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1424/2855] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:39:08.608189 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16f734-9558-490d-85c4-37c7e34f2226 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:08.617297 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16f734-9558-490d-85c4-37c7e34f2226 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:08.622016 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70828334-6512-4dd2-ab0e-ffa5624e1e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:08.622605 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70828334-6512-4dd2-ab0e-ffa5624e1e70 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:08.622883 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70828334-6512-4dd2-ab0e-ffa5624e1e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:08.623212 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70828334-6512-4dd2-ab0e-ffa5624e1e70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:08.623874 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70828334-6512-4dd2-ab0e-ffa5624e1e70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:08.625797 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70828334-6512-4dd2-ab0e-ffa5624e1e70 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:08.652717 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1432/2856] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:39:08 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:39:08.656743 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc49ecf-60c4-443a-b40a-8f82e05f1277 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:08.666638 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc49ecf-60c4-443a-b40a-8f82e05f1277 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:08.723813 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bf244-e466-4370-ad23-f5c2deea5aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:08.724461 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bf244-e466-4370-ad23-f5c2deea5aec admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:08.724767 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bf244-e466-4370-ad23-f5c2deea5aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:08.725026 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bf244-e466-4370-ad23-f5c2deea5aec admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:08.725694 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9bf244-e466-4370-ad23-f5c2deea5aec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:08.727578 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9bf244-e466-4370-ad23-f5c2deea5aec admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:08.747630 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1425/2857] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:39:08 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:39:08.751832 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70828334-6512-4dd2-ab0e-ffa5624e1e70 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:08.764870 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70828334-6512-4dd2-ab0e-ffa5624e1e70 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:08.770126 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f259d0-e5be-485d-af35-9c2b63527dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:08.770733 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f259d0-e5be-485d-af35-9c2b63527dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:08.771016 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f259d0-e5be-485d-af35-9c2b63527dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:08.771290 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f259d0-e5be-485d-af35-9c2b63527dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:08.771980 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f259d0-e5be-485d-af35-9c2b63527dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:08.773643 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f259d0-e5be-485d-af35-9c2b63527dc5 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:08.787028 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1433/2858] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:39:08.791047 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bf244-e466-4370-ad23-f5c2deea5aec admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:08.801220 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9bf244-e466-4370-ad23-f5c2deea5aec admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:08.805878 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd353487-6204-4c9a-9015-7e82268092b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:08.806474 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd353487-6204-4c9a-9015-7e82268092b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:08.806756 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd353487-6204-4c9a-9015-7e82268092b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:08.807032 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd353487-6204-4c9a-9015-7e82268092b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:08.807725 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd353487-6204-4c9a-9015-7e82268092b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:08.809407 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd353487-6204-4c9a-9015-7e82268092b1 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:08.820206 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1426/2859] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:39:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 15:39:08.824661 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f259d0-e5be-485d-af35-9c2b63527dc5 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:08.834657 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f259d0-e5be-485d-af35-9c2b63527dc5 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:08.840003 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0cdab4-063a-41c1-a6f4-7aaa753d6223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:08.840665 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cdab4-063a-41c1-a6f4-7aaa753d6223 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:08.840950 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cdab4-063a-41c1-a6f4-7aaa753d6223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:08.841254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0cdab4-063a-41c1-a6f4-7aaa753d6223 admin admin] PATH_INFO: `/v3/projects/808a53473c834fce8ae18825df44b341/users/9b50dfd2bdd340018657650fe590be16/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:08.855518 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0cdab4-063a-41c1-a6f4-7aaa753d6223 admin admin] RBAC: Authorizing `identity:create_grant(project_id=808a53473c834fce8ae18825df44b341, user_id=9b50dfd2bdd340018657650fe590be16, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:08.858182 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0cdab4-063a-41c1-a6f4-7aaa753d6223 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:08.871697 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1434/2860] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:39:08 2022] PUT /identity/v3/projects/808a53473c834fce8ae18825df44b341/users/9b50dfd2bdd340018657650fe590be16/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 15:39:08.881762 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cd6ea-f369-468c-8679-bcca102cec6e None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:08.882056 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cd6ea-f369-468c-8679-bcca102cec6e None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:08.882336 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cd6ea-f369-468c-8679-bcca102cec6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:08.910210 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-dd7cd6ea-f369-468c-8679-bcca102cec6e None None] MFA Rules not processed for user `9b50dfd2bdd340018657650fe590be16`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:39:08.911555 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-dd7cd6ea-f369-468c-8679-bcca102cec6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:08.952585 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:39:08.977377 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1427/2861] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:39:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:39:08.988785 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0cdab4-063a-41c1-a6f4-7aaa753d6223 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:08.990556 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-dc0cdab4-063a-41c1-a6f4-7aaa753d6223 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:09.035918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:39:09.053564 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0cdab4-063a-41c1-a6f4-7aaa753d6223 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:09.058049 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b6274-b1e4-47f6-ac1b-b89540cdab23 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2f71721ca75a461d92044091564de424', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:09.058744 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b6274-b1e4-47f6-ac1b-b89540cdab23 service glance] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:09.059114 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b6274-b1e4-47f6-ac1b-b89540cdab23 service glance] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:09.059412 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b6274-b1e4-47f6-ac1b-b89540cdab23 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:09.076380 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b6274-b1e4-47f6-ac1b-b89540cdab23 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:09.077778 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b6274-b1e4-47f6-ac1b-b89540cdab23 service glance] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:09.091806 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1435/2862] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:39:08 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:39:18.974424 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=8 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:39:19.085877 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=7 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:39:26.300771 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdb43d-30a9-4681-8617-14d32a466cec None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:26.301266 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdb43d-30a9-4681-8617-14d32a466cec None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:26.301361 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdb43d-30a9-4681-8617-14d32a466cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:26.320439 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-f6bdb43d-30a9-4681-8617-14d32a466cec None None] MFA Rules not processed for user `b470b4c2ca1a4d1a8a864789bf603d02`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:39:26.322218 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-f6bdb43d-30a9-4681-8617-14d32a466cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:26.381349 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1428/2863] 10.222.0.40 () {58 vars in 967 bytes} [Wed Jul 27 15:39:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:39:26.429544 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b6274-b1e4-47f6-ac1b-b89540cdab23 service glance] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:26.431546 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-030b6274-b1e4-47f6-ac1b-b89540cdab23 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:26.502712 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b6274-b1e4-47f6-ac1b-b89540cdab23 service glance] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:26.507660 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfef09-6fd4-4087-a467-8aa0cd9da9a6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '68bbf8bb59a84829afacd9677c9639a6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:26.508929 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfef09-6fd4-4087-a467-8aa0cd9da9a6 service swift] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:26.509211 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfef09-6fd4-4087-a467-8aa0cd9da9a6 service swift] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:26.509485 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfef09-6fd4-4087-a467-8aa0cd9da9a6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:26.517645 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfef09-6fd4-4087-a467-8aa0cd9da9a6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:26.519214 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfef09-6fd4-4087-a467-8aa0cd9da9a6 service swift] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:26.527302 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1436/2864] 10.222.0.40 () {60 vars in 1384 bytes} [Wed Jul 27 15:39:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 15:39:28.857766 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdb43d-30a9-4681-8617-14d32a466cec None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:28.922813 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdb43d-30a9-4681-8617-14d32a466cec None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:28.927511 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ed75b-367f-4bc9-860f-277748914172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:28.928184 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ed75b-367f-4bc9-860f-277748914172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:28.928463 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ed75b-367f-4bc9-860f-277748914172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:28.928734 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ed75b-367f-4bc9-860f-277748914172 admin admin] PATH_INFO: `/v3/users/9b50dfd2bdd340018657650fe590be16` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:28.929912 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ed75b-367f-4bc9-860f-277748914172 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b50dfd2bdd340018657650fe590be16)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:28.932562 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3ed75b-367f-4bc9-860f-277748914172 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:28.984246 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8e3ed75b-367f-4bc9-860f-277748914172 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b50dfd2bdd340018657650fe590be16'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:28.984971 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8e3ed75b-367f-4bc9-860f-277748914172 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b50dfd2bdd340018657650fe590be16'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:28.992743 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8e3ed75b-367f-4bc9-860f-277748914172 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b50dfd2bdd340018657650fe590be16'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:28.993510 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8e3ed75b-367f-4bc9-860f-277748914172 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b50dfd2bdd340018657650fe590be16'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:29.007165 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-8e3ed75b-367f-4bc9-860f-277748914172 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b50dfd2bdd340018657650fe590be16'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:29.021450 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1429/2865] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:39:28 2022] DELETE /identity/v3/users/9b50dfd2bdd340018657650fe590be16 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:39:29.026592 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62283a86-4b57-450a-be5a-b467b562ef32 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:29.027071 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62283a86-4b57-450a-be5a-b467b562ef32 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:29.027284 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62283a86-4b57-450a-be5a-b467b562ef32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:29.049229 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-62283a86-4b57-450a-be5a-b467b562ef32 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:39:29.050591 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-62283a86-4b57-450a-be5a-b467b562ef32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:29.122823 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1437/2866] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:39:29.134346 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ed75b-367f-4bc9-860f-277748914172 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:29.136090 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-8e3ed75b-367f-4bc9-860f-277748914172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:29.191671 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:39:29.243838 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ed75b-367f-4bc9-860f-277748914172 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:29.247627 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6462ea9-a748-461a-84c2-a46d0868ef34 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:29.248283 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6462ea9-a748-461a-84c2-a46d0868ef34 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:29.248568 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6462ea9-a748-461a-84c2-a46d0868ef34 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:29.248850 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6462ea9-a748-461a-84c2-a46d0868ef34 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:29.258199 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6462ea9-a748-461a-84c2-a46d0868ef34 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:29.259634 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6462ea9-a748-461a-84c2-a46d0868ef34 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:29.269463 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1430/2867] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:39:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:39:29.985616 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62283a86-4b57-450a-be5a-b467b562ef32 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:29.987081 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-62283a86-4b57-450a-be5a-b467b562ef32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:30.000399 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62283a86-4b57-450a-be5a-b467b562ef32 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:30.005223 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed80200-aa73-4321-9923-d175fd523bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:30.005946 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed80200-aa73-4321-9923-d175fd523bc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:30.006322 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed80200-aa73-4321-9923-d175fd523bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:30.006705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed80200-aa73-4321-9923-d175fd523bc5 admin admin] PATH_INFO: `/v3/projects/808a53473c834fce8ae18825df44b341` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:30.007957 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed80200-aa73-4321-9923-d175fd523bc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=808a53473c834fce8ae18825df44b341)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:30.010623 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed80200-aa73-4321-9923-d175fd523bc5 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:30.062824 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6ed80200-aa73-4321-9923-d175fd523bc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '808a53473c834fce8ae18825df44b341', 'request_id': 'req-6ed80200-aa73-4321-9923-d175fd523bc5'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:30.069134 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6ed80200-aa73-4321-9923-d175fd523bc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '808a53473c834fce8ae18825df44b341', 'request_id': 'req-6ed80200-aa73-4321-9923-d175fd523bc5'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:30.076306 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6ed80200-aa73-4321-9923-d175fd523bc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '808a53473c834fce8ae18825df44b341', 'request_id': 'req-6ed80200-aa73-4321-9923-d175fd523bc5'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:30.090843 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6ed80200-aa73-4321-9923-d175fd523bc5 admin admin] The token cache is being invalidate because project 808a53473c834fce8ae18825df44b341 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:39:30.091133 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6ed80200-aa73-4321-9923-d175fd523bc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:30.091775 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-6ed80200-aa73-4321-9923-d175fd523bc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:30.093500 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1438/2868] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:39:29 2022] DELETE /identity/v3/projects/808a53473c834fce8ae18825df44b341 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:39:30.098493 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8098387-8a81-43ff-8ecb-eeb88c8eda58 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:30.098978 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8098387-8a81-43ff-8ecb-eeb88c8eda58 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:30.099257 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8098387-8a81-43ff-8ecb-eeb88c8eda58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:30.123748 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-b8098387-8a81-43ff-8ecb-eeb88c8eda58 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:39:30.125256 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-b8098387-8a81-43ff-8ecb-eeb88c8eda58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:30.193466 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1431/2869] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:39:30.203125 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac23a6d-dde0-47bf-9db9-e3b5f6c64497 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:30.203415 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac23a6d-dde0-47bf-9db9-e3b5f6c64497 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:30.203694 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac23a6d-dde0-47bf-9db9-e3b5f6c64497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:30.226366 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-0ac23a6d-dde0-47bf-9db9-e3b5f6c64497 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:39:30.227675 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-0ac23a6d-dde0-47bf-9db9-e3b5f6c64497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:30.237750 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1439/2870] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:39:30.241736 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8098387-8a81-43ff-8ecb-eeb88c8eda58 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:30.252686 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8098387-8a81-43ff-8ecb-eeb88c8eda58 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:30.257583 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09bd99-b565-4a38-afab-ff58336f8007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:30.259026 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09bd99-b565-4a38-afab-ff58336f8007 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:30.259384 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09bd99-b565-4a38-afab-ff58336f8007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:30.259724 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09bd99-b565-4a38-afab-ff58336f8007 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:30.260541 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e09bd99-b565-4a38-afab-ff58336f8007 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:39:30.260918 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e09bd99-b565-4a38-afab-ff58336f8007 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:30.262619 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e09bd99-b565-4a38-afab-ff58336f8007 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:30.277686 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1432/2871] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:39:30.282703 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac23a6d-dde0-47bf-9db9-e3b5f6c64497 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:30.293988 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac23a6d-dde0-47bf-9db9-e3b5f6c64497 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:30.299405 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01686816-6572-46ad-a46f-3d4d2df3f78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:30.300333 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01686816-6572-46ad-a46f-3d4d2df3f78b admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:30.300618 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01686816-6572-46ad-a46f-3d4d2df3f78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:30.300892 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01686816-6572-46ad-a46f-3d4d2df3f78b admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:30.301728 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01686816-6572-46ad-a46f-3d4d2df3f78b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:30.303662 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01686816-6572-46ad-a46f-3d4d2df3f78b admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:30.308830 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:39:30.337947 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1440/2872] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:39:30 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:39:30.342495 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09bd99-b565-4a38-afab-ff58336f8007 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:30.353676 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09bd99-b565-4a38-afab-ff58336f8007 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:30.428169 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67896f5d-3d44-47a5-a1f4-f35e66aed074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:30.428877 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67896f5d-3d44-47a5-a1f4-f35e66aed074 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:30.429232 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67896f5d-3d44-47a5-a1f4-f35e66aed074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:30.429581 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67896f5d-3d44-47a5-a1f4-f35e66aed074 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:30.430350 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67896f5d-3d44-47a5-a1f4-f35e66aed074 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:30.432822 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67896f5d-3d44-47a5-a1f4-f35e66aed074 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:30.475470 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1433/2873] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:39:30 2022] POST /identity/v3/users => generated 292 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:39:30.479855 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01686816-6572-46ad-a46f-3d4d2df3f78b admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:30.491567 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01686816-6572-46ad-a46f-3d4d2df3f78b admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:30.496740 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6d517-a8cc-4ea8-8b14-88315c13ad35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:30.497383 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6d517-a8cc-4ea8-8b14-88315c13ad35 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:30.497839 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6d517-a8cc-4ea8-8b14-88315c13ad35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:30.498111 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6d517-a8cc-4ea8-8b14-88315c13ad35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:30.499109 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6d517-a8cc-4ea8-8b14-88315c13ad35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:30.500940 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6d517-a8cc-4ea8-8b14-88315c13ad35 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:30.511976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1441/2874] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:39:30.516230 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67896f5d-3d44-47a5-a1f4-f35e66aed074 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:30.526877 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67896f5d-3d44-47a5-a1f4-f35e66aed074 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:30.531509 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b6c235-820e-4c97-80b5-340171cab4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:30.532147 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6c235-820e-4c97-80b5-340171cab4cf admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:30.532430 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6c235-820e-4c97-80b5-340171cab4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:30.532742 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b6c235-820e-4c97-80b5-340171cab4cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:30.533396 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6c235-820e-4c97-80b5-340171cab4cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:30.534978 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b6c235-820e-4c97-80b5-340171cab4cf admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:30.546132 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1434/2875] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:39:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:39:30.550484 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6d517-a8cc-4ea8-8b14-88315c13ad35 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:30.560618 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6d517-a8cc-4ea8-8b14-88315c13ad35 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:30.565303 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969c404-ea09-489a-b654-0ef138478cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:30.565955 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969c404-ea09-489a-b654-0ef138478cc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:30.566232 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969c404-ea09-489a-b654-0ef138478cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:30.566509 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6969c404-ea09-489a-b654-0ef138478cc7 admin admin] PATH_INFO: `/v3/projects/edceb6e015ee44d7a74fc1b703277c49/users/abf414be42824a74919e202e23e53143/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:30.584388 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6969c404-ea09-489a-b654-0ef138478cc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edceb6e015ee44d7a74fc1b703277c49, user_id=abf414be42824a74919e202e23e53143, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:30.588001 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6969c404-ea09-489a-b654-0ef138478cc7 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:30.603383 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1442/2876] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:39:30 2022] PUT /identity/v3/projects/edceb6e015ee44d7a74fc1b703277c49/users/abf414be42824a74919e202e23e53143/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:39:30.613830 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef59d64-b486-4eaf-88d3-031984e87abc None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:30.614122 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef59d64-b486-4eaf-88d3-031984e87abc None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:30.614399 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef59d64-b486-4eaf-88d3-031984e87abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:30.642791 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-7ef59d64-b486-4eaf-88d3-031984e87abc None None] MFA Rules not processed for user `abf414be42824a74919e202e23e53143`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:39:30.644016 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7ef59d64-b486-4eaf-88d3-031984e87abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:30.665256 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:39:30.714791 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1435/2877] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:39:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:39:30.725604 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969c404-ea09-489a-b654-0ef138478cc7 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:30.727812 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6969c404-ea09-489a-b654-0ef138478cc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:30.788239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6969c404-ea09-489a-b654-0ef138478cc7 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:30.791965 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9293016-8e71-4e8b-b12c-a3bc24a1cd28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:30.792617 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9293016-8e71-4e8b-b12c-a3bc24a1cd28 service cinder] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:30.792898 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9293016-8e71-4e8b-b12c-a3bc24a1cd28 service cinder] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:30.793174 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9293016-8e71-4e8b-b12c-a3bc24a1cd28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:30.802052 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9293016-8e71-4e8b-b12c-a3bc24a1cd28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:30.803413 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9293016-8e71-4e8b-b12c-a3bc24a1cd28 service cinder] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:30.813549 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1443/2878] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:39:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:39:33.429535 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef59d64-b486-4eaf-88d3-031984e87abc None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:33.431643 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7ef59d64-b486-4eaf-88d3-031984e87abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:33.501937 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef59d64-b486-4eaf-88d3-031984e87abc None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:33.506530 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87cc52-f15e-4a9c-bf61-38bb50c2bd32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:33.507169 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87cc52-f15e-4a9c-bf61-38bb50c2bd32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:33.507449 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87cc52-f15e-4a9c-bf61-38bb50c2bd32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:33.507724 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b87cc52-f15e-4a9c-bf61-38bb50c2bd32 admin admin] PATH_INFO: `/v3/users/17ade914bb1c4585a551d47709ecba6b` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:33.508969 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87cc52-f15e-4a9c-bf61-38bb50c2bd32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17ade914bb1c4585a551d47709ecba6b)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:33.510869 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b87cc52-f15e-4a9c-bf61-38bb50c2bd32 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:33.563745 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7b87cc52-f15e-4a9c-bf61-38bb50c2bd32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17ade914bb1c4585a551d47709ecba6b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:33.564451 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7b87cc52-f15e-4a9c-bf61-38bb50c2bd32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17ade914bb1c4585a551d47709ecba6b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:33.571847 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7b87cc52-f15e-4a9c-bf61-38bb50c2bd32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17ade914bb1c4585a551d47709ecba6b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:33.572565 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7b87cc52-f15e-4a9c-bf61-38bb50c2bd32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17ade914bb1c4585a551d47709ecba6b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:33.590373 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-7b87cc52-f15e-4a9c-bf61-38bb50c2bd32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17ade914bb1c4585a551d47709ecba6b'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:33.605316 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1436/2879] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:39:33 2022] DELETE /identity/v3/users/17ade914bb1c4585a551d47709ecba6b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:39:33.801567 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9293016-8e71-4e8b-b12c-a3bc24a1cd28 service cinder] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:33.819236 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9293016-8e71-4e8b-b12c-a3bc24a1cd28 service cinder] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:33.880066 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15124a78-5a59-4878-89cd-01ce48c4565f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:33.880709 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15124a78-5a59-4878-89cd-01ce48c4565f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:33.880998 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15124a78-5a59-4878-89cd-01ce48c4565f admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:33.881284 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15124a78-5a59-4878-89cd-01ce48c4565f admin admin] PATH_INFO: `/v3/projects/b9136b9708b440c8a6c6b88b2472779a` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:33.882434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15124a78-5a59-4878-89cd-01ce48c4565f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9136b9708b440c8a6c6b88b2472779a)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:33.884948 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15124a78-5a59-4878-89cd-01ce48c4565f admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:33.935358 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-15124a78-5a59-4878-89cd-01ce48c4565f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9136b9708b440c8a6c6b88b2472779a', 'request_id': 'req-15124a78-5a59-4878-89cd-01ce48c4565f'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:33.941946 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-15124a78-5a59-4878-89cd-01ce48c4565f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9136b9708b440c8a6c6b88b2472779a', 'request_id': 'req-15124a78-5a59-4878-89cd-01ce48c4565f'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:33.943183 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:39:33.948997 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-15124a78-5a59-4878-89cd-01ce48c4565f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9136b9708b440c8a6c6b88b2472779a', 'request_id': 'req-15124a78-5a59-4878-89cd-01ce48c4565f'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:33.964863 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-15124a78-5a59-4878-89cd-01ce48c4565f admin admin] The token cache is being invalidate because project b9136b9708b440c8a6c6b88b2472779a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:39:33.965045 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-15124a78-5a59-4878-89cd-01ce48c4565f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:33.965705 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-15124a78-5a59-4878-89cd-01ce48c4565f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:33.967693 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1444/2880] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:39:33 2022] DELETE /identity/v3/projects/b9136b9708b440c8a6c6b88b2472779a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:39:33.972273 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87cc52-f15e-4a9c-bf61-38bb50c2bd32 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:33.975561 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-7b87cc52-f15e-4a9c-bf61-38bb50c2bd32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:33.992707 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b87cc52-f15e-4a9c-bf61-38bb50c2bd32 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:34.041554 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:39:34.061790 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb415dc5-a714-43a9-9fdb-5150f37c7421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:34.062430 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb415dc5-a714-43a9-9fdb-5150f37c7421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:34.062720 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb415dc5-a714-43a9-9fdb-5150f37c7421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:34.062995 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb415dc5-a714-43a9-9fdb-5150f37c7421 admin admin] PATH_INFO: `/v3/users/75f19437deb94841ad816f4955a7f764` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:34.064263 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb415dc5-a714-43a9-9fdb-5150f37c7421 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75f19437deb94841ad816f4955a7f764)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:34.068290 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb415dc5-a714-43a9-9fdb-5150f37c7421 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:34.114142 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fb415dc5-a714-43a9-9fdb-5150f37c7421 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75f19437deb94841ad816f4955a7f764'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:34.114777 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fb415dc5-a714-43a9-9fdb-5150f37c7421 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75f19437deb94841ad816f4955a7f764'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:34.121974 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fb415dc5-a714-43a9-9fdb-5150f37c7421 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75f19437deb94841ad816f4955a7f764'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:34.122593 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fb415dc5-a714-43a9-9fdb-5150f37c7421 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75f19437deb94841ad816f4955a7f764'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:34.135029 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-fb415dc5-a714-43a9-9fdb-5150f37c7421 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75f19437deb94841ad816f4955a7f764'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:34.147299 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1437/2881] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:39:33 2022] DELETE /identity/v3/users/75f19437deb94841ad816f4955a7f764 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:39:34.318918 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15124a78-5a59-4878-89cd-01ce48c4565f admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:34.320981 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-15124a78-5a59-4878-89cd-01ce48c4565f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:34.334034 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15124a78-5a59-4878-89cd-01ce48c4565f admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:34.390347 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef5435f-60e9-482e-a71f-a43985abe39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:34.390977 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5435f-60e9-482e-a71f-a43985abe39d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:34.391254 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5435f-60e9-482e-a71f-a43985abe39d admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:34.391525 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef5435f-60e9-482e-a71f-a43985abe39d admin admin] PATH_INFO: `/v3/projects/741b8094ae1e46a694be3435fe7f7a29` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:34.392675 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef5435f-60e9-482e-a71f-a43985abe39d admin admin] RBAC: Authorizing `identity:delete_project(project_id=741b8094ae1e46a694be3435fe7f7a29)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:34.394539 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef5435f-60e9-482e-a71f-a43985abe39d admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:34.439966 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-fef5435f-60e9-482e-a71f-a43985abe39d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '741b8094ae1e46a694be3435fe7f7a29', 'request_id': 'req-fef5435f-60e9-482e-a71f-a43985abe39d'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:34.446573 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-fef5435f-60e9-482e-a71f-a43985abe39d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '741b8094ae1e46a694be3435fe7f7a29', 'request_id': 'req-fef5435f-60e9-482e-a71f-a43985abe39d'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:34.452134 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-fef5435f-60e9-482e-a71f-a43985abe39d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '741b8094ae1e46a694be3435fe7f7a29', 'request_id': 'req-fef5435f-60e9-482e-a71f-a43985abe39d'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:34.464434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-fef5435f-60e9-482e-a71f-a43985abe39d admin admin] The token cache is being invalidate because project 741b8094ae1e46a694be3435fe7f7a29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:39:34.464721 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-fef5435f-60e9-482e-a71f-a43985abe39d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:34.465369 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-fef5435f-60e9-482e-a71f-a43985abe39d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:34.466985 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1445/2882] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:39:34 2022] DELETE /identity/v3/projects/741b8094ae1e46a694be3435fe7f7a29 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:39:34.472083 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c0dde-2201-4c3e-afeb-1ea3361e44e4 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:34.472592 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c0dde-2201-4c3e-afeb-1ea3361e44e4 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:34.472705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c0dde-2201-4c3e-afeb-1ea3361e44e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:34.491735 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-440c0dde-2201-4c3e-afeb-1ea3361e44e4 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:39:34.493623 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-440c0dde-2201-4c3e-afeb-1ea3361e44e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:34.554381 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1438/2883] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:39:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 15:39:34.562777 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641b84d-fa59-4876-93fe-65ed12b491a8 None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:34.563070 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641b84d-fa59-4876-93fe-65ed12b491a8 None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:34.563351 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641b84d-fa59-4876-93fe-65ed12b491a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:34.583983 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-c641b84d-fa59-4876-93fe-65ed12b491a8 None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:39:34.585211 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-c641b84d-fa59-4876-93fe-65ed12b491a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:34.593426 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1446/2884] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:39:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:39:34.597665 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c0dde-2201-4c3e-afeb-1ea3361e44e4 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:34.607415 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c0dde-2201-4c3e-afeb-1ea3361e44e4 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:34.611941 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e1ad2-f385-45aa-bfa1-53078748be04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:34.612559 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e1ad2-f385-45aa-bfa1-53078748be04 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:34.612836 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e1ad2-f385-45aa-bfa1-53078748be04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:34.613107 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391e1ad2-f385-45aa-bfa1-53078748be04 admin admin] PATH_INFO: `/v3/domains` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:34.613820 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e1ad2-f385-45aa-bfa1-53078748be04 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80058) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 15:39:34.614121 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e1ad2-f385-45aa-bfa1-53078748be04 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:34.615719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391e1ad2-f385-45aa-bfa1-53078748be04 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:34.627357 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1439/2885] 10.222.0.40 () {58 vars in 1153 bytes} [Wed Jul 27 15:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 15:39:34.631703 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641b84d-fa59-4876-93fe-65ed12b491a8 None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:34.641606 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641b84d-fa59-4876-93fe-65ed12b491a8 None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:34.646397 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836ff46-de85-476c-9418-97e1dae09758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:34.646999 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836ff46-de85-476c-9418-97e1dae09758 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:34.647279 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836ff46-de85-476c-9418-97e1dae09758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:34.647552 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4836ff46-de85-476c-9418-97e1dae09758 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:34.648239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836ff46-de85-476c-9418-97e1dae09758 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:34.650137 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4836ff46-de85-476c-9418-97e1dae09758 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:34.676915 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1447/2886] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:39:34 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:39:34.681491 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e1ad2-f385-45aa-bfa1-53078748be04 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:34.691375 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391e1ad2-f385-45aa-bfa1-53078748be04 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:34.736191 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:39:34.750551 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc212fd-8384-4c1c-b7b3-6ff68a317ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:34.751098 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc212fd-8384-4c1c-b7b3-6ff68a317ab0 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:34.751380 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc212fd-8384-4c1c-b7b3-6ff68a317ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:34.751660 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc212fd-8384-4c1c-b7b3-6ff68a317ab0 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:34.752346 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc212fd-8384-4c1c-b7b3-6ff68a317ab0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:34.754243 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc212fd-8384-4c1c-b7b3-6ff68a317ab0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:34.774213 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1440/2887] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:39:34 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 15:39:34.778416 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836ff46-de85-476c-9418-97e1dae09758 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:34.788866 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4836ff46-de85-476c-9418-97e1dae09758 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:34.793868 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42840c3-7a1e-4a14-abd6-60c9e85ea640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:34.794728 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42840c3-7a1e-4a14-abd6-60c9e85ea640 admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:34.795014 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42840c3-7a1e-4a14-abd6-60c9e85ea640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:34.795290 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42840c3-7a1e-4a14-abd6-60c9e85ea640 admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:34.795981 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42840c3-7a1e-4a14-abd6-60c9e85ea640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:34.797589 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42840c3-7a1e-4a14-abd6-60c9e85ea640 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:34.807897 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1448/2888] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:39:34.811604 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc212fd-8384-4c1c-b7b3-6ff68a317ab0 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:34.822111 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc212fd-8384-4c1c-b7b3-6ff68a317ab0 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:34.826675 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3e490-a10c-41de-abd1-5abcec1d44d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:34.827262 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3e490-a10c-41de-abd1-5abcec1d44d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:34.827539 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3e490-a10c-41de-abd1-5abcec1d44d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:34.827810 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3e490-a10c-41de-abd1-5abcec1d44d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:34.828519 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3e490-a10c-41de-abd1-5abcec1d44d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:34.830082 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3e490-a10c-41de-abd1-5abcec1d44d0 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:34.840424 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1441/2889] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:39:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:39:34.844473 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42840c3-7a1e-4a14-abd6-60c9e85ea640 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:34.855241 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42840c3-7a1e-4a14-abd6-60c9e85ea640 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:34.859841 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3f674-74bc-4450-9f3a-933d4439a7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:34.860524 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3f674-74bc-4450-9f3a-933d4439a7a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:34.860807 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3f674-74bc-4450-9f3a-933d4439a7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:34.861085 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede3f674-74bc-4450-9f3a-933d4439a7a0 admin admin] PATH_INFO: `/v3/projects/9d9b38c2f5774beca95a4af2d174fb70/users/77358dc76f534af48f5839c622cc286b/roles/05b155ad77f0416a85b84ab318160c53` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:34.876108 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede3f674-74bc-4450-9f3a-933d4439a7a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d9b38c2f5774beca95a4af2d174fb70, user_id=77358dc76f534af48f5839c622cc286b, role_id=05b155ad77f0416a85b84ab318160c53)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:34.878782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede3f674-74bc-4450-9f3a-933d4439a7a0 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:34.891108 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1449/2890] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:39:34 2022] PUT /identity/v3/projects/9d9b38c2f5774beca95a4af2d174fb70/users/77358dc76f534af48f5839c622cc286b/roles/05b155ad77f0416a85b84ab318160c53 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:39:34.896085 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc216b-1e21-4671-94b5-27aefc47a82b None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:34.896370 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc216b-1e21-4671-94b5-27aefc47a82b None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:34.896668 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddc216b-1e21-4671-94b5-27aefc47a82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:34.915289 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-0ddc216b-1e21-4671-94b5-27aefc47a82b None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:39:34.916497 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0ddc216b-1e21-4671-94b5-27aefc47a82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:34.974568 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1442/2891] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:39:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:39:34.984571 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3f674-74bc-4450-9f3a-933d4439a7a0 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:34.986223 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ede3f674-74bc-4450-9f3a-933d4439a7a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:34.997369 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:39:35.043077 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede3f674-74bc-4450-9f3a-933d4439a7a0 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:35.046898 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4af52c-23d3-4667-8dd7-a6e6550690ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:35.047527 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4af52c-23d3-4667-8dd7-a6e6550690ed service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:35.047801 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4af52c-23d3-4667-8dd7-a6e6550690ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:35.048111 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4af52c-23d3-4667-8dd7-a6e6550690ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:35.057591 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4af52c-23d3-4667-8dd7-a6e6550690ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:35.058999 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4af52c-23d3-4667-8dd7-a6e6550690ed service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:35.068286 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1450/2892] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:39:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:39:36.252330 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc216b-1e21-4671-94b5-27aefc47a82b None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:36.254364 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-0ddc216b-1e21-4671-94b5-27aefc47a82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:36.274500 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddc216b-1e21-4671-94b5-27aefc47a82b None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:36.279960 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d8be4-0fc8-4273-8f4f-e35018632bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:36.280679 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d8be4-0fc8-4273-8f4f-e35018632bce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:36.280988 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d8be4-0fc8-4273-8f4f-e35018632bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:36.281272 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d8be4-0fc8-4273-8f4f-e35018632bce admin admin] PATH_INFO: `/v3/users/abf414be42824a74919e202e23e53143` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:36.282495 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d8be4-0fc8-4273-8f4f-e35018632bce admin admin] RBAC: Authorizing `identity:delete_user(user_id=abf414be42824a74919e202e23e53143)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:36.284457 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d8be4-0fc8-4273-8f4f-e35018632bce admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:36.364722 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a97d8be4-0fc8-4273-8f4f-e35018632bce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abf414be42824a74919e202e23e53143'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:36.365556 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a97d8be4-0fc8-4273-8f4f-e35018632bce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abf414be42824a74919e202e23e53143'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:36.375596 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a97d8be4-0fc8-4273-8f4f-e35018632bce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abf414be42824a74919e202e23e53143'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:36.376665 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a97d8be4-0fc8-4273-8f4f-e35018632bce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abf414be42824a74919e202e23e53143'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:36.392483 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a97d8be4-0fc8-4273-8f4f-e35018632bce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abf414be42824a74919e202e23e53143'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:36.409710 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1443/2893] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:39:36 2022] DELETE /identity/v3/users/abf414be42824a74919e202e23e53143 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:39:36.414445 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d9c06-dc2f-4ff2-b955-59f9bb184aae None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:36.415017 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d9c06-dc2f-4ff2-b955-59f9bb184aae None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:36.415327 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d9c06-dc2f-4ff2-b955-59f9bb184aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:36.437174 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-cd4d9c06-dc2f-4ff2-b955-59f9bb184aae None None] MFA Rules not processed for user `ad4a70e32c774ff3ae25d8ff565d4a1d`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:39:36.440727 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-cd4d9c06-dc2f-4ff2-b955-59f9bb184aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:36.519640 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1451/2894] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:39:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:39:36.519916 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d8be4-0fc8-4273-8f4f-e35018632bce admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:36.522761 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a97d8be4-0fc8-4273-8f4f-e35018632bce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:36.607915 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:39:36.628630 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d8be4-0fc8-4273-8f4f-e35018632bce admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:36.632366 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77790a3f-b4d2-44d2-80c5-cf2ba391edbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:36.633733 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77790a3f-b4d2-44d2-80c5-cf2ba391edbb service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:36.634035 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77790a3f-b4d2-44d2-80c5-cf2ba391edbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:36.634300 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77790a3f-b4d2-44d2-80c5-cf2ba391edbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:36.644862 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77790a3f-b4d2-44d2-80c5-cf2ba391edbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:36.646382 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77790a3f-b4d2-44d2-80c5-cf2ba391edbb service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:36.659421 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1444/2895] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:39:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 15:39:36.956541 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d9c06-dc2f-4ff2-b955-59f9bb184aae None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:36.958209 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-cd4d9c06-dc2f-4ff2-b955-59f9bb184aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:36.971128 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d9c06-dc2f-4ff2-b955-59f9bb184aae None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:36.978105 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be950fa-51ec-4454-9d64-948b03974cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:36.978771 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be950fa-51ec-4454-9d64-948b03974cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:36.979060 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be950fa-51ec-4454-9d64-948b03974cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:36.979385 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be950fa-51ec-4454-9d64-948b03974cb4 admin admin] PATH_INFO: `/v3/projects/edceb6e015ee44d7a74fc1b703277c49` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:36.980922 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be950fa-51ec-4454-9d64-948b03974cb4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edceb6e015ee44d7a74fc1b703277c49)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:36.986473 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be950fa-51ec-4454-9d64-948b03974cb4 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:37.051938 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7be950fa-51ec-4454-9d64-948b03974cb4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edceb6e015ee44d7a74fc1b703277c49', 'request_id': 'req-7be950fa-51ec-4454-9d64-948b03974cb4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:37.061051 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7be950fa-51ec-4454-9d64-948b03974cb4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edceb6e015ee44d7a74fc1b703277c49', 'request_id': 'req-7be950fa-51ec-4454-9d64-948b03974cb4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:37.067419 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7be950fa-51ec-4454-9d64-948b03974cb4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edceb6e015ee44d7a74fc1b703277c49', 'request_id': 'req-7be950fa-51ec-4454-9d64-948b03974cb4'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:37.081944 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7be950fa-51ec-4454-9d64-948b03974cb4 admin admin] The token cache is being invalidate because project edceb6e015ee44d7a74fc1b703277c49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80057) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:39:37.082239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7be950fa-51ec-4454-9d64-948b03974cb4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:37.083001 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-7be950fa-51ec-4454-9d64-948b03974cb4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:39:37.099138 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1452/2896] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:39:36 2022] DELETE /identity/v3/projects/edceb6e015ee44d7a74fc1b703277c49 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:39:39.117587 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eade0b-198a-4e8f-9dea-cadb2e217fd0 None None] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:39.118558 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eade0b-198a-4e8f-9dea-cadb2e217fd0 None None] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:39.118931 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eade0b-198a-4e8f-9dea-cadb2e217fd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:39.154877 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.auth.core [None req-55eade0b-198a-4e8f-9dea-cadb2e217fd0 None None] MFA Rules not processed for user `77358dc76f534af48f5839c622cc286b`. Rule list: `[]` (Enabled: `True`). {{(pid=80058) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:39:39.156687 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-55eade0b-198a-4e8f-9dea-cadb2e217fd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:39.234120 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1445/2897] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:39:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:39:39.239894 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be950fa-51ec-4454-9d64-948b03974cb4 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:39.241413 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-7be950fa-51ec-4454-9d64-948b03974cb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:39.293607 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:39:39.323461 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be950fa-51ec-4454-9d64-948b03974cb4 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:39.329829 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5ddfe-4444-45d7-8d77-c6b746862228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:39.330455 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5ddfe-4444-45d7-8d77-c6b746862228 admin admin] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:39.330783 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5ddfe-4444-45d7-8d77-c6b746862228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:39.330995 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5ddfe-4444-45d7-8d77-c6b746862228 admin admin] PATH_INFO: `/v3/projects` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:39.331664 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5ddfe-4444-45d7-8d77-c6b746862228 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:39.333728 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5ddfe-4444-45d7-8d77-c6b746862228 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:39.368073 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1453/2898] 10.222.0.40 () {60 vars in 1153 bytes} [Wed Jul 27 15:39:39 2022] POST /identity/v3/projects => generated 373 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:39:39.368287 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eade0b-198a-4e8f-9dea-cadb2e217fd0 None None] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:39.379713 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eade0b-198a-4e8f-9dea-cadb2e217fd0 None None] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:39.449228 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794cab6-3f7f-43c0-a2d3-d1156dd7ce01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:39.449957 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794cab6-3f7f-43c0-a2d3-d1156dd7ce01 admin admin] REQUEST_METHOD: `POST` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:39.450243 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794cab6-3f7f-43c0-a2d3-d1156dd7ce01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:39.450520 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1794cab6-3f7f-43c0-a2d3-d1156dd7ce01 admin admin] PATH_INFO: `/v3/users` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:39.451197 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1794cab6-3f7f-43c0-a2d3-d1156dd7ce01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:39.453287 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1794cab6-3f7f-43c0-a2d3-d1156dd7ce01 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:39.479693 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1446/2899] 10.222.0.40 () {60 vars in 1144 bytes} [Wed Jul 27 15:39:39 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 15:39:39.483175 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5ddfe-4444-45d7-8d77-c6b746862228 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:39.495277 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5ddfe-4444-45d7-8d77-c6b746862228 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:39.499871 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc9af9e-749e-48c2-be33-73ae8f8bd33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:39.500661 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9af9e-749e-48c2-be33-73ae8f8bd33e admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:39.501315 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9af9e-749e-48c2-be33-73ae8f8bd33e admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:39.501315 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc9af9e-749e-48c2-be33-73ae8f8bd33e admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:39.501893 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc9af9e-749e-48c2-be33-73ae8f8bd33e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:39.503532 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc9af9e-749e-48c2-be33-73ae8f8bd33e admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:39.516034 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1454/2900] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 15:39:39.519692 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794cab6-3f7f-43c0-a2d3-d1156dd7ce01 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:39.531289 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1794cab6-3f7f-43c0-a2d3-d1156dd7ce01 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:39.537010 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f75028-daf6-4622-b5ee-2b1eabd6b5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:39.537885 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f75028-daf6-4622-b5ee-2b1eabd6b5dc admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:39.538270 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f75028-daf6-4622-b5ee-2b1eabd6b5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:39.538666 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f75028-daf6-4622-b5ee-2b1eabd6b5dc admin admin] PATH_INFO: `/v3/projects/eaddee7bfd414d179e893615929bbdb4/users/5dcd3c41f33446b4bc25665ab5ed4818/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:39.556640 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f75028-daf6-4622-b5ee-2b1eabd6b5dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaddee7bfd414d179e893615929bbdb4, user_id=5dcd3c41f33446b4bc25665ab5ed4818, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:39.559369 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f75028-daf6-4622-b5ee-2b1eabd6b5dc admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:39.581300 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1447/2901] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:39:39 2022] PUT /identity/v3/projects/eaddee7bfd414d179e893615929bbdb4/users/5dcd3c41f33446b4bc25665ab5ed4818/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:39:39.590325 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc9af9e-749e-48c2-be33-73ae8f8bd33e admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:39.597459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc9af9e-749e-48c2-be33-73ae8f8bd33e admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:39.658785 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15021605-3df1-4f8b-b7f8-3ad73c9b95bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:39.659401 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15021605-3df1-4f8b-b7f8-3ad73c9b95bc admin admin] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:39.659678 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15021605-3df1-4f8b-b7f8-3ad73c9b95bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:39.659949 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15021605-3df1-4f8b-b7f8-3ad73c9b95bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:39.660665 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15021605-3df1-4f8b-b7f8-3ad73c9b95bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:39.662239 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15021605-3df1-4f8b-b7f8-3ad73c9b95bc admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:39.675437 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1455/2902] 10.222.0.40 () {58 vars in 1122 bytes} [Wed Jul 27 15:39:39 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 15:39:39.677953 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f75028-daf6-4622-b5ee-2b1eabd6b5dc admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:39.689259 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f75028-daf6-4622-b5ee-2b1eabd6b5dc admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:39.698744 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5f6ab-976a-451d-a25a-e2806e3f0745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:39.699878 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5f6ab-976a-451d-a25a-e2806e3f0745 admin admin] REQUEST_METHOD: `PUT` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:39.700347 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5f6ab-976a-451d-a25a-e2806e3f0745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:39.700680 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b5f6ab-976a-451d-a25a-e2806e3f0745 admin admin] PATH_INFO: `/v3/projects/eaddee7bfd414d179e893615929bbdb4/users/5dcd3c41f33446b4bc25665ab5ed4818/roles/6535f8b98008471dba33e89bd460880d` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:39.702770 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5f6ab-976a-451d-a25a-e2806e3f0745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaddee7bfd414d179e893615929bbdb4, user_id=5dcd3c41f33446b4bc25665ab5ed4818, role_id=6535f8b98008471dba33e89bd460880d)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:39.706351 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b5f6ab-976a-451d-a25a-e2806e3f0745 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:39.720814 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1448/2903] 10.222.0.40 () {60 vars in 1483 bytes} [Wed Jul 27 15:39:39 2022] PUT /identity/v3/projects/eaddee7bfd414d179e893615929bbdb4/users/5dcd3c41f33446b4bc25665ab5ed4818/roles/6535f8b98008471dba33e89bd460880d => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:39:44.517621 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbac6ea-aaac-4e1c-a7bb-7dba92b27a2e None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:44.518100 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbac6ea-aaac-4e1c-a7bb-7dba92b27a2e None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:44.518100 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbac6ea-aaac-4e1c-a7bb-7dba92b27a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:44.548864 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-1cbac6ea-aaac-4e1c-a7bb-7dba92b27a2e None None] MFA Rules not processed for user `5dcd3c41f33446b4bc25665ab5ed4818`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:39:44.550295 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-1cbac6ea-aaac-4e1c-a7bb-7dba92b27a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:44.625233 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1456/2904] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:39:44 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:39:44.641272 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5f6ab-976a-451d-a25a-e2806e3f0745 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:39:44.643244 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-18b5f6ab-976a-451d-a25a-e2806e3f0745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:44.675426 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:39:44.724234 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b5f6ab-976a-451d-a25a-e2806e3f0745 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:39:44.730263 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c5cc6-6557-45e5-8bad-8842d2fac796 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:39:44.730816 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c5cc6-6557-45e5-8bad-8842d2fac796 service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:44.731098 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c5cc6-6557-45e5-8bad-8842d2fac796 service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:44.731368 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792c5cc6-6557-45e5-8bad-8842d2fac796 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:44.789545 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c5cc6-6557-45e5-8bad-8842d2fac796 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:39:44.791117 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792c5cc6-6557-45e5-8bad-8842d2fac796 service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:39:44.800226 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1449/2905] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:39:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:39:45.785894 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8107dff-cf57-4043-9ec0-eb747e2e300b None None] REQUEST_METHOD: `POST` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:39:45.786459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8107dff-cf57-4043-9ec0-eb747e2e300b None None] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:39:45.786459 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8107dff-cf57-4043-9ec0-eb747e2e300b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:39:45.806197 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.auth.core [None req-d8107dff-cf57-4043-9ec0-eb747e2e300b None None] MFA Rules not processed for user `77358dc76f534af48f5839c622cc286b`. Rule list: `[]` (Enabled: `True`). {{(pid=80057) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 15:39:45.807389 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d8107dff-cf57-4043-9ec0-eb747e2e300b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:39:45.814478 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1457/2906] 10.222.0.40 () {58 vars in 958 bytes} [Wed Jul 27 15:39:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 15:39:54.796326 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=45 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:39:55.800965 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=88,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:40:03.339753 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c5cc6-6557-45e5-8bad-8842d2fac796 service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:40:03.341190 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-792c5cc6-6557-45e5-8bad-8842d2fac796 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:40:03.403705 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792c5cc6-6557-45e5-8bad-8842d2fac796 service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:40:03.407329 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999663eb-d520-4c14-8392-9161fa090e1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20aa56e1154649cb8b440dae788c922c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:40:03.407936 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999663eb-d520-4c14-8392-9161fa090e1d service cinder] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:40:03.408259 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999663eb-d520-4c14-8392-9161fa090e1d service cinder] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:40:03.408533 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999663eb-d520-4c14-8392-9161fa090e1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:40:03.410286 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-999663eb-d520-4c14-8392-9161fa090e1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:40:03.424304 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999663eb-d520-4c14-8392-9161fa090e1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:40:03.425711 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999663eb-d520-4c14-8392-9161fa090e1d service cinder] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:40:03.437314 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1450/2907] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:40:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:40:04.161463 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8107dff-cf57-4043-9ec0-eb747e2e300b None None] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:40:04.162906 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-d8107dff-cf57-4043-9ec0-eb747e2e300b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:40:04.225719 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8107dff-cf57-4043-9ec0-eb747e2e300b None None] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:40:04.229294 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f63d8-ffca-4ef4-a74b-8dd29bc0e934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:40:04.229909 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f63d8-ffca-4ef4-a74b-8dd29bc0e934 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:40:04.230193 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f63d8-ffca-4ef4-a74b-8dd29bc0e934 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:40:04.230462 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835f63d8-ffca-4ef4-a74b-8dd29bc0e934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:40:04.232299 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-835f63d8-ffca-4ef4-a74b-8dd29bc0e934 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:40:04.245903 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f63d8-ffca-4ef4-a74b-8dd29bc0e934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:40:04.247334 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835f63d8-ffca-4ef4-a74b-8dd29bc0e934 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:40:04.259023 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1458/2908] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:40:04 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:40:13.431803 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=26 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:40:14.253887 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=26 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:40:16.149509 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999663eb-d520-4c14-8392-9161fa090e1d service cinder] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:40:16.159014 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999663eb-d520-4c14-8392-9161fa090e1d service cinder] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:40:16.162625 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a824124-ab57-4b89-ac12-ab7b6e48d7bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:40:16.163228 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a824124-ab57-4b89-ac12-ab7b6e48d7bd service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:40:16.163508 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a824124-ab57-4b89-ac12-ab7b6e48d7bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:40:16.163780 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a824124-ab57-4b89-ac12-ab7b6e48d7bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:40:16.173388 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a824124-ab57-4b89-ac12-ab7b6e48d7bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:40:16.174797 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a824124-ab57-4b89-ac12-ab7b6e48d7bd service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:40:16.184817 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1451/2909] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:40:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:40:26.180046 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=6 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:41:09.712277 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f63d8-ffca-4ef4-a74b-8dd29bc0e934 service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:41:09.713751 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-835f63d8-ffca-4ef4-a74b-8dd29bc0e934 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:41:09.724528 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835f63d8-ffca-4ef4-a74b-8dd29bc0e934 service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:41:09.728165 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be38ee8-af16-46be-a53f-cb4abcf58971 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:41:09.728770 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be38ee8-af16-46be-a53f-cb4abcf58971 service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:41:09.729051 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be38ee8-af16-46be-a53f-cb4abcf58971 service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:41:09.729326 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be38ee8-af16-46be-a53f-cb4abcf58971 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:41:09.731027 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-6be38ee8-af16-46be-a53f-cb4abcf58971 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:41:09.740807 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be38ee8-af16-46be-a53f-cb4abcf58971 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:41:09.742223 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be38ee8-af16-46be-a53f-cb4abcf58971 service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:41:09.750749 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1459/2910] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:41:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:41:19.746724 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=6 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:42:57.416325 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a824124-ab57-4b89-ac12-ab7b6e48d7bd service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:42:57.437771 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a824124-ab57-4b89-ac12-ab7b6e48d7bd service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:42:57.441605 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f538436-0f89-49aa-9eee-4ae5f03dd64e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:42:57.442300 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f538436-0f89-49aa-9eee-4ae5f03dd64e service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:42:57.442645 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f538436-0f89-49aa-9eee-4ae5f03dd64e service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:42:57.442982 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f538436-0f89-49aa-9eee-4ae5f03dd64e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:42:57.444939 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6f538436-0f89-49aa-9eee-4ae5f03dd64e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:42:57.475870 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f538436-0f89-49aa-9eee-4ae5f03dd64e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:42:57.477442 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f538436-0f89-49aa-9eee-4ae5f03dd64e service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:42:57.489337 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1452/2911] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:42:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:42:57.567946 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be38ee8-af16-46be-a53f-cb4abcf58971 service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:42:57.587316 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be38ee8-af16-46be-a53f-cb4abcf58971 service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:42:57.591066 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a20d6f-db7c-4dc5-8f58-5cc9f8eaa2ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:42:57.591691 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a20d6f-db7c-4dc5-8f58-5cc9f8eaa2ab service neutron] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:42:57.591976 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a20d6f-db7c-4dc5-8f58-5cc9f8eaa2ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:42:57.592282 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a20d6f-db7c-4dc5-8f58-5cc9f8eaa2ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:42:57.594030 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-10a20d6f-db7c-4dc5-8f58-5cc9f8eaa2ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:42:57.635355 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a20d6f-db7c-4dc5-8f58-5cc9f8eaa2ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:42:57.636556 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a20d6f-db7c-4dc5-8f58-5cc9f8eaa2ab service neutron] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:42:57.650562 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1460/2912] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:42:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:42:57.712128 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f538436-0f89-49aa-9eee-4ae5f03dd64e service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:42:57.713578 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6f538436-0f89-49aa-9eee-4ae5f03dd64e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:42:57.801770 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f538436-0f89-49aa-9eee-4ae5f03dd64e service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:42:57.806767 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fefbae4-32ac-4607-801c-587a8172cf23 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a386d326dc634cbd943ac30f6e8d08bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:42:57.807379 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fefbae4-32ac-4607-801c-587a8172cf23 service placement] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:42:57.807664 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fefbae4-32ac-4607-801c-587a8172cf23 service placement] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:42:57.807946 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fefbae4-32ac-4607-801c-587a8172cf23 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:42:57.809711 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1fefbae4-32ac-4607-801c-587a8172cf23 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:42:57.821025 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fefbae4-32ac-4607-801c-587a8172cf23 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:42:57.822588 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fefbae4-32ac-4607-801c-587a8172cf23 service placement] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:42:57.832898 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1453/2913] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:42:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:42:58.800338 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a20d6f-db7c-4dc5-8f58-5cc9f8eaa2ab service neutron] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:42:58.812857 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a20d6f-db7c-4dc5-8f58-5cc9f8eaa2ab service neutron] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:42:58.819012 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed983f70-70d6-4a51-a3b9-d953e3a946f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:42:58.819874 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed983f70-70d6-4a51-a3b9-d953e3a946f0 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:42:58.820192 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed983f70-70d6-4a51-a3b9-d953e3a946f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:42:58.820730 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed983f70-70d6-4a51-a3b9-d953e3a946f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:42:58.822509 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-ed983f70-70d6-4a51-a3b9-d953e3a946f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:42:58.835561 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed983f70-70d6-4a51-a3b9-d953e3a946f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:42:58.837263 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed983f70-70d6-4a51-a3b9-d953e3a946f0 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:42:58.849624 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1461/2914] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:42:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:43:07.828228 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=60 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:43:08.843730 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=29 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:44:04.073456 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fefbae4-32ac-4607-801c-587a8172cf23 service placement] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:44:04.074848 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-1fefbae4-32ac-4607-801c-587a8172cf23 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:44:04.088202 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fefbae4-32ac-4607-801c-587a8172cf23 service placement] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:44:04.093199 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5aa19-8d73-4c63-9f91-370e68ec0c31 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a386d326dc634cbd943ac30f6e8d08bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:44:04.093799 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5aa19-8d73-4c63-9f91-370e68ec0c31 service placement] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:44:04.094082 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5aa19-8d73-4c63-9f91-370e68ec0c31 service placement] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:44:04.094358 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf5aa19-8d73-4c63-9f91-370e68ec0c31 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:44:04.096067 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6cf5aa19-8d73-4c63-9f91-370e68ec0c31 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:44:04.107168 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5aa19-8d73-4c63-9f91-370e68ec0c31 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:44:04.108760 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf5aa19-8d73-4c63-9f91-370e68ec0c31 service placement] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:44:04.118557 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1454/2915] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:44:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:44:14.114410 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=6 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:44:44.936914 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed983f70-70d6-4a51-a3b9-d953e3a946f0 service nova] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:44:44.947192 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5aa19-8d73-4c63-9f91-370e68ec0c31 service placement] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:44:44.949612 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-6cf5aa19-8d73-4c63-9f91-370e68ec0c31 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:44:44.965568 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed983f70-70d6-4a51-a3b9-d953e3a946f0 service nova] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:44:44.971635 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064de6d5-8281-4103-bd04-d1c34f5913d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:44:44.972286 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064de6d5-8281-4103-bd04-d1c34f5913d7 service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:44:44.972569 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064de6d5-8281-4103-bd04-d1c34f5913d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:44:44.972844 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064de6d5-8281-4103-bd04-d1c34f5913d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:44:44.981498 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064de6d5-8281-4103-bd04-d1c34f5913d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:44:44.983554 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf5aa19-8d73-4c63-9f91-370e68ec0c31 service placement] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:44:44.984137 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064de6d5-8281-4103-bd04-d1c34f5913d7 service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:44:44.992029 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5702161-4d2f-4f8e-85b5-50497268212e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:44:44.993101 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5702161-4d2f-4f8e-85b5-50497268212e service nova] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:44:44.993637 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5702161-4d2f-4f8e-85b5-50497268212e service nova] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:44:44.994121 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5702161-4d2f-4f8e-85b5-50497268212e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:44:44.995266 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1462/2916] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:44:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:44:44.996890 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a5702161-4d2f-4f8e-85b5-50497268212e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:44:45.010232 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5702161-4d2f-4f8e-85b5-50497268212e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:44:45.011894 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5702161-4d2f-4f8e-85b5-50497268212e service nova] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:44:45.024227 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1455/2917] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:44:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:44:47.428222 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064de6d5-8281-4103-bd04-d1c34f5913d7 service nova] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:44:47.439795 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064de6d5-8281-4103-bd04-d1c34f5913d7 service nova] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:44:47.445913 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f4ca2-35e3-4372-90a0-25a12a29d30b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd3e01aa0ef1340cbba7170bac4a82783', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:44:47.446519 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f4ca2-35e3-4372-90a0-25a12a29d30b service nova] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:44:47.446797 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f4ca2-35e3-4372-90a0-25a12a29d30b service nova] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:44:47.447068 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653f4ca2-35e3-4372-90a0-25a12a29d30b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:44:47.448834 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-653f4ca2-35e3-4372-90a0-25a12a29d30b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:44:47.462410 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f4ca2-35e3-4372-90a0-25a12a29d30b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:44:47.465232 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653f4ca2-35e3-4372-90a0-25a12a29d30b service nova] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:44:47.478070 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1463/2918] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:44:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:44:49.092384 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5702161-4d2f-4f8e-85b5-50497268212e service nova] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:44:49.111407 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5702161-4d2f-4f8e-85b5-50497268212e service nova] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:44:49.114992 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40276927-6232-44b5-a7ed-6d1e0f85cd80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '227dac1eaefc4d0a8d3cc8a6dee2ecba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:44:49.116119 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40276927-6232-44b5-a7ed-6d1e0f85cd80 service neutron] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:44:49.116401 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40276927-6232-44b5-a7ed-6d1e0f85cd80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:44:49.116674 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40276927-6232-44b5-a7ed-6d1e0f85cd80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:44:49.118416 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-40276927-6232-44b5-a7ed-6d1e0f85cd80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:44:49.209599 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40276927-6232-44b5-a7ed-6d1e0f85cd80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:44:49.211024 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40276927-6232-44b5-a7ed-6d1e0f85cd80 service neutron] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:44:49.229447 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1456/2919] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:44:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:44:51.991211 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f4ca2-35e3-4372-90a0-25a12a29d30b service nova] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:44:52.004447 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653f4ca2-35e3-4372-90a0-25a12a29d30b service nova] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:44:52.010646 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c8104-fa1a-49cf-bdfc-175fbe9743b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a386d326dc634cbd943ac30f6e8d08bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:44:52.011434 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c8104-fa1a-49cf-bdfc-175fbe9743b8 service placement] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:44:52.011816 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c8104-fa1a-49cf-bdfc-175fbe9743b8 service placement] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:44:52.012231 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51c8104-fa1a-49cf-bdfc-175fbe9743b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:44:52.014306 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-e51c8104-fa1a-49cf-bdfc-175fbe9743b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:44:52.027663 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c8104-fa1a-49cf-bdfc-175fbe9743b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:44:52.029747 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51c8104-fa1a-49cf-bdfc-175fbe9743b8 service placement] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:44:52.041989 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1464/2920] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:44:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:44:55.092599 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40276927-6232-44b5-a7ed-6d1e0f85cd80 service neutron] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:44:55.107140 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40276927-6232-44b5-a7ed-6d1e0f85cd80 service neutron] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:44:55.114140 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee736d2-fb30-446b-bf64-68aa42e2e1f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a386d326dc634cbd943ac30f6e8d08bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:44:55.114794 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee736d2-fb30-446b-bf64-68aa42e2e1f0 service placement] REQUEST_METHOD: `GET` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:44:55.115097 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee736d2-fb30-446b-bf64-68aa42e2e1f0 service placement] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:44:55.115861 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee736d2-fb30-446b-bf64-68aa42e2e1f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:44:55.117721 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-4ee736d2-fb30-446b-bf64-68aa42e2e1f0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:44:55.132297 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee736d2-fb30-446b-bf64-68aa42e2e1f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:44:55.134181 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee736d2-fb30-446b-bf64-68aa42e2e1f0 service placement] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:44:55.145526 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1457/2921] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:44:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 15:44:55.179530 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c8104-fa1a-49cf-bdfc-175fbe9743b8 service placement] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:44:55.195630 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51c8104-fa1a-49cf-bdfc-175fbe9743b8 service placement] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:44:55.199935 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5240c-8ea5-48b5-9ba9-b7cb72611b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:44:55.200668 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5240c-8ea5-48b5-9ba9-b7cb72611b45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:44:55.200948 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5240c-8ea5-48b5-9ba9-b7cb72611b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:44:55.201232 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f5240c-8ea5-48b5-9ba9-b7cb72611b45 admin admin] PATH_INFO: `/v3/users/77358dc76f534af48f5839c622cc286b` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:44:55.202510 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5240c-8ea5-48b5-9ba9-b7cb72611b45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77358dc76f534af48f5839c622cc286b)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:44:55.204681 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f5240c-8ea5-48b5-9ba9-b7cb72611b45 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:44:55.258146 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b0f5240c-8ea5-48b5-9ba9-b7cb72611b45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77358dc76f534af48f5839c622cc286b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:44:55.258801 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b0f5240c-8ea5-48b5-9ba9-b7cb72611b45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77358dc76f534af48f5839c622cc286b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:44:55.267221 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b0f5240c-8ea5-48b5-9ba9-b7cb72611b45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77358dc76f534af48f5839c622cc286b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:44:55.274695 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b0f5240c-8ea5-48b5-9ba9-b7cb72611b45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77358dc76f534af48f5839c622cc286b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:44:55.286915 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-b0f5240c-8ea5-48b5-9ba9-b7cb72611b45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77358dc76f534af48f5839c622cc286b'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:44:55.293288 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1465/2922] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:44:55 2022] DELETE /identity/v3/users/77358dc76f534af48f5839c622cc286b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:44:55.475509 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee736d2-fb30-446b-bf64-68aa42e2e1f0 service placement] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:44:55.486745 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee736d2-fb30-446b-bf64-68aa42e2e1f0 service placement] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:44:55.543299 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1969b3e-2a7a-40ea-be2e-0ca7fcb17274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:44:55.543931 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1969b3e-2a7a-40ea-be2e-0ca7fcb17274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:44:55.544238 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1969b3e-2a7a-40ea-be2e-0ca7fcb17274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:44:55.544510 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1969b3e-2a7a-40ea-be2e-0ca7fcb17274 admin admin] PATH_INFO: `/v3/projects/9d9b38c2f5774beca95a4af2d174fb70` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:44:55.545670 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1969b3e-2a7a-40ea-be2e-0ca7fcb17274 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d9b38c2f5774beca95a4af2d174fb70)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:44:55.547794 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1969b3e-2a7a-40ea-be2e-0ca7fcb17274 admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:44:55.570398 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:SELECT=100 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:44:55.592394 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a1969b3e-2a7a-40ea-be2e-0ca7fcb17274 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d9b38c2f5774beca95a4af2d174fb70', 'request_id': 'req-a1969b3e-2a7a-40ea-be2e-0ca7fcb17274'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:44:55.598367 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a1969b3e-2a7a-40ea-be2e-0ca7fcb17274 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d9b38c2f5774beca95a4af2d174fb70', 'request_id': 'req-a1969b3e-2a7a-40ea-be2e-0ca7fcb17274'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:44:55.604340 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a1969b3e-2a7a-40ea-be2e-0ca7fcb17274 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d9b38c2f5774beca95a4af2d174fb70', 'request_id': 'req-a1969b3e-2a7a-40ea-be2e-0ca7fcb17274'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:44:55.617045 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a1969b3e-2a7a-40ea-be2e-0ca7fcb17274 admin admin] The token cache is being invalidate because project 9d9b38c2f5774beca95a4af2d174fb70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:44:55.617333 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a1969b3e-2a7a-40ea-be2e-0ca7fcb17274 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:44:55.617953 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-a1969b3e-2a7a-40ea-be2e-0ca7fcb17274 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:44:55.619495 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1458/2923] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:44:55 2022] DELETE /identity/v3/projects/9d9b38c2f5774beca95a4af2d174fb70 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:44:55.623540 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5240c-8ea5-48b5-9ba9-b7cb72611b45 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:44:55.624992 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-b0f5240c-8ea5-48b5-9ba9-b7cb72611b45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:44:55.638135 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f5240c-8ea5-48b5-9ba9-b7cb72611b45 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:44:55.693717 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd523f17-76ae-4fb4-ba8a-b3a8ff505b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:44:55.694275 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd523f17-76ae-4fb4-ba8a-b3a8ff505b80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:44:55.694556 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd523f17-76ae-4fb4-ba8a-b3a8ff505b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:44:55.694829 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd523f17-76ae-4fb4-ba8a-b3a8ff505b80 admin admin] PATH_INFO: `/v3/users/5dcd3c41f33446b4bc25665ab5ed4818` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:44:55.696018 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd523f17-76ae-4fb4-ba8a-b3a8ff505b80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5dcd3c41f33446b4bc25665ab5ed4818)` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:44:55.697941 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd523f17-76ae-4fb4-ba8a-b3a8ff505b80 admin admin] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:44:55.726462 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:44:55.746766 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-fd523f17-76ae-4fb4-ba8a-b3a8ff505b80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5dcd3c41f33446b4bc25665ab5ed4818'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:44:55.747414 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-fd523f17-76ae-4fb4-ba8a-b3a8ff505b80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5dcd3c41f33446b4bc25665ab5ed4818'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:44:55.755554 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-fd523f17-76ae-4fb4-ba8a-b3a8ff505b80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5dcd3c41f33446b4bc25665ab5ed4818'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:44:55.762483 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-fd523f17-76ae-4fb4-ba8a-b3a8ff505b80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5dcd3c41f33446b4bc25665ab5ed4818'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:44:55.774151 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.notifications [None req-fd523f17-76ae-4fb4-ba8a-b3a8ff505b80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5dcd3c41f33446b4bc25665ab5ed4818'} {{(pid=80057) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:44:55.780092 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1466/2924] 10.222.0.40 () {58 vars in 1224 bytes} [Wed Jul 27 15:44:55 2022] DELETE /identity/v3/users/5dcd3c41f33446b4bc25665ab5ed4818 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:44:55.953231 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1969b3e-2a7a-40ea-be2e-0ca7fcb17274 admin admin] Authenticating user token {{(pid=80058) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:44:55.954825 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.fernet_utils [None req-a1969b3e-2a7a-40ea-be2e-0ca7fcb17274 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80058) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:44:55.968118 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1969b3e-2a7a-40ea-be2e-0ca7fcb17274 admin admin] Validating token access rules against request {{(pid=80058) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:44:56.024869 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542db85d-e325-4a29-9ddb-79374ecc1e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad4a70e32c774ff3ae25d8ff565d4a1d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cee0118499d467da89c121f8970b184', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80058) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:44:56.025503 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542db85d-e325-4a29-9ddb-79374ecc1e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:44:56.025786 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542db85d-e325-4a29-9ddb-79374ecc1e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:44:56.026064 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542db85d-e325-4a29-9ddb-79374ecc1e6a admin admin] PATH_INFO: `/v3/projects/eaddee7bfd414d179e893615929bbdb4` {{(pid=80058) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:44:56.027208 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542db85d-e325-4a29-9ddb-79374ecc1e6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaddee7bfd414d179e893615929bbdb4)` {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:44:56.029236 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542db85d-e325-4a29-9ddb-79374ecc1e6a admin admin] RBAC: Authorization granted {{(pid=80058) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:44:56.073760 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-542db85d-e325-4a29-9ddb-79374ecc1e6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaddee7bfd414d179e893615929bbdb4', 'request_id': 'req-542db85d-e325-4a29-9ddb-79374ecc1e6a'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:44:56.079657 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-542db85d-e325-4a29-9ddb-79374ecc1e6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaddee7bfd414d179e893615929bbdb4', 'request_id': 'req-542db85d-e325-4a29-9ddb-79374ecc1e6a'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:44:56.085719 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-542db85d-e325-4a29-9ddb-79374ecc1e6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaddee7bfd414d179e893615929bbdb4', 'request_id': 'req-542db85d-e325-4a29-9ddb-79374ecc1e6a'} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:44:56.097223 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-542db85d-e325-4a29-9ddb-79374ecc1e6a admin admin] The token cache is being invalidate because project eaddee7bfd414d179e893615929bbdb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80058) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 15:44:56.097797 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-542db85d-e325-4a29-9ddb-79374ecc1e6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:44:56.098125 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG keystone.notifications [None req-542db85d-e325-4a29-9ddb-79374ecc1e6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80058) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 15:44:56.100441 dv-cinder-841315-2-smb devstack@keystone.service[80058]: [pid: 80058|app: 0|req: 1459/2925] 10.222.0.40 () {58 vars in 1233 bytes} [Wed Jul 27 15:44:55 2022] DELETE /identity/v3/projects/eaddee7bfd414d179e893615929bbdb4 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 15:45:05.776564 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:DELETE=6,keystone:SELECT=19,keystone:INSERT=1 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:45:06.094262 dv-cinder-841315-2-smb devstack@keystone.service[80058]: DEBUG dbcounter [-] [80058] Writing DB stats keystone:DELETE=14,keystone:SELECT=66,keystone:INSERT=2 {{(pid=80058) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 15:49:09.004084 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd523f17-76ae-4fb4-ba8a-b3a8ff505b80 admin admin] Authenticating user token {{(pid=80057) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 15:49:09.005506 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-fd523f17-76ae-4fb4-ba8a-b3a8ff505b80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:49:09.072725 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd523f17-76ae-4fb4-ba8a-b3a8ff505b80 admin admin] Validating token access rules against request {{(pid=80057) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 15:49:09.131884 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd0593-d989-487a-aa60-89fafc9417de service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a386d326dc634cbd943ac30f6e8d08bc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b616213eaea4a22afee15d4cbe5a3c5', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80057) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 15:49:09.132533 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd0593-d989-487a-aa60-89fafc9417de service placement] REQUEST_METHOD: `GET` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 15:49:09.132810 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd0593-d989-487a-aa60-89fafc9417de service placement] SCRIPT_NAME: `/identity` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 15:49:09.133080 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd0593-d989-487a-aa60-89fafc9417de service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80057) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 15:49:09.134782 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.fernet_utils [None req-2ecd0593-d989-487a-aa60-89fafc9417de service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80057) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 15:49:09.146289 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd0593-d989-487a-aa60-89fafc9417de service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 15:49:09.147847 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd0593-d989-487a-aa60-89fafc9417de service placement] RBAC: Authorization granted {{(pid=80057) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 15:49:09.158251 dv-cinder-841315-2-smb devstack@keystone.service[80057]: [pid: 80057|app: 0|req: 1467/2926] 10.222.0.40 () {60 vars in 1365 bytes} [Wed Jul 27 15:49:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 15:49:19.154116 dv-cinder-841315-2-smb devstack@keystone.service[80057]: DEBUG dbcounter [-] [80057] Writing DB stats keystone:SELECT=58 {{(pid=80057) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}